Nov 04 01:07:36.777287 ip-10-0-128-142 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Nov 04 01:07:36.777301 ip-10-0-128-142 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Nov 04 01:07:36.777312 ip-10-0-128-142 systemd[1]: kubelet.service: Failed with result 'resources'.
Nov 04 01:07:36.777629 ip-10-0-128-142 systemd[1]: Failed to start Kubernetes Kubelet.
Nov 04 01:07:46.881895 ip-10-0-128-142 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Nov 04 01:07:46.881909 ip-10-0-128-142 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bdb09196680042a794313d569a5e3460 --
Nov 04 01:09:55.833821 ip-10-0-128-142 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 01:09:56.276177 ip-10-0-128-142 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:09:56.276177 ip-10-0-128-142 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 01:09:56.276177 ip-10-0-128-142 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:09:56.276177 ip-10-0-128-142 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:09:56.279728 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279638    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:09:56.279728 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279725    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:09:56.279728 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279732    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:09:56.279728 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279737    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279742    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279746    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279750    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279754    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279757    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279761    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279765    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279768    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279772    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279776    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279780    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279784    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279788    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279792    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279795    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279799    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279803    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279807    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:09:56.279992 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279811    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279816    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279819    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279824    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279828    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279843    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279848    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279852    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279856    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279861    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279865    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279870    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279875    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279879    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279884    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279888    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279892    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279900    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279905    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279909    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:09:56.280708 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279914    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279918    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279922    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279926    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279930    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279935    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279939    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279943    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279947    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279951    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279956    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279960    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279965    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279969    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279974    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279978    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279983    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279987    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279993    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:09:56.281219 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.279997    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280002    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280006    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280010    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280014    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280018    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280023    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280028    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280032    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280038    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280042    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280046    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280050    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280055    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280059    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280064    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280068    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280073    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280077    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280081    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:09:56.282016 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280085    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280089    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280094    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280098    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280103    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280108    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280112    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280117    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280122    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280126    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280130    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280134    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280148    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280153    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280158    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280163    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280167    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280171    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280176    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280192    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:09:56.282894 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280196    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280201    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280205    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280209    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.280214    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282314    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282328    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282333    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282338    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282343    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282347    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282351    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282356    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282360    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282366    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282370    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282374    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282379    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282384    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282388    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:09:56.283742 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282393    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282398    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282402    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282406    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282410    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282416    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282421    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282424    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282430    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282434    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282438    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282442    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282447    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282451    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282456    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282460    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282464    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282469    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282474    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282478    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:09:56.284636 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282483    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282487    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282491    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282495    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282502    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282508    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282514    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282521    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282526    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282547    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282552    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282556    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282561    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282565    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282569    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282575    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282579    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282584    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282589    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:09:56.285376 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282594    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282598    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282602    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282607    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282611    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282615    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282620    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282624    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282628    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282632    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282638    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282643    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282647    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282652    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282656    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282660    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282665    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282669    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282673    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282677    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:09:56.286059 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282681    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282685    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282690    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282694    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282698    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282702    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282706    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282710    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282714    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282719    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282723    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282727    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282732    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282737    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282741    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282746    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282750    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282755    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282759    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282764    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:09:56.286588 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282768    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282772    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282777    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282782    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282786    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282790    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282794    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282799    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282803    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282807    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282813    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.282817    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283666    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283676    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283682    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283686    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283690    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283695    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283699    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283703    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:09:56.287117 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283708    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283713    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283717    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283721    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283727    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283732    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283736    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283740    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283745    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283749    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283753    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283757    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283761    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283765    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283770    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283774    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283778    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283782    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283787    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283791    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:09:56.287605 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283795    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283800    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283804    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283808    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283813    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283817    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283821    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283826    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283830    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283834    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283841    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283845    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283849    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283853    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283858    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283864    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283870    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283876    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283882    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:09:56.288080 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283886    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283891    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283895    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283899    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283903    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283907    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283912    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283916    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283920    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283926    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283930    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283934    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283939    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283943    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283948    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283952    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283956    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283963    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283970    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:09:56.288574 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283975    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283982    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283987    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283992    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.283998    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284003    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284007    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284011    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284016    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284020    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284024    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284029    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284033    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284038    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284042    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284046    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284051    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284055    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284059    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284063    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:09:56.289022 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284067    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284071    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284075    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284080    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284084    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284088    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284092    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284097    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284102    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284106    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284110    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284114    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284119    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284126    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284131    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284135    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284141    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284146    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284150    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.284156    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:09:56.289481 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284287    2578 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284299    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284308    2578 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284315    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284323    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284329    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284336    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284343    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284348    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284352    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284359    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284364    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284370    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284375    2578 flags.go:64] FLAG: --cgroup-root=""
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284379    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284384    2578 flags.go:64] FLAG: --client-ca-file=""
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284389    2578 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284393    2578 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284433    2578 flags.go:64] FLAG: --cluster-domain=""
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284438    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284444    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284450    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284456    2578 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284462    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 01:09:56.290006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284468    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284475    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284481    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284486    2578 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284493    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284498    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284503    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284508    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284515    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284520    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284525    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284548    2578 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284554    2578 flags.go:64] FLAG: --enable-server="true"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284559    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284581    2578 flags.go:64] FLAG: --event-burst="100"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284587    2578 flags.go:64] FLAG: --event-qps="50"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284591    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284597    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284602    2578 flags.go:64] FLAG: --eviction-hard=""
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284609    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284614    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284619    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284624    2578 flags.go:64] FLAG: --eviction-soft=""
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284629    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284634    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 01:09:56.290598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284639    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284643    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284648    2578 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284652    2578 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284657    2578 flags.go:64] FLAG: --feature-gates=""
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284663    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284668    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284674    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284681    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284687    2578 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284692    2578 flags.go:64] FLAG: --help="false"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284698    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284704    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284709    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284714    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284720    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284726    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284730    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284735    2578 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284740    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284745    2578 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284749    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284756    2578 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284761    2578 flags.go:64] FLAG: --kube-reserved=""
Nov 04 01:09:56.291245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284766    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284770    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284775    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284780    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284784    2578 flags.go:64] FLAG: --lock-file=""
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284789    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284794    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284799    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284808    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284813    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284818    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284823    2578 flags.go:64] FLAG: --logging-format="text"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284828    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284833    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284838    2578 flags.go:64] FLAG: --manifest-url=""
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284843    2578 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284859    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284864    2578 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284870    2578 flags.go:64] FLAG: --max-pods="110"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284876    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284881    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284887    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284891    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284896    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284901    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 01:09:56.291842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284906    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284917    2578 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284922    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284928    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284933    2578 flags.go:64] FLAG: --pod-cidr=""
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284938    2578 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284943    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284948    2578 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284953    2578 flags.go:64] FLAG: --port="10250"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284958    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284963    2578 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-02d69b6a52ac63d65"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284968    2578 flags.go:64] FLAG: --qos-reserved=""
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284973    2578 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284978    2578 flags.go:64] FLAG: --register-node="true"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284984    2578 flags.go:64] FLAG: --register-with-taints=""
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284990    2578 flags.go:64] FLAG: --registry-burst="10"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.284994    2578 flags.go:64] FLAG: --registry-qps="5"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285000    2578 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285004    2578 flags.go:64] FLAG: --reserved-memory=""
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285011    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285016    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285021    2578 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285026    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285033    2578 flags.go:64] FLAG: --runonce="false"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285038    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285042    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285049    2578 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 01:09:56.292435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285054    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285059    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285064    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285069    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285074    2578 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285079    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285085    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285089    2578 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285094    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285098    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285103    2578 flags.go:64] FLAG: --system-cgroups=""
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285108    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285150    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285157    2578 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285161    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285169    2578 flags.go:64] FLAG: --tls-min-version=""
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285173    2578 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285176    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285179    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285183    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285188    2578 flags.go:64] FLAG: --v="2"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285200    2578 flags.go:64] FLAG: --version="false"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285205    2578 flags.go:64] FLAG: --vmodule=""
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285210    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.285213    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 01:09:56.293074 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287002    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287020    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287023    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287026    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287029    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287032    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287035    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287038    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287060    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287064    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287068    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287071    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287075    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287078    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287081    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287083    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287086    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287090    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287092    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287095    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:09:56.293709 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287097    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287100    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287103    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287105    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287108    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287111    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287113    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287116    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287118    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287121    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287125    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287128    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287131    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287135    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287138    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287140    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287143    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287145    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287148    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:09:56.294196 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287150    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287153    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287156    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287158    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287161    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287164    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287166    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287169    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287172    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287175    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287178    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287180    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287184    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287188    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287191    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287194    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287196    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287199    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287201    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:09:56.294702 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287204    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287206    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287209    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287212    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287215    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287217    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287220    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287224    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287228    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287232    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287235    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287238    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287241    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287243    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287246    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287248    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287251    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287254    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287257    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:09:56.295162 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287260    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287262    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287265    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287267    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287270    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287272    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287276    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287279    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287281    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287284    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287286    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287289    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287291    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287294    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287297    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287300    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287302    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287305    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287307    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287310    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:09:56.295628 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287313    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287316    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287318    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287321    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287324    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287326    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287329    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287331    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287334    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.287366    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287410    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287417    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287421    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287425    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287428    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287431    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:09:56.296094 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287434    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287436    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287439    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287442    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287445    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287448    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287451    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287454    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287456    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287459    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287463    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287467    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287470    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287473    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287475    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287478    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287481    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287483    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287486    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:09:56.296484 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287489    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287492    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287495    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287497    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287500    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287502    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287505    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287507    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287510    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287512    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287515    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287517    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287520    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287522    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287525    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287528    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287544    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287548    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287551    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287553    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:09:56.296940 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287556    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287559    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287562    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287565    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287567    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287570    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287573    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287575    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287578    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287581    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287584    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287586    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287589    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287591    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287594    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287596    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287599    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287602    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287604    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287607    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:09:56.297405 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287610    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287612    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287615    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287619    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287624    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287627    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287630    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287632    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287635    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287640    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287643    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287646    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287649    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287652    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287655    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287657    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287660    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287663    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287665    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287668    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:09:56.297893 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287670    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287673    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287675    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287678    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287680    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287683    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287686    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287689    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287691    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287694    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287696    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287699    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287702    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287705    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287707    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287710    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287714    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287717    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287720    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:09:56.298371 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287724    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.287726    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.294941    2578 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.294957    2578 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.294972    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.294976    2578 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295036    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295041    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295044    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295048    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295052    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295054    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295057    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295060    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295063    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295065    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295068    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295071    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295073    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295076    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:09:56.298866 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295079    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295082    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295085    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295087    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295090    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295092    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295095    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295098    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295100    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295103    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295106    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295108    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295111    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295113    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295116    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295119    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295123    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295126    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295128    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:09:56.299345 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295131    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295134    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295136    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295139    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295142    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295144    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295148    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295153    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295156    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295160    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295173    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295176    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295179    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295183    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295188    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295192    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295196    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295200    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295205    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:09:56.299956 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295209    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295213    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295215    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295218    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295220    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295223    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295226    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295229    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295231    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295235    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295238    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295242    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295245    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295247    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295250    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295253    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295256    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295258    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295261    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295264    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:09:56.300434 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295266    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295269    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295272    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295274    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295277    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295279    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295282    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295285    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295287    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295290    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295293    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295296    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295298    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295301    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295303    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295306    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295309    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295311    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295314    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:09:56.300999 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295316    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295319    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295323    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295325    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295328    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295331    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295334    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295336    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295339    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295341    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295344    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295347    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295349    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295351    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295354    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.295383    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:09:56.301459 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295527    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295542    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295545    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295549    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295552    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295554    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295557    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295560    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295562    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295565    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295569    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295571    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295574    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295577    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295579    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295583    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295585    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295588    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295590    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:09:56.301909 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295593    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295596    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295599    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295602    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295605    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295608    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295610    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295613    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295616    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295619    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295622    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295625    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295627    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295630    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295633    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295635    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295638    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295641    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295644    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295646    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:09:56.302383 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295649    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295651    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295654    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295657    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295660    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295662    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295665    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295667    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295670    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295673    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295675    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295678    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295681    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295684    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295687    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295689    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295692    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295695    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295698    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295700    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:09:56.303209 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295703    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295706    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295710    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295714    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295717    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295719    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295722    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295726    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295729    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295733    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295737    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295740    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295742    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295745    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295748    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295751    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295753    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295756    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:09:56.303801 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295758    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295761    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295763    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295766    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295768    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295771    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295773    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295776    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295779    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295781    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295784    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295787    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295790    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295792    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295795    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295797    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295800    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295803    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295806    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295808    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:09:56.304245 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295811    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295814    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295816    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295819    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295821    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295824    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295826    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295830    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295832    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.295855    2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295887    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295891    2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295894    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295897    2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295900    2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295903    2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:09:56.304922 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295905    2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295908    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295911    2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295913    2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295916    2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295918    2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295921    2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295924    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295927    2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295930    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295933    2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295936    2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295939    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295941    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295944    2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295946    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295949    2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295951    2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295954    2578 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295957    2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:09:56.305409 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295959    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295962    2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295965    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295967    2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295970    2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295973    2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295976    2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295978    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295981    2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295983    2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295986    2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295988    2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295991    2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295994    2578 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295996    2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.295999    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296002    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296005    2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296007    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296010    2578 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:09:56.306035 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296012    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296015    2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296018    2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296020    2578 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296023    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296025    2578 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296028    2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296030    2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296033    2578 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296035    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296038    2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296041    2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296043    2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296046    2578 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296048    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296051    2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296055    2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296058    2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296061    2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:09:56.306527 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296064    2578 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296066    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296070    2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296074    2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296077    2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296080    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296082    2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296084    2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296087    2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296089    2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296092    2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296095    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296097    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296100    2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296103    2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296106    2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296109    2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296111    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296114    2578 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:09:56.307012 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296116    2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296119    2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296122    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296124    2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296127    2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296129    2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296132    2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296135    2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296137    2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296140    2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296142    2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296145    2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296147    2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296150    2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296152    2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296155    2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296157    2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296160    2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296162    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:09:56.307457 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296166    2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:09:56.307948 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296168    2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:09:56.307948 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:56.296171    2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:09:56.307948 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.296222    2578 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 01:09:56.307948 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.298489    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 04 01:09:56.307948 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.299583    2578 server.go:1014] "Starting client certificate rotation"
Nov 04 01:09:56.307948 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.299687    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 01:09:56.307948 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.299742    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 01:09:56.307948 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.301772    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 01:09:56.307948 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.307636    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 01:09:56.318472 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.318457    2578 log.go:25] "Validated CRI v1 runtime API"
Nov 04 01:09:56.323629 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.323613    2578 log.go:25] "Validated CRI v1 image API"
Nov 04 01:09:56.324456 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.324434    2578 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 01:09:56.327994 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.327972    2578 fs.go:135] Filesystem UUIDs: map[6d99199f-72bf-4970-95cf-efcd7de33405:/dev/nvme0n1p3 70c35d1c-5a72-46f9-bf34-52cf8f3ed938:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Nov 04 01:09:56.328044 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.327994    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 04 01:09:56.333276 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.333168    2578 manager.go:217] Machine: {Timestamp:2026-11-04 01:09:56.331647977 +0000 UTC m=+0.364168379 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101571 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24c277e9e65a91b5b2a297746c9454 SystemUUID:ec24c277-e9e6-5a91-b5b2-a297746c9454 BootID:bdb09196-6800-42a7-9431-3d569a5e3460 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:dd:32:3e:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:dd:32:3e:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:62:44:57:c8:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 01:09:56.333276 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.333275    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 01:09:56.333383 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.333352    2578 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 01:09:56.337138 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.337117    2578 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 01:09:56.337271 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.337138    2578 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-142.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 01:09:56.338054 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.338044    2578 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 01:09:56.338088 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.338056    2578 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 01:09:56.338088 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.338066    2578 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 01:09:56.338088 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.338076    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 01:09:56.339069 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.339059    2578 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 01:09:56.343117 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.343104    2578 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 01:09:56.343233 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.343224    2578 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 01:09:56.344045 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.344035    2578 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 01:09:56.344093 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.344047    2578 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 01:09:56.344093 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.344059    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 01:09:56.344093 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.344068    2578 kubelet.go:405] "Adding apiserver pod source"
Nov 04 01:09:56.344093 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.344076    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 01:09:56.344422 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.344410    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 01:09:56.346887 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.346869    2578 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 01:09:56.353231 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.353215    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 01:09:56.354172 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.354154    2578 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 01:09:56.354230 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.354190    2578 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 01:09:56.354342 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.354332    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 01:09:56.354374 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.354348    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 01:09:56.354374 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.354354    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 01:09:56.354374 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.354360    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 01:09:56.354374 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.354366    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 01:09:56.354374 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.354373    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 01:09:56.355080 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.355070    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 01:09:56.355080 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.355080    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 01:09:56.355136 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.355088    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 01:09:56.355136 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.355094    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 01:09:56.355136 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.355109    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 01:09:56.355136 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.355118    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 01:09:56.356919 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.356909    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 01:09:56.356969 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.356919    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 01:09:56.360729 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.360716    2578 server.go:1263] "Started kubelet"
Nov 04 01:09:56.360820 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.360779    2578 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 01:09:56.360888 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.360843    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 01:09:56.361389 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.361367    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 01:09:56.361605 ip-10-0-128-142 systemd[1]: Started Kubernetes Kubelet.
Nov 04 01:09:56.362641 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.362620    2578 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 01:09:56.363287 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.363274    2578 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 01:09:56.366059 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:56.366038    2578 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 04 01:09:56.368765 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.368752    2578 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 01:09:56.368765 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.368758    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 01:09:56.368876 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:56.368833    2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-142.us-west-2.compute.internal\" not found"
Nov 04 01:09:56.371006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.370983    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 01:09:56.371006 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.371007    2578 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 01:09:56.371147 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.371018    2578 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 01:09:56.371210 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.371149    2578 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 01:09:56.371210 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.371157    2578 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 01:09:56.371776 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.371758    2578 factory.go:55] Registering systemd factory
Nov 04 01:09:56.371862 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.371808    2578 factory.go:223] Registration of the systemd container factory successfully
Nov 04 01:09:56.373091 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.372972    2578 factory.go:153] Registering CRI-O factory
Nov 04 01:09:56.373091 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.372991    2578 factory.go:223] Registration of the crio container factory successfully
Nov 04 01:09:56.373091 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.373053    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 01:09:56.373091 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.373075    2578 factory.go:103] Registering Raw factory
Nov 04 01:09:56.373091 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.373094    2578 manager.go:1199] Started watching for new ooms in manager
Nov 04 01:09:56.374510 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.374493    2578 manager.go:319] Starting recovery of all containers
Nov 04 01:09:56.384156 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.384136    2578 manager.go:324] Recovery completed
Nov 04 01:09:56.389003 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.388989    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:09:56.390522 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.390506    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:09:56.390607 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.390547    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:09:56.390607 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.390563    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:09:56.391122 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.391107    2578 cpu_manager.go:226] "Starting" policy="none"
Nov 04 01:09:56.391122 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.391120    2578 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 01:09:56.391242 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.391111    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:09:56.391242 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.391139    2578 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 01:09:56.391946 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.391928    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:09:56.392001 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.391963    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:09:56.392001 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.391977    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:09:56.393306 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.393291    2578 policy_none.go:50] "Start"
Nov 04 01:09:56.393353 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.393312    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 01:09:56.393353 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.393330    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 01:09:56.395276 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.395263    2578 policy_none.go:44] "Start"
Nov 04 01:09:56.441150 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.441118    2578 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 01:09:56.443567 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.443550    2578 manager.go:341] "Starting Device Plugin manager"
Nov 04 01:09:56.444190 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:56.444175    2578 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 01:09:56.444190 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.444191    2578 server.go:87] "Starting device plugin registration server"
Nov 04 01:09:56.444471 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.444458    2578 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 01:09:56.444561 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.444472    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 01:09:56.444883 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.444581    2578 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 01:09:56.444883 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.444667    2578 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 01:09:56.444883 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.444674    2578 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 01:09:56.445271 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:56.445239    2578 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 01:09:56.445374 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:56.445294    2578 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-142.us-west-2.compute.internal\" not found"
Nov 04 01:09:56.502498 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.502455    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 01:09:56.504475 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.503686    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 01:09:56.504475 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.503706    2578 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 01:09:56.504475 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.503725    2578 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 01:09:56.504475 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:56.503757    2578 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 04 01:09:56.513760 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.513734    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-142.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 04 01:09:56.514837 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:56.513735    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-142.us-west-2.compute.internal.18e4b24d3a4d99e7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-142.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-142.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 01:09:56.360690151 +0000 UTC m=+0.393210553,LastTimestamp:2026-11-04 01:09:56.360690151 +0000 UTC m=+0.393210553,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-142.us-west-2.compute.internal,}"
Nov 04 01:09:56.544738 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.544686    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:09:56.545717 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.545562    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:09:56.545825 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.545738    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:09:56.545825 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.545757    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:09:56.545825 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.545791    2578 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.564218 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:56.564185    2578 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-142.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 04 01:09:56.581147 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.581119    2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 01:09:56.581258 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.581171    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6dfnn"
Nov 04 01:09:56.604543 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.604493    2578 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"]
Nov 04 01:09:56.604624 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.604575    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:09:56.605497 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.605484    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:09:56.605572 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.605509    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:09:56.605572 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.605520    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:09:56.607649 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.607637    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:09:56.607806 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.607788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.607844 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.607817    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:09:56.608433 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.608412    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:09:56.608433 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.608418    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:09:56.608511 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.608442    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:09:56.608511 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.608454    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:09:56.608586 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.608444    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:09:56.608586 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.608567    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:09:56.610602 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.610590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.610654 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.610615    2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:09:56.611235 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.611219    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:09:56.611310 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.611263    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:09:56.611310 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.611278    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:09:56.627059 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:56.627033    2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-142.us-west-2.compute.internal\" not found" node="ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.632620 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:56.632604    2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-142.us-west-2.compute.internal\" not found" node="ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.665306 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.665279    2578 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:09:56.666810 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.666793    2578 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:09:56.672889 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.672871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2c9bab5e4ee3b4b58012399d0a10eff-config\") pod \"kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"a2c9bab5e4ee3b4b58012399d0a10eff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.672968 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.672900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.672968 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.672925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.760478 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.760456    2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:09:56.761121 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.761105    2578 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:09:56.762550 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.762522    2578 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.768926 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.768905    2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.773163 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.773148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2c9bab5e4ee3b4b58012399d0a10eff-config\") pod \"kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"a2c9bab5e4ee3b4b58012399d0a10eff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.773214 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.773173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.773214 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.773191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.773315 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.773254    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2c9bab5e4ee3b4b58012399d0a10eff-config\") pod \"kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"a2c9bab5e4ee3b4b58012399d0a10eff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.773315 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.773277    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.773315 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.773254    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.825625 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.825570    2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:09:56.826595 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.826582    2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.915154 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.915129    2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:09:56.931633 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.931609    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:56.937359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:56.937342    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:09:57.299892 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.299860    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 04 01:09:57.300503 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.300002    2578 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 01:09:57.300503 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.300088    2578 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 01:09:57.300503 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.300088    2578 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 01:09:57.300503 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.300070    2578 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a3e660436c5ac4b748d5d3f99dae8da8-e741eb2aa4dd6e95.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-128-142.us-west-2.compute.internal.18e4b24d3c1581ce\": read tcp 10.0.128.142:52452->3.147.153.216:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-128-142.us-west-2.compute.internal.18e4b24d3c1581ce  default   5215 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-142.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-142.us-west-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-142.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 01:09:56 +0000 UTC,LastTimestamp:2026-11-04 01:09:56.545762961 +0000 UTC m=+0.578283367,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-142.us-west-2.compute.internal,}"
Nov 04 01:09:57.344948 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.344921    2578 apiserver.go:52] "Watching apiserver"
Nov 04 01:09:57.370062 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.370037    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 04 01:09:57.586102 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.586003    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 01:04:56 +0000 UTC" deadline="2028-08-17 04:08:50.906444226 +0000 UTC"
Nov 04 01:09:57.586102 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.586043    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15650h58m53.320405859s"
Nov 04 01:09:57.662160 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.662128    2578 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 01:09:57.662478 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.662460    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-pn797","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm","openshift-multus/multus-pmzlg","kube-system/global-pull-secret-syncer-c5jls","kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal","openshift-dns/node-resolver-xdspt","openshift-network-diagnostics/network-check-target-l4plc","kube-system/konnectivity-agent-gpw4g","openshift-image-registry/node-ca-mgql9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal","openshift-multus/multus-additional-cni-plugins-hmcdr","openshift-ovn-kubernetes/ovnkube-node-q2lpn","openshift-cluster-node-tuning-operator/tuned-n9vdh","openshift-multus/network-metrics-daemon-plbjs"]
Nov 04 01:09:57.665107 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.665085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:09:57.665185 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.665166    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:09:57.667182 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.667165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.669378 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.669355    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.671628 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.671589    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:57.671729 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.671662    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:09:57.674458 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.674099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:09:57.676480 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk4q9\" (UniqueName: \"kubernetes.io/projected/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-kube-api-access-wk4q9\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.676480 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.676661 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-daemon-config\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.676661 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-etc-kubernetes\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.676661 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-kubernetes\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.676661 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-sys\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.676661 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cni-binary-copy\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.676661 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676645    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-kubelet\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.676962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fglqf\" (UniqueName: \"kubernetes.io/projected/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-kube-api-access-fglqf\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.676962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676693    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-dbus\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:57.676962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676726    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:09:57.676962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676749    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-modprobe-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.676962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-run\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.676962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-tmp\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.676962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-hostroot\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.676962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-multus-certs\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.676962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:09:57.676962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-lib-modules\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.676962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.676992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-netns\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-bin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-kubelet-config\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-multus\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-conf-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-systemd\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-host\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677181    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-system-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cnibin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-socket-dir-parent\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-k8s-cni-cncf-io\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysconfig\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-conf\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-var-lib-kubelet\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.677320 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.677323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-tuned\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.679050 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.679032    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:09:57.681365 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.681348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.683630 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.683593    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:09:57.683777 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.683673    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:09:57.685912 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.685893    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.688279 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.688262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.690599 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.690578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:09:57.727181 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.727162    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 01:09:57.727287 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.727199    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q5jlj\""
Nov 04 01:09:57.727287 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.727236    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 01:09:57.728828 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.728806    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 01:09:57.728960 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.728945    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 01:09:57.728960 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.728955    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 01:09:57.729067 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.729057    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 01:09:57.729111 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.729062    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rjcnb\""
Nov 04 01:09:57.733700 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.733672    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 01:09:57.733700 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.733680    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 01:09:57.733889 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.733875    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hz84q\""
Nov 04 01:09:57.736005 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.735987    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 01:09:57.736156 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.736141    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 01:09:57.736220 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.736202    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 01:09:57.736256 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.736234    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j9t67\""
Nov 04 01:09:57.738206 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.738182    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 01:09:57.738371 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.738354    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 01:09:57.738435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.738355    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d8jdw\""
Nov 04 01:09:57.748757 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.748722    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 01:09:57.748926 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.748911    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 01:09:57.748994 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.748953    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-prqm6\""
Nov 04 01:09:57.749337 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.749320    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4z2qg\""
Nov 04 01:09:57.771573 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.771558    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 01:09:57.777816 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.777793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-kubernetes\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.777923 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.777820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cni-binary-copy\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.777923 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.777840    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-kubelet\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.777923 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.777856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-bin\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.777923 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.777876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-tmp-dir\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:09:57.777923 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.777901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-cnibin\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.778140 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.777922    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-kubernetes\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.778140 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.777956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.778140 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.778504 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-tmp\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.778595 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-multus-certs\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.778595 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778567    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-multus-certs\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.778718 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-node-log\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.778718 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.778718 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d8801a3-3cc4-4311-9876-152f71cc5687-ovn-node-metrics-cert\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.778871 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:09:57.778871 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778763    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-lib-modules\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.778871 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778783    2578 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 01:09:57.778871 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghdgw\" (UniqueName: \"kubernetes.io/projected/d1a3f906-3026-4220-af30-3a682acafbbb-kube-api-access-ghdgw\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:09:57.779067 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktr2t\" (UniqueName: \"kubernetes.io/projected/36657689-6fdf-4f18-b466-52ab25506722-kube-api-access-ktr2t\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:09:57.779067 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-netns\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.779067 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778906    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-lib-modules\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.779067 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.779067 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-sys-fs\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.779067 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.778978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jp9j\" (UniqueName: \"kubernetes.io/projected/aea8797d-c027-4b30-8e75-e65ed05158af-kube-api-access-9jp9j\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.779067 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-netns\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779074    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-netns\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779091    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-bin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-kubelet-config\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779147    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cni-binary-copy\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779189    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-bin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779202    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779205    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36657689-6fdf-4f18-b466-52ab25506722-iptables-alerter-script\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779235    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779241    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779243    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36657689-6fdf-4f18-b466-52ab25506722-host-slash\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779279    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779289    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779302    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779300    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-kubelet-config\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779316    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779307    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779359    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-socket-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vds7d\" (UniqueName: \"kubernetes.io/projected/3d8801a3-3cc4-4311-9876-152f71cc5687-kube-api-access-vds7d\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779381    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 01:09:57.779391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-hosts-file\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-multus\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779437    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g9sbp\""
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1a3f906-3026-4220-af30-3a682acafbbb-serviceca\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779505    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-multus\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-systemd\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779718    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-systemd\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cnibin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-socket-dir-parent\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-k8s-cni-cncf-io\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779780    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cnibin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779835    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-k8s-cni-cncf-io\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-var-lib-kubelet\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779856    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-socket-dir-parent\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk4q9\" (UniqueName: \"kubernetes.io/projected/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-kube-api-access-wk4q9\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779893    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-var-lib-kubelet\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.780359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-daemon-config\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-dbus\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-systemd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxwfl\" (UniqueName: \"kubernetes.io/projected/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kube-api-access-xxwfl\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.779991    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-dbus\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-sys\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-kubelet\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fglqf\" (UniqueName: \"kubernetes.io/projected/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-kube-api-access-fglqf\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780126    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-sys\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-modprobe-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-run\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780170    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-kubelet\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-hostroot\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780242    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-modprobe-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-config\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780265    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-run\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780289    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-hostroot\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.781040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmjz\" (UniqueName: \"kubernetes.io/projected/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-kube-api-access-hsmjz\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-registration-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780358    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-daemon-config\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a3f906-3026-4220-af30-3a682acafbbb-host\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-device-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.780436    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-var-lib-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780468    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-env-overrides\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-system-cni-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.780505    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret podName:41d83d70-c53d-4e05-9ef0-54918d176ee0 nodeName:}" failed. No retries permitted until 2026-11-04 01:09:58.280482993 +0000 UTC m=+2.313003409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret") pod "global-pull-secret-syncer-c5jls" (UID: "41d83d70-c53d-4e05-9ef0-54918d176ee0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-slash\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1b6756a-77d7-4a73-9900-9a739b6c3a21-konnectivity-ca\") pod \"konnectivity-agent-gpw4g\" (UID: \"a1b6756a-77d7-4a73-9900-9a739b6c3a21\") " pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780644    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.781686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-conf-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780701    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-conf-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-log-socket\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-host\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780756    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-system-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-systemd-units\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-ovn\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780798    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-host\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780813    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-system-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-script-lib\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1b6756a-77d7-4a73-9900-9a739b6c3a21-agent-certs\") pod \"konnectivity-agent-gpw4g\" (UID: \"a1b6756a-77d7-4a73-9900-9a739b6c3a21\") " pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-etc-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysconfig\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.780980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-conf\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.781005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-tuned\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.781013    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysconfig\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.782157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.781031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.782668 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.781057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-etc-kubernetes\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.782668 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.781087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqz8n\" (UniqueName: \"kubernetes.io/projected/54daba34-bdc5-4e9a-8fc2-124c44311571-kube-api-access-zqz8n\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:09:57.782668 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.781108    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-conf\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.782668 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.781114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-netd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.782668 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.781160    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.782668 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.781230    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-etc-kubernetes\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.782909 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.782881    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-tmp\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.782970 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.782956    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 01:09:57.783153 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.783134    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-tuned\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.784425 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.784405    2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 01:09:57.784484 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.784453    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lxbzg"
Nov 04 01:09:57.835633 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.835601    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-7mrtt\""
Nov 04 01:09:57.835633 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.835612    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 01:09:57.845275 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.845226    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:09:57.845275 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.845246    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:09:57.845275 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.845256    2578 projected.go:196] Error preparing data for projected volume kube-api-access-h6j5x for pod openshift-network-diagnostics/network-check-target-l4plc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:09:57.845425 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.845312    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x podName:af124602-383f-4c7a-8325-6cbaf0d80d1e nodeName:}" failed. No retries permitted until 2026-11-04 01:09:58.345297484 +0000 UTC m=+2.377817875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h6j5x" (UniqueName: "kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x") pod "network-check-target-l4plc" (UID: "af124602-383f-4c7a-8325-6cbaf0d80d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:09:57.848242 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.848218    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fglqf\" (UniqueName: \"kubernetes.io/projected/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-kube-api-access-fglqf\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:57.848436 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.848411    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk4q9\" (UniqueName: \"kubernetes.io/projected/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-kube-api-access-wk4q9\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:57.881934 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.881903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-kubelet\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882035 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.881937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-bin\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882035 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.881954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-tmp-dir\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:09:57.882035 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.881972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-cnibin\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.882035 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.881991    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.882035 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882009    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-kubelet\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882035 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882019    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-bin\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-node-log\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882092    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-cnibin\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d8801a3-3cc4-4311-9876-152f71cc5687-ovn-node-metrics-cert\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghdgw\" (UniqueName: \"kubernetes.io/projected/d1a3f906-3026-4220-af30-3a682acafbbb-kube-api-access-ghdgw\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882156    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-node-log\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882163    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktr2t\" (UniqueName: \"kubernetes.io/projected/36657689-6fdf-4f18-b466-52ab25506722-kube-api-access-ktr2t\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-netns\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-sys-fs\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882332    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-sys-fs\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882332    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-netns\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.882351 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882340    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-tmp-dir\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jp9j\" (UniqueName: \"kubernetes.io/projected/aea8797d-c027-4b30-8e75-e65ed05158af-kube-api-access-9jp9j\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36657689-6fdf-4f18-b466-52ab25506722-iptables-alerter-script\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882373    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36657689-6fdf-4f18-b466-52ab25506722-host-slash\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882503    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36657689-6fdf-4f18-b466-52ab25506722-host-slash\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.882539    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-socket-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds7d\" (UniqueName: \"kubernetes.io/projected/3d8801a3-3cc4-4311-9876-152f71cc5687-kube-api-access-vds7d\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:57.882613    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs podName:54daba34-bdc5-4e9a-8fc2-124c44311571 nodeName:}" failed. No retries permitted until 2026-11-04 01:09:58.382593778 +0000 UTC m=+2.415114187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs") pod "network-metrics-daemon-plbjs" (UID: "54daba34-bdc5-4e9a-8fc2-124c44311571") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-hosts-file\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1a3f906-3026-4220-af30-3a682acafbbb-serviceca\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882672    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882728    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-socket-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.883152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882743    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-hosts-file\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-systemd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxwfl\" (UniqueName: \"kubernetes.io/projected/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kube-api-access-xxwfl\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882796    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882800    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-config\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882844    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-systemd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmjz\" (UniqueName: \"kubernetes.io/projected/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-kube-api-access-hsmjz\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-registration-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a3f906-3026-4220-af30-3a682acafbbb-host\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-device-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.882999    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-var-lib-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-env-overrides\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883036    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36657689-6fdf-4f18-b466-52ab25506722-iptables-alerter-script\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:09:57.883836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-system-cni-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-slash\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883104    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a3f906-3026-4220-af30-3a682acafbbb-host\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1b6756a-77d7-4a73-9900-9a739b6c3a21-konnectivity-ca\") pod \"konnectivity-agent-gpw4g\" (UID: \"a1b6756a-77d7-4a73-9900-9a739b6c3a21\") " pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883154    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-device-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883158    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-system-cni-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883163    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1a3f906-3026-4220-af30-3a682acafbbb-serviceca\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-log-socket\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883113    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-var-lib-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883061    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-registration-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883197    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-slash\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883216    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-log-socket\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-systemd-units\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883319    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-ovn\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883388    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-systemd-units\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884331 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-script-lib\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884926 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1b6756a-77d7-4a73-9900-9a739b6c3a21-agent-certs\") pod \"konnectivity-agent-gpw4g\" (UID: \"a1b6756a-77d7-4a73-9900-9a739b6c3a21\") " pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:09:57.884926 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883567    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-ovn\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884926 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-etc-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884926 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqz8n\" (UniqueName: \"kubernetes.io/projected/54daba34-bdc5-4e9a-8fc2-124c44311571-kube-api-access-zqz8n\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:09:57.884926 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-netd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884926 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883706    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-netd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.884926 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.883732    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-etc-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.885576 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.885549    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-config\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.885679 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.885649    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.885735 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.885672    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d8801a3-3cc4-4311-9876-152f71cc5687-ovn-node-metrics-cert\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.885735 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.885699    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:57.885840 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.885708    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1b6756a-77d7-4a73-9900-9a739b6c3a21-konnectivity-ca\") pod \"konnectivity-agent-gpw4g\" (UID: \"a1b6756a-77d7-4a73-9900-9a739b6c3a21\") " pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:09:57.885840 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.885757    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-env-overrides\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.886095 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.886075    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-script-lib\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.887338 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.887321    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1b6756a-77d7-4a73-9900-9a739b6c3a21-agent-certs\") pod \"konnectivity-agent-gpw4g\" (UID: \"a1b6756a-77d7-4a73-9900-9a739b6c3a21\") " pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:09:57.951654 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.951628    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmjz\" (UniqueName: \"kubernetes.io/projected/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-kube-api-access-hsmjz\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:09:57.951654 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.951652    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxwfl\" (UniqueName: \"kubernetes.io/projected/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kube-api-access-xxwfl\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:57.951831 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.951683    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghdgw\" (UniqueName: \"kubernetes.io/projected/d1a3f906-3026-4220-af30-3a682acafbbb-kube-api-access-ghdgw\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:09:57.954455 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.954424    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktr2t\" (UniqueName: \"kubernetes.io/projected/36657689-6fdf-4f18-b466-52ab25506722-kube-api-access-ktr2t\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:09:57.955031 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.955006    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vds7d\" (UniqueName: \"kubernetes.io/projected/3d8801a3-3cc4-4311-9876-152f71cc5687-kube-api-access-vds7d\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:57.955132 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.955034    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqz8n\" (UniqueName: \"kubernetes.io/projected/54daba34-bdc5-4e9a-8fc2-124c44311571-kube-api-access-zqz8n\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:09:57.955132 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:57.955087    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jp9j\" (UniqueName: \"kubernetes.io/projected/aea8797d-c027-4b30-8e75-e65ed05158af-kube-api-access-9jp9j\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:58.001482 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.001449    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:09:58.008403 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.008383    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pmzlg"
Nov 04 01:09:58.022637 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.022607    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:09:58.038317 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.038294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:09:58.040667 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.040649    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:09:58.074292 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.074264    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:09:58.102031 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.101970    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:09:58.108809 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.108791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:09:58.121340 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.121317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:09:58.142820 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:58.142780    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b6756a_77d7_4a73_9900_9a739b6c3a21.slice/crio-7941b992c631e2fab8f0f106013c6bb2ba197fd7146dd51d38e631ba0de992b8 WatchSource:0}: Error finding container 7941b992c631e2fab8f0f106013c6bb2ba197fd7146dd51d38e631ba0de992b8: Status 404 returned error can't find the container with id 7941b992c631e2fab8f0f106013c6bb2ba197fd7146dd51d38e631ba0de992b8
Nov 04 01:09:58.144178 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:58.144147    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8801a3_3cc4_4311_9876_152f71cc5687.slice/crio-c49fd70540af06678e24ff1496e4425dbf1eab4c451ece2944386396db8eea77 WatchSource:0}: Error finding container c49fd70540af06678e24ff1496e4425dbf1eab4c451ece2944386396db8eea77: Status 404 returned error can't find the container with id c49fd70540af06678e24ff1496e4425dbf1eab4c451ece2944386396db8eea77
Nov 04 01:09:58.147696 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:58.146028    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec177e465a97bf965e66ed6a00cb6b1c.slice/crio-44029ff2416ffa01b9059a6d1e06d099880ae16d7c95ede95c922fdf85cf6a73 WatchSource:0}: Error finding container 44029ff2416ffa01b9059a6d1e06d099880ae16d7c95ede95c922fdf85cf6a73: Status 404 returned error can't find the container with id 44029ff2416ffa01b9059a6d1e06d099880ae16d7c95ede95c922fdf85cf6a73
Nov 04 01:09:58.150562 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.150544    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 01:09:58.183333 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:58.183301    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c9bab5e4ee3b4b58012399d0a10eff.slice/crio-70aef28f3b64ab1915a533c794a25b6208da186648d540f57aeecc8ddd722221 WatchSource:0}: Error finding container 70aef28f3b64ab1915a533c794a25b6208da186648d540f57aeecc8ddd722221: Status 404 returned error can't find the container with id 70aef28f3b64ab1915a533c794a25b6208da186648d540f57aeecc8ddd722221
Nov 04 01:09:58.286685 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.286639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:58.286809 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:58.286785    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:09:58.286867 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:58.286844    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret podName:41d83d70-c53d-4e05-9ef0-54918d176ee0 nodeName:}" failed. No retries permitted until 2026-11-04 01:09:59.286829952 +0000 UTC m=+3.319350358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret") pod "global-pull-secret-syncer-c5jls" (UID: "41d83d70-c53d-4e05-9ef0-54918d176ee0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:09:58.387168 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.387079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:09:58.387168 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.387129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:09:58.387879 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:58.387247    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:09:58.387879 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:58.387273    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:09:58.387879 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:58.387252    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:09:58.387879 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:58.387328    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs podName:54daba34-bdc5-4e9a-8fc2-124c44311571 nodeName:}" failed. No retries permitted until 2026-11-04 01:09:59.387314377 +0000 UTC m=+3.419834782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs") pod "network-metrics-daemon-plbjs" (UID: "54daba34-bdc5-4e9a-8fc2-124c44311571") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:09:58.387879 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:58.387283    2578 projected.go:196] Error preparing data for projected volume kube-api-access-h6j5x for pod openshift-network-diagnostics/network-check-target-l4plc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:09:58.387879 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:58.387374    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x podName:af124602-383f-4c7a-8325-6cbaf0d80d1e nodeName:}" failed. No retries permitted until 2026-11-04 01:09:59.387366944 +0000 UTC m=+3.419887335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6j5x" (UniqueName: "kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x") pod "network-check-target-l4plc" (UID: "af124602-383f-4c7a-8325-6cbaf0d80d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:09:58.394217 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.394200    2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:09:58.508650 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.508593    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal" event={"ID":"ec177e465a97bf965e66ed6a00cb6b1c","Type":"ContainerStarted","Data":"44029ff2416ffa01b9059a6d1e06d099880ae16d7c95ede95c922fdf85cf6a73"}
Nov 04 01:09:58.509703 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.509658    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gpw4g" event={"ID":"a1b6756a-77d7-4a73-9900-9a739b6c3a21","Type":"ContainerStarted","Data":"7941b992c631e2fab8f0f106013c6bb2ba197fd7146dd51d38e631ba0de992b8"}
Nov 04 01:09:58.510727 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.510706    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal" event={"ID":"a2c9bab5e4ee3b4b58012399d0a10eff","Type":"ContainerStarted","Data":"70aef28f3b64ab1915a533c794a25b6208da186648d540f57aeecc8ddd722221"}
Nov 04 01:09:58.511836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.511816    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn" event={"ID":"3d8801a3-3cc4-4311-9876-152f71cc5687","Type":"ContainerStarted","Data":"c49fd70540af06678e24ff1496e4425dbf1eab4c451ece2944386396db8eea77"}
Nov 04 01:09:58.774266 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.774236    2578 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:09:58.787364 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.787310    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 01:04:57 +0000 UTC" deadline="2028-06-05 21:19:30.633039163 +0000 UTC"
Nov 04 01:09:58.787364 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.787347    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13916h9m31.845693912s"
Nov 04 01:09:58.813687 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:58.813655    2578 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:09:58.971495 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:58.971461    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a3f906_3026_4220_af30_3a682acafbbb.slice/crio-744928099cc137c52314c67fe79047467f07f9aa8511de031b501507def58f3a WatchSource:0}: Error finding container 744928099cc137c52314c67fe79047467f07f9aa8511de031b501507def58f3a: Status 404 returned error can't find the container with id 744928099cc137c52314c67fe79047467f07f9aa8511de031b501507def58f3a
Nov 04 01:09:58.997548 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:58.997498    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335e91c5_3f5e_49e7_ab4c_67ffb1e5d694.slice/crio-ac461c8ef39aef232c8d2a4f40ec47c4387371227940ae1af1fe1958e6b2c68c WatchSource:0}: Error finding container ac461c8ef39aef232c8d2a4f40ec47c4387371227940ae1af1fe1958e6b2c68c: Status 404 returned error can't find the container with id ac461c8ef39aef232c8d2a4f40ec47c4387371227940ae1af1fe1958e6b2c68c
Nov 04 01:09:59.048104 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:59.048072    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a7a8be_5a1a_4d39_9988_8163e34d69e5.slice/crio-0bdc4f355aa5fcbd369073261e0da56da559ea2bbd1c5ff337d26575f3ff2cf3 WatchSource:0}: Error finding container 0bdc4f355aa5fcbd369073261e0da56da559ea2bbd1c5ff337d26575f3ff2cf3: Status 404 returned error can't find the container with id 0bdc4f355aa5fcbd369073261e0da56da559ea2bbd1c5ff337d26575f3ff2cf3
Nov 04 01:09:59.056937 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:59.056915    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25fa3dbe_9f99_4c9a_bb48_afe5dac916ac.slice/crio-dbd480fa2378df615a4aff83bba81c1390688ee717563608cf094960050b6ed6 WatchSource:0}: Error finding container dbd480fa2378df615a4aff83bba81c1390688ee717563608cf094960050b6ed6: Status 404 returned error can't find the container with id dbd480fa2378df615a4aff83bba81c1390688ee717563608cf094960050b6ed6
Nov 04 01:09:59.073606 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:59.073584    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631c65a6_6bc5_4d54_8e52_ac6cc89bfad1.slice/crio-4d06af4651ea5b1352ac0b731357a379d657ebbf04b08a8b71f013a4b794047f WatchSource:0}: Error finding container 4d06af4651ea5b1352ac0b731357a379d657ebbf04b08a8b71f013a4b794047f: Status 404 returned error can't find the container with id 4d06af4651ea5b1352ac0b731357a379d657ebbf04b08a8b71f013a4b794047f
Nov 04 01:09:59.119250 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:59.119225    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36657689_6fdf_4f18_b466_52ab25506722.slice/crio-74587aef909146b9b97b84698c14558c5fc9cff5660691c7890d9cfbf53ba851 WatchSource:0}: Error finding container 74587aef909146b9b97b84698c14558c5fc9cff5660691c7890d9cfbf53ba851: Status 404 returned error can't find the container with id 74587aef909146b9b97b84698c14558c5fc9cff5660691c7890d9cfbf53ba851
Nov 04 01:09:59.152322 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:09:59.152290    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea8797d_c027_4b30_8e75_e65ed05158af.slice/crio-7e5a5b6a7dc21ee11cb6f014bcdff00576cb2801dfafaba2a1cf4993b47cf0ba WatchSource:0}: Error finding container 7e5a5b6a7dc21ee11cb6f014bcdff00576cb2801dfafaba2a1cf4993b47cf0ba: Status 404 returned error can't find the container with id 7e5a5b6a7dc21ee11cb6f014bcdff00576cb2801dfafaba2a1cf4993b47cf0ba
Nov 04 01:09:59.293466 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.293432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:59.293643 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:59.293587    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:09:59.293712 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:59.293662    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret podName:41d83d70-c53d-4e05-9ef0-54918d176ee0 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:01.293642745 +0000 UTC m=+5.326163136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret") pod "global-pull-secret-syncer-c5jls" (UID: "41d83d70-c53d-4e05-9ef0-54918d176ee0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:09:59.394166 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.394083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:09:59.394166 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.394130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:09:59.394704 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:59.394261    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:09:59.394704 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:59.394328    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs podName:54daba34-bdc5-4e9a-8fc2-124c44311571 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:01.394307305 +0000 UTC m=+5.426827698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs") pod "network-metrics-daemon-plbjs" (UID: "54daba34-bdc5-4e9a-8fc2-124c44311571") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:09:59.394704 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:59.394414    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:09:59.394704 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:59.394432    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:09:59.394704 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:59.394444    2578 projected.go:196] Error preparing data for projected volume kube-api-access-h6j5x for pod openshift-network-diagnostics/network-check-target-l4plc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:09:59.394704 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:59.394482    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x podName:af124602-383f-4c7a-8325-6cbaf0d80d1e nodeName:}" failed. No retries permitted until 2026-11-04 01:10:01.394470099 +0000 UTC m=+5.426990489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6j5x" (UniqueName: "kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x") pod "network-check-target-l4plc" (UID: "af124602-383f-4c7a-8325-6cbaf0d80d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:09:59.504627 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.504594    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:09:59.504812 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:59.504729    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:09:59.504885 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.504820    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:09:59.504933 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:59.504889    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:09:59.504987 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.504948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:09:59.505038 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:09:59.504999    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:09:59.515739 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.515697    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n9vdh" event={"ID":"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac","Type":"ContainerStarted","Data":"dbd480fa2378df615a4aff83bba81c1390688ee717563608cf094960050b6ed6"}
Nov 04 01:09:59.518466 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.518397    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xdspt" event={"ID":"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694","Type":"ContainerStarted","Data":"ac461c8ef39aef232c8d2a4f40ec47c4387371227940ae1af1fe1958e6b2c68c"}
Nov 04 01:09:59.520448 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.520424    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmcdr" event={"ID":"aea8797d-c027-4b30-8e75-e65ed05158af","Type":"ContainerStarted","Data":"7e5a5b6a7dc21ee11cb6f014bcdff00576cb2801dfafaba2a1cf4993b47cf0ba"}
Nov 04 01:09:59.522687 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.522665    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm" event={"ID":"01a7a8be-5a1a-4d39-9988-8163e34d69e5","Type":"ContainerStarted","Data":"0bdc4f355aa5fcbd369073261e0da56da559ea2bbd1c5ff337d26575f3ff2cf3"}
Nov 04 01:09:59.525918 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.525892    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mgql9" event={"ID":"d1a3f906-3026-4220-af30-3a682acafbbb","Type":"ContainerStarted","Data":"744928099cc137c52314c67fe79047467f07f9aa8511de031b501507def58f3a"}
Nov 04 01:09:59.527409 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.527385    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pn797" event={"ID":"36657689-6fdf-4f18-b466-52ab25506722","Type":"ContainerStarted","Data":"74587aef909146b9b97b84698c14558c5fc9cff5660691c7890d9cfbf53ba851"}
Nov 04 01:09:59.529774 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.529749    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pmzlg" event={"ID":"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1","Type":"ContainerStarted","Data":"4d06af4651ea5b1352ac0b731357a379d657ebbf04b08a8b71f013a4b794047f"}
Nov 04 01:09:59.787683 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.787639    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 01:04:57 +0000 UTC" deadline="2028-03-31 07:48:36.884980958 +0000 UTC"
Nov 04 01:09:59.787683 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:09:59.787681    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12318h38m37.097304035s"
Nov 04 01:10:01.312394 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:01.312075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:01.312394 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:01.312278    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:01.312394 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:01.312345    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret podName:41d83d70-c53d-4e05-9ef0-54918d176ee0 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:05.312325163 +0000 UTC m=+9.344845553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret") pod "global-pull-secret-syncer-c5jls" (UID: "41d83d70-c53d-4e05-9ef0-54918d176ee0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:01.413414 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:01.413333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:01.413414 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:01.413386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:01.413659 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:01.413518    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:01.413659 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:01.413603    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs podName:54daba34-bdc5-4e9a-8fc2-124c44311571 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:05.413575412 +0000 UTC m=+9.446095816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs") pod "network-metrics-daemon-plbjs" (UID: "54daba34-bdc5-4e9a-8fc2-124c44311571") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:01.413774 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:01.413698    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:10:01.413774 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:01.413716    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:10:01.413774 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:01.413729    2578 projected.go:196] Error preparing data for projected volume kube-api-access-h6j5x for pod openshift-network-diagnostics/network-check-target-l4plc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:01.413774 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:01.413768    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x podName:af124602-383f-4c7a-8325-6cbaf0d80d1e nodeName:}" failed. No retries permitted until 2026-11-04 01:10:05.413754495 +0000 UTC m=+9.446274898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6j5x" (UniqueName: "kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x") pod "network-check-target-l4plc" (UID: "af124602-383f-4c7a-8325-6cbaf0d80d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:01.504882 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:01.504851    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:01.505079 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:01.504983    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:01.505079 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:01.505050    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:01.505198 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:01.505126    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:01.505198 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:01.505174    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:01.505408 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:01.505250    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:03.504633 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:03.504026    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:03.504633 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:03.504314    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:03.504633 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:03.504376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:03.504633 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:03.504443    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:03.504633 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:03.504495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:03.504633 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:03.504560    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:03.553329 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:03.553271    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gpw4g" event={"ID":"a1b6756a-77d7-4a73-9900-9a739b6c3a21","Type":"ContainerStarted","Data":"5800c2ad813502b3b9350f0d7e039598293168f09e7c9adbd3e919324c191d51"}
Nov 04 01:10:03.556258 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:03.556226    2578 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="4a63b157ae2e21a81cb3fa2508caee4ac9c5041bd4588d5768a7971c8db32ec1" exitCode=0
Nov 04 01:10:03.556405 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:03.556315    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmcdr" event={"ID":"aea8797d-c027-4b30-8e75-e65ed05158af","Type":"ContainerDied","Data":"4a63b157ae2e21a81cb3fa2508caee4ac9c5041bd4588d5768a7971c8db32ec1"}
Nov 04 01:10:03.562235 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:03.562203    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal" event={"ID":"a2c9bab5e4ee3b4b58012399d0a10eff","Type":"ContainerStarted","Data":"eb342467819b6f0a501f57c74fc3b6ad6d7e239e26be2f611a1be38b3976f43c"}
Nov 04 01:10:03.567300 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:03.567270    2578 generic.go:356] "Generic (PLEG): container finished" podID="ec177e465a97bf965e66ed6a00cb6b1c" containerID="e09eb9b4acd0393a8e172b4a0fa2da5f81604d3365eb141280713ce62f61d1e6" exitCode=0
Nov 04 01:10:03.567396 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:03.567309    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal" event={"ID":"ec177e465a97bf965e66ed6a00cb6b1c","Type":"ContainerDied","Data":"e09eb9b4acd0393a8e172b4a0fa2da5f81604d3365eb141280713ce62f61d1e6"}
Nov 04 01:10:03.795757 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:03.795707    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gpw4g" podStartSLOduration=3.981453565 podStartE2EDuration="7.79569381s" totalImagesPullingTime="3.814240245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:03.674804598 +0000 UTC m=+7.707325012" watchObservedRunningTime="2026-11-04 01:10:03.79569381 +0000 UTC m=+7.828214220"
Nov 04 01:10:04.574650 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:04.574613    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal" event={"ID":"ec177e465a97bf965e66ed6a00cb6b1c","Type":"ContainerStarted","Data":"0e751dc5ffa44de699c01b79bb9ebfb0950851d6db5e1366b60d833e880e47bc"}
Nov 04 01:10:04.695989 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:04.695902    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal" podStartSLOduration=8.69588793 podStartE2EDuration="8.69588793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:04.043337786 +0000 UTC m=+8.075858196" watchObservedRunningTime="2026-11-04 01:10:04.69588793 +0000 UTC m=+8.728408341"
Nov 04 01:10:05.348477 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.348443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:05.348664 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:05.348596    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:05.348664 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:05.348658    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret podName:41d83d70-c53d-4e05-9ef0-54918d176ee0 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:13.348641388 +0000 UTC m=+17.381161792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret") pod "global-pull-secret-syncer-c5jls" (UID: "41d83d70-c53d-4e05-9ef0-54918d176ee0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:05.449110 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.449072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:05.449224 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.449128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:05.449274 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:05.449259    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:05.449339 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:05.449309    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs podName:54daba34-bdc5-4e9a-8fc2-124c44311571 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:13.449297532 +0000 UTC m=+17.481817934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs") pod "network-metrics-daemon-plbjs" (UID: "54daba34-bdc5-4e9a-8fc2-124c44311571") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:05.449692 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:05.449568    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:10:05.449692 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:05.449597    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:10:05.449692 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:05.449610    2578 projected.go:196] Error preparing data for projected volume kube-api-access-h6j5x for pod openshift-network-diagnostics/network-check-target-l4plc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:05.449692 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:05.449668    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x podName:af124602-383f-4c7a-8325-6cbaf0d80d1e nodeName:}" failed. No retries permitted until 2026-11-04 01:10:13.449647955 +0000 UTC m=+17.482168359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6j5x" (UniqueName: "kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x") pod "network-check-target-l4plc" (UID: "af124602-383f-4c7a-8325-6cbaf0d80d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:05.504565 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.504477    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:05.504565 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.504491    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:05.504778 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:05.504677    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:05.504778 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.504721    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:05.504875 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:05.504801    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:05.504931 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:05.504885    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:05.551336 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.551305    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:10:05.552122 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.552103    2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:10:05.580104 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.580047    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm" event={"ID":"01a7a8be-5a1a-4d39-9988-8163e34d69e5","Type":"ContainerStarted","Data":"b3d0f8e33245485785c7ec357f637283c1a52ef1cba225fbf0d8f555490d25b0"}
Nov 04 01:10:05.583725 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.583698    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mgql9" event={"ID":"d1a3f906-3026-4220-af30-3a682acafbbb","Type":"ContainerStarted","Data":"70ef89e7593cb170f62b1c9c32660cf306f4585e45091a0e62b728b90bfd5c86"}
Nov 04 01:10:05.677778 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.676969    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal" podStartSLOduration=8.67694811 podStartE2EDuration="8.67694811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:09:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:04.696216749 +0000 UTC m=+8.728737161" watchObservedRunningTime="2026-11-04 01:10:05.67694811 +0000 UTC m=+9.709468522"
Nov 04 01:10:05.798490 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:05.798386    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mgql9" podStartSLOduration=4.327783078 podStartE2EDuration="9.798365304s" totalImagesPullingTime="5.470582226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:05.798121363 +0000 UTC m=+9.830641775" watchObservedRunningTime="2026-11-04 01:10:05.798365304 +0000 UTC m=+9.830885716"
Nov 04 01:10:06.588577 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:06.588551    2578 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 01:10:07.504914 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:07.504618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:07.504914 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:07.504758    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:07.504914 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:07.504796    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:07.504914 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:07.504876    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:07.505417 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:07.505255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:07.505417 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:07.505372    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:07.594253 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:07.593489    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pmzlg" event={"ID":"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1","Type":"ContainerStarted","Data":"cd6eee92cff64c4b016d54f97159340dbff091b50a2492637ff961ac1b089b52"}
Nov 04 01:10:07.599108 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:07.599043    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xdspt" event={"ID":"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694","Type":"ContainerStarted","Data":"a3f2ee5ce714da10bf8bfc0c79388971f9ae4512e716721ec2513b2a2617d233"}
Nov 04 01:10:07.721249 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:07.721029    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-pmzlg" podStartSLOduration=3.4518330329999998 podStartE2EDuration="11.721013697s" totalImagesPullingTime="8.269180664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:07.720343582 +0000 UTC m=+11.752863996" watchObservedRunningTime="2026-11-04 01:10:07.721013697 +0000 UTC m=+11.753534107"
Nov 04 01:10:07.765185 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:07.765160    2578 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 01:10:07.841056 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:07.840995    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-xdspt" podStartSLOduration=3.483006314 podStartE2EDuration="11.840972545s" totalImagesPullingTime="8.357966231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:07.840263038 +0000 UTC m=+11.872783452" watchObservedRunningTime="2026-11-04 01:10:07.840972545 +0000 UTC m=+11.873492958"
Nov 04 01:10:08.458007 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:08.457897    2578 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T01:10:07.76517901Z","UUID":"2e8ccab9-0ac4-48eb-8f81-9b67ee590b2b","Handler":null,"Name":"","Endpoint":""}
Nov 04 01:10:08.459527 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:08.459502    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 01:10:08.459527 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:08.459549    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 01:10:08.603391 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:08.603356    2578 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="972ef04c5ffa427bd53e047003ef9a95a4862da24f28e31f0b5a514a62be158f" exitCode=0
Nov 04 01:10:08.603867 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:08.603441    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmcdr" event={"ID":"aea8797d-c027-4b30-8e75-e65ed05158af","Type":"ContainerDied","Data":"972ef04c5ffa427bd53e047003ef9a95a4862da24f28e31f0b5a514a62be158f"}
Nov 04 01:10:08.606505 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:08.606478    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm" event={"ID":"01a7a8be-5a1a-4d39-9988-8163e34d69e5","Type":"ContainerStarted","Data":"41734e8f7a7704555e4cdaf5224d02bc6012fb867a421c2ec58b1a146210bea1"}
Nov 04 01:10:09.504275 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:09.504189    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:09.504275 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:09.504189    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:09.504469 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:09.504413    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:09.504510 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:09.504482    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:09.504596 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:09.504575    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:09.504694 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:09.504668    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:09.610814 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:09.610784    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm" event={"ID":"01a7a8be-5a1a-4d39-9988-8163e34d69e5","Type":"ContainerStarted","Data":"f5663cdef00e8ec4e068ea24b124c83ec7d63b002dd272ac2545a82bf3615181"}
Nov 04 01:10:09.612221 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:09.612198    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pn797" event={"ID":"36657689-6fdf-4f18-b466-52ab25506722","Type":"ContainerStarted","Data":"6897f83f068ff79533f56570e9bc3fff2aee1357f3186a230941efbec64148be"}
Nov 04 01:10:09.613545 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:09.613513    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n9vdh" event={"ID":"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac","Type":"ContainerStarted","Data":"feef5ce7cad9ebccc94792f41a8894a87dfe2400dc81d4ae550f55fdd588104e"}
Nov 04 01:10:09.735101 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:09.735045    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm" podStartSLOduration=3.82217313 podStartE2EDuration="13.735030516s" totalImagesPullingTime="9.912857386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:09.734617435 +0000 UTC m=+13.767137851" watchObservedRunningTime="2026-11-04 01:10:09.735030516 +0000 UTC m=+13.767550927"
Nov 04 01:10:09.855910 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:09.855859    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pn797" podStartSLOduration=5.368742863 podStartE2EDuration="13.855838942s" totalImagesPullingTime="8.487096079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:09.855080147 +0000 UTC m=+13.887600560" watchObservedRunningTime="2026-11-04 01:10:09.855838942 +0000 UTC m=+13.888359354"
Nov 04 01:10:09.978150 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:09.978100    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n9vdh" podStartSLOduration=3.862535942 podStartE2EDuration="13.978081003s" totalImagesPullingTime="10.115545061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:09.977445254 +0000 UTC m=+14.009965665" watchObservedRunningTime="2026-11-04 01:10:09.978081003 +0000 UTC m=+14.010601414"
Nov 04 01:10:10.617247 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:10.617212    2578 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="ccb3e8e1eca1fecd0d6271052867931e7783e9328a80725e00e4b0c7eb877c05" exitCode=0
Nov 04 01:10:10.617864 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:10.617310    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmcdr" event={"ID":"aea8797d-c027-4b30-8e75-e65ed05158af","Type":"ContainerDied","Data":"ccb3e8e1eca1fecd0d6271052867931e7783e9328a80725e00e4b0c7eb877c05"}
Nov 04 01:10:11.504376 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:11.504340    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:11.504376 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:11.504365    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:11.504674 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:11.504457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:11.504674 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:11.504472    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:11.504674 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:11.504569    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:11.504904 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:11.504675    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:12.625073 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:12.624806    2578 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="e194fc52b447707781e17f4fefcb22eabf56462233703dffc175d522bdc32afb" exitCode=0
Nov 04 01:10:12.625073 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:12.624886    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmcdr" event={"ID":"aea8797d-c027-4b30-8e75-e65ed05158af","Type":"ContainerDied","Data":"e194fc52b447707781e17f4fefcb22eabf56462233703dffc175d522bdc32afb"}
Nov 04 01:10:13.408792 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:13.408757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:13.408978 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:13.408881    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:13.408978 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:13.408947    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret podName:41d83d70-c53d-4e05-9ef0-54918d176ee0 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:29.408929347 +0000 UTC m=+33.441449736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret") pod "global-pull-secret-syncer-c5jls" (UID: "41d83d70-c53d-4e05-9ef0-54918d176ee0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:13.503933 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:13.503901    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:13.503933 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:13.503926    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:13.504098 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:13.504018    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:13.504098 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:13.504022    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:13.504167 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:13.504097    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:13.504167 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:13.504148    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:13.509141 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:13.509080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:13.509251 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:13.509150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:13.509309 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:13.509251    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:10:13.509309 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:13.509282    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:10:13.509309 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:13.509252    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:13.509457 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:13.509354    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs podName:54daba34-bdc5-4e9a-8fc2-124c44311571 nodeName:}" failed. No retries permitted until 2026-11-04 01:10:29.5093307 +0000 UTC m=+33.541851102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs") pod "network-metrics-daemon-plbjs" (UID: "54daba34-bdc5-4e9a-8fc2-124c44311571") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:13.509457 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:13.509294    2578 projected.go:196] Error preparing data for projected volume kube-api-access-h6j5x for pod openshift-network-diagnostics/network-check-target-l4plc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:13.509457 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:13.509440    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x podName:af124602-383f-4c7a-8325-6cbaf0d80d1e nodeName:}" failed. No retries permitted until 2026-11-04 01:10:29.509415611 +0000 UTC m=+33.541936016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6j5x" (UniqueName: "kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x") pod "network-check-target-l4plc" (UID: "af124602-383f-4c7a-8325-6cbaf0d80d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:15.504650 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:15.504468    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:15.504942 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:15.504562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:15.504942 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:15.504743    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:15.504942 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:15.504570    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:15.504942 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:15.504843    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:15.504942 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:15.504872    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:15.634212 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:15.634178    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn" event={"ID":"3d8801a3-3cc4-4311-9876-152f71cc5687","Type":"ContainerStarted","Data":"56715433a875da3c49e44e6a8bdbe2302ae63baa78c7f7a48b49135371fd14a4"}
Nov 04 01:10:15.634347 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:15.634262    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn" event={"ID":"3d8801a3-3cc4-4311-9876-152f71cc5687","Type":"ContainerStarted","Data":"8137e50f881b40664e49e08023dd19cfdc491c66cde5fa5d1e4e40462fba8386"}
Nov 04 01:10:15.634347 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:15.634298    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn" event={"ID":"3d8801a3-3cc4-4311-9876-152f71cc5687","Type":"ContainerStarted","Data":"16b4e7f7b45acc15f0db126196dc43d4730bf280d7ccd6b30a5943b3531a0de3"}
Nov 04 01:10:15.634347 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:15.634328    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn" event={"ID":"3d8801a3-3cc4-4311-9876-152f71cc5687","Type":"ContainerStarted","Data":"8a7656ed88bbe7f294f58565a97aea793cfa24c0914d9081fa63da4d2a34acf8"}
Nov 04 01:10:15.634456 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:15.634354    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn" event={"ID":"3d8801a3-3cc4-4311-9876-152f71cc5687","Type":"ContainerStarted","Data":"03fffcdaa1f1320b72a1490006674563eb44baa9d4947f0a6a40ae941c0449eb"}
Nov 04 01:10:15.634456 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:15.634399    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn" event={"ID":"3d8801a3-3cc4-4311-9876-152f71cc5687","Type":"ContainerStarted","Data":"43f2accac395c4a05a1599c9e5125890c1132998c1d6c67cf06be4556107d081"}
Nov 04 01:10:15.636836 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:15.636812    2578 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="22a75b91037637acfbb03d98d4f382f80e3ff5ce12494621c19d6e7e997a14a9" exitCode=0
Nov 04 01:10:15.636967 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:15.636848    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmcdr" event={"ID":"aea8797d-c027-4b30-8e75-e65ed05158af","Type":"ContainerDied","Data":"22a75b91037637acfbb03d98d4f382f80e3ff5ce12494621c19d6e7e997a14a9"}
Nov 04 01:10:16.642011 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:16.641979    2578 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="559f9be1cd61f0fc93f0e7f538a0e552139aa4fe3e4c4239ef4098b57d5b5ac3" exitCode=0
Nov 04 01:10:16.642485 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:16.642022    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmcdr" event={"ID":"aea8797d-c027-4b30-8e75-e65ed05158af","Type":"ContainerDied","Data":"559f9be1cd61f0fc93f0e7f538a0e552139aa4fe3e4c4239ef4098b57d5b5ac3"}
Nov 04 01:10:17.447220 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:17.447175    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:17.504817 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:17.504790    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:17.504960 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:17.504870    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:17.504960 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:17.504892    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:17.505022 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:17.504969    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:17.505022 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:17.505009    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:17.505077 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:17.505059    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:17.648368 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:17.648339    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn" event={"ID":"3d8801a3-3cc4-4311-9876-152f71cc5687","Type":"ContainerStarted","Data":"c662907ab6e500638ff22c6417d845b61bbc1e8d0991eac17250f5ebcb1379af"}
Nov 04 01:10:17.649448 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:17.649408    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:17.651903 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:17.651875    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmcdr" event={"ID":"aea8797d-c027-4b30-8e75-e65ed05158af","Type":"ContainerStarted","Data":"b9142af7c615734c9e3a8ba2eefa460948ddda7ddabc8b253dfb1676ebb5dad2"}
Nov 04 01:10:17.779919 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:17.779818    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hmcdr" podStartSLOduration=8.661268655 podStartE2EDuration="21.779805026s" totalImagesPullingTime="13.118536371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:17.779729334 +0000 UTC m=+21.812249747" watchObservedRunningTime="2026-11-04 01:10:17.779805026 +0000 UTC m=+21.812325436"
Nov 04 01:10:19.336103 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:19.336067    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:10:19.336649 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:19.336197    2578 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 01:10:19.336649 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:19.336585    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:10:19.503978 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:19.503943    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:19.504154 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:19.504019    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:19.504154 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:19.504049    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:19.504270 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:19.504156    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:19.504270 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:19.504184    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:19.504367 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:19.504270    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:19.539707 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:19.539684    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:19.687792 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:19.687768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:20.527435 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:20.527403    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:20.661461 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:20.661428    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn" event={"ID":"3d8801a3-3cc4-4311-9876-152f71cc5687","Type":"ContainerStarted","Data":"59846966638fd7363e7edb3c87925edead04236e9443ca28a8cec09b104c3f57"}
Nov 04 01:10:20.661805 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:20.661772    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:10:20.677110 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:20.676966    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:10:20.684907 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:20.684885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:20.838313 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:20.838197    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:20.956196 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:20.956136    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn" podStartSLOduration=7.955558193 podStartE2EDuration="24.95612331s" totalImagesPullingTime="17.000565117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:20.955810946 +0000 UTC m=+24.988331360" watchObservedRunningTime="2026-11-04 01:10:20.95612331 +0000 UTC m=+24.988643720"
Nov 04 01:10:21.208049 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:21.208019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:21.300444 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:21.300412    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:10:21.355553 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:21.355484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:21.504548 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:21.504457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:21.504714 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:21.504457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:21.504714 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:21.504457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:21.504714 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:21.504603    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:21.504714 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:21.504695    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:21.504920 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:21.504756    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:21.664497 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:21.664470    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:10:21.679578 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:21.679520    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:10:21.970171 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:21.970139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:22.433405 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:22.433329    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l4plc"]
Nov 04 01:10:22.433624 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:22.433484    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:22.433624 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:22.433600    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:22.436837 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:22.436809    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-plbjs"]
Nov 04 01:10:22.436933 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:22.436920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:22.437053 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:22.437036    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:22.437263 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:22.437238    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c5jls"]
Nov 04 01:10:22.437379 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:22.437334    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:22.437429 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:22.437414    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:22.625574 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:22.625519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:23.765247 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:23.765221    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:23.954014 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:23.953988    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xdspt_335e91c5-3f5e-49e7-ab4c-67ffb1e5d694/dns-node-resolver/0.log"
Nov 04 01:10:24.018134 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:24.018065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:24.179059 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:24.179032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:24.322461 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:24.322391    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:24.472861 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:24.472833    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:24.504632 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:24.504595    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:24.504632 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:24.504628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:24.504842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:24.504595    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:24.504842 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:24.504712    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:24.504842 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:24.504799    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:24.504996 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:24.504892    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:24.616358 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:24.616290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:24.667019 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:24.666997    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mgql9_d1a3f906-3026-4220-af30-3a682acafbbb/node-ca/0.log"
Nov 04 01:10:25.496307 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:25.496275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:25.717669 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:25.717636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:25.918963 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:25.918927    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:26.119569 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:26.119474    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:26.319224 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:26.319190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:26.504842 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:26.504814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:26.505221 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:26.504887    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:26.505221 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:26.504978    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:26.505221 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:26.505086    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:26.505221 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:26.505128    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:26.505221 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:26.505175    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:26.521800 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:26.521774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:27.184306 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:27.184276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:27.348778 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:27.348748    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:27.491441 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:27.491409    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:27.635542 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:27.635512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:27.920611 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:27.920561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:28.064961 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:28.064886    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:28.211187 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:28.211153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:28.353918 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:28.353839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:28.504226 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:28.504188    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:28.504385 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:28.504188    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:28.504385 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:28.504298    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:28.504385 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:28.504202    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:28.504479 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:28.504377    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:28.504479 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:28.504441    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:28.721157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:28.721127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:29.434510 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:29.434471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:29.434936 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:29.434916    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:29.435102 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:29.435092    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret podName:41d83d70-c53d-4e05-9ef0-54918d176ee0 nodeName:}" failed. No retries permitted until 2026-11-04 01:11:01.43506687 +0000 UTC m=+65.467587278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret") pod "global-pull-secret-syncer-c5jls" (UID: "41d83d70-c53d-4e05-9ef0-54918d176ee0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 01:10:29.518988 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:29.518929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:29.535971 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:29.535949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:29.536077 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:29.535981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:29.536138 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:29.536120    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 01:10:29.536138 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:29.536134    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:29.536198 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:29.536143    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 01:10:29.536198 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:29.536154    2578 projected.go:196] Error preparing data for projected volume kube-api-access-h6j5x for pod openshift-network-diagnostics/network-check-target-l4plc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:29.536198 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:29.536178    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs podName:54daba34-bdc5-4e9a-8fc2-124c44311571 nodeName:}" failed. No retries permitted until 2026-11-04 01:11:01.53616628 +0000 UTC m=+65.568686669 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs") pod "network-metrics-daemon-plbjs" (UID: "54daba34-bdc5-4e9a-8fc2-124c44311571") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 01:10:29.536198 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:29.536189    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x podName:af124602-383f-4c7a-8325-6cbaf0d80d1e nodeName:}" failed. No retries permitted until 2026-11-04 01:11:01.53618375 +0000 UTC m=+65.568704140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6j5x" (UniqueName: "kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x") pod "network-check-target-l4plc" (UID: "af124602-383f-4c7a-8325-6cbaf0d80d1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 01:10:29.784783 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:29.784754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:29.927984 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:29.927935    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:30.119589 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:30.119473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:30.318706 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:30.318659    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:30.504384 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:30.504358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:30.504384 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:30.504370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:30.504639 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:30.504439    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:30.504639 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:30.504453    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:30.504639 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:30.504548    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:30.504739 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:30.504653    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:30.719115 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:30.719075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:31.522123 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:31.522079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:31.718703 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:31.718640    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:32.123665 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:32.123615    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:32.324506 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:32.324393    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:32.504090 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:32.504054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:32.504090 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:32.504072    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:32.504090 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:32.504054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:32.504375 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:32.504157    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:32.504375 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:32.504208    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:32.504375 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:32.504288    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:32.708982 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:32.708921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:32.854753 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:32.854722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:33.000102 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:33.000001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:33.146829 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:33.146763    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:33.290343 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:33.290232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:33.519630 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:33.519597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:33.718250 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:33.718223    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:33.918227 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:33.918192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:34.063133 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:34.063065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:34.211313 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:34.211283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:34.361163 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:34.361080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:34.504179 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:34.504143    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:34.504179 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:34.504167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:34.504430 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:34.504193    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:34.504430 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:34.504279    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:34.504430 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:34.504346    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:34.504430 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:34.504406    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:34.504844 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:34.504827    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:34.647359 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:34.647260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:34.885404 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:34.885370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:35.029444 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:35.029413    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:35.324678 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:35.324603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:35.766809 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:35.766780    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:35.910289 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:35.910257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:36.504664 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:36.504631    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:36.504845 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:36.504708    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:36.504845 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:36.504798    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:36.504966 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:36.504936    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:36.505021 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:36.504997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:36.505078 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:36.505061    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:38.504786 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:38.504748    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:38.504786 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:38.504769    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:38.505205 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:38.504875    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:38.505205 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:38.504933    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:38.505205 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:38.505043    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:38.505205 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:38.505159    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:40.504255 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:40.504223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:40.504655 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:40.504236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:40.504655 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:40.504325    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l4plc" podUID="af124602-383f-4c7a-8325-6cbaf0d80d1e"
Nov 04 01:10:40.504655 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:40.504341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:40.504655 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:40.504423    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plbjs" podUID="54daba34-bdc5-4e9a-8fc2-124c44311571"
Nov 04 01:10:40.504655 ip-10-0-128-142 kubenswrapper[2578]: E1104 01:10:40.504485    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5jls" podUID="41d83d70-c53d-4e05-9ef0-54918d176ee0"
Nov 04 01:10:40.607025 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:40.606994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:40.762386 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:40.762314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:41.163897 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.163864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:41.195520 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.195500    2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeReady"
Nov 04 01:10:41.195667 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.195635    2578 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 04 01:10:41.320113 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.319577    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9s98m"]
Nov 04 01:10:41.322386 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.322367    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rf4vp"]
Nov 04 01:10:41.322513 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.322474    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:10:41.324285 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.324263    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.324837 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.324819    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pnhc2"]
Nov 04 01:10:41.326709 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.326689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.330613 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.330581    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:41.360577 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.360554    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9s98m"]
Nov 04 01:10:41.363324 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.363305    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rf4vp"]
Nov 04 01:10:41.377886 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.377858    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 01:10:41.378011 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.377996    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 01:10:41.378065 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.378053    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-9dncz\""
Nov 04 01:10:41.378110 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.378057    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 01:10:41.379392 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.379375    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 01:10:41.379626 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.379614    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 01:10:41.379756 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.379742    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ldpj7\""
Nov 04 01:10:41.381696 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.381682    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qr45v\""
Nov 04 01:10:41.381855 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.381844    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 01:10:41.414911 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.414887    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 01:10:41.414911 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.414890    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 01:10:41.415024 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.414919    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 01:10:41.422206 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.422182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec448ba9-2485-4143-9b71-d5e3b51d507c-metrics-tls\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.422206 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.422208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec448ba9-2485-4143-9b71-d5e3b51d507c-tmp-dir\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.422361 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.422224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v56qh\" (UniqueName: \"kubernetes.io/projected/ec448ba9-2485-4143-9b71-d5e3b51d507c-kube-api-access-v56qh\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.422361 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.422328    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec448ba9-2485-4143-9b71-d5e3b51d507c-config-volume\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.422464 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.422411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt9g6\" (UniqueName: \"kubernetes.io/projected/9ab62697-06cf-4b69-abb4-cefd227bbd8a-kube-api-access-jt9g6\") pod \"ingress-canary-9s98m\" (UID: \"9ab62697-06cf-4b69-abb4-cefd227bbd8a\") " pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:10:41.422464 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.422450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab62697-06cf-4b69-abb4-cefd227bbd8a-cert\") pod \"ingress-canary-9s98m\" (UID: \"9ab62697-06cf-4b69-abb4-cefd227bbd8a\") " pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:10:41.422597 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.422479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.422597 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.422508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b6b228e-6fd5-455f-91c3-498ac0b29d01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.422597 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.422590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b6b228e-6fd5-455f-91c3-498ac0b29d01-crio-socket\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.422690 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.422611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b6b228e-6fd5-455f-91c3-498ac0b29d01-data-volume\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.422690 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.422656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk9v8\" (UniqueName: \"kubernetes.io/projected/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-api-access-sk9v8\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.423653 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.423636    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pnhc2"]
Nov 04 01:10:41.523598 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.523570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec448ba9-2485-4143-9b71-d5e3b51d507c-metrics-tls\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.524092 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.523604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec448ba9-2485-4143-9b71-d5e3b51d507c-tmp-dir\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.524092 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.523629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v56qh\" (UniqueName: \"kubernetes.io/projected/ec448ba9-2485-4143-9b71-d5e3b51d507c-kube-api-access-v56qh\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.524092 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.523683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec448ba9-2485-4143-9b71-d5e3b51d507c-config-volume\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.524092 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.523710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt9g6\" (UniqueName: \"kubernetes.io/projected/9ab62697-06cf-4b69-abb4-cefd227bbd8a-kube-api-access-jt9g6\") pod \"ingress-canary-9s98m\" (UID: \"9ab62697-06cf-4b69-abb4-cefd227bbd8a\") " pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:10:41.524092 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.523736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab62697-06cf-4b69-abb4-cefd227bbd8a-cert\") pod \"ingress-canary-9s98m\" (UID: \"9ab62697-06cf-4b69-abb4-cefd227bbd8a\") " pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:10:41.524092 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.523764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.524092 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.523912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b6b228e-6fd5-455f-91c3-498ac0b29d01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.524092 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.523953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b6b228e-6fd5-455f-91c3-498ac0b29d01-crio-socket\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.524092 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.523979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b6b228e-6fd5-455f-91c3-498ac0b29d01-data-volume\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.524092 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.523999    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec448ba9-2485-4143-9b71-d5e3b51d507c-tmp-dir\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.524092 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.524010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk9v8\" (UniqueName: \"kubernetes.io/projected/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-api-access-sk9v8\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.524591 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.524216    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b6b228e-6fd5-455f-91c3-498ac0b29d01-crio-socket\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.524591 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.524434    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec448ba9-2485-4143-9b71-d5e3b51d507c-config-volume\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.524591 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.524433    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.524591 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.524454    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b6b228e-6fd5-455f-91c3-498ac0b29d01-data-volume\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.527332 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.527304    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b6b228e-6fd5-455f-91c3-498ac0b29d01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.527429 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.527411    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec448ba9-2485-4143-9b71-d5e3b51d507c-metrics-tls\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.527544 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.527514    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab62697-06cf-4b69-abb4-cefd227bbd8a-cert\") pod \"ingress-canary-9s98m\" (UID: \"9ab62697-06cf-4b69-abb4-cefd227bbd8a\") " pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:10:41.587538 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.587469    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk9v8\" (UniqueName: \"kubernetes.io/projected/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-api-access-sk9v8\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:41.587643 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.587569    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v56qh\" (UniqueName: \"kubernetes.io/projected/ec448ba9-2485-4143-9b71-d5e3b51d507c-kube-api-access-v56qh\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.587749 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.587734    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt9g6\" (UniqueName: \"kubernetes.io/projected/9ab62697-06cf-4b69-abb4-cefd227bbd8a-kube-api-access-jt9g6\") pod \"ingress-canary-9s98m\" (UID: \"9ab62697-06cf-4b69-abb4-cefd227bbd8a\") " pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:10:41.635017 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.634994    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:10:41.641767 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.641740    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:41.647733 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:41.647712    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:10:42.021147 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:10:42.021116    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec448ba9_2485_4143_9b71_d5e3b51d507c.slice/crio-770bc9a3fdf9188627e10d49293d93d4f611f1d6e26e1710403cf59d28054eff WatchSource:0}: Error finding container 770bc9a3fdf9188627e10d49293d93d4f611f1d6e26e1710403cf59d28054eff: Status 404 returned error can't find the container with id 770bc9a3fdf9188627e10d49293d93d4f611f1d6e26e1710403cf59d28054eff
Nov 04 01:10:42.023307 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.023278    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rf4vp"]
Nov 04 01:10:42.065820 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:10:42.065787    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab62697_06cf_4b69_abb4_cefd227bbd8a.slice/crio-41bd9a978a285cf1be7e937ed0189d62fb2835f4cdb43dd30f22565d4030d698 WatchSource:0}: Error finding container 41bd9a978a285cf1be7e937ed0189d62fb2835f4cdb43dd30f22565d4030d698: Status 404 returned error can't find the container with id 41bd9a978a285cf1be7e937ed0189d62fb2835f4cdb43dd30f22565d4030d698
Nov 04 01:10:42.068756 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.068679    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9s98m"]
Nov 04 01:10:42.068756 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:10:42.068712    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6b228e_6fd5_455f_91c3_498ac0b29d01.slice/crio-d521785aa434b98c89ae0fcf259439d7bab01a128e9166da44eb06c9a8dba061 WatchSource:0}: Error finding container d521785aa434b98c89ae0fcf259439d7bab01a128e9166da44eb06c9a8dba061: Status 404 returned error can't find the container with id d521785aa434b98c89ae0fcf259439d7bab01a128e9166da44eb06c9a8dba061
Nov 04 01:10:42.071612 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.071527    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pnhc2"]
Nov 04 01:10:42.505002 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.504971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:10:42.505177 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.504982    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:10:42.505177 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.505123    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:10:42.562389 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.562361    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-x4nsn\""
Nov 04 01:10:42.562770 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.562410    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 01:10:42.562770 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.562410    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 01:10:42.562770 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.562459    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-8hhs6\""
Nov 04 01:10:42.562770 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.562571    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 01:10:42.562770 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.562620    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 01:10:42.562770 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.562625    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8lz6w\""
Nov 04 01:10:42.717620 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.717582    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rf4vp" event={"ID":"ec448ba9-2485-4143-9b71-d5e3b51d507c","Type":"ContainerStarted","Data":"770bc9a3fdf9188627e10d49293d93d4f611f1d6e26e1710403cf59d28054eff"}
Nov 04 01:10:42.718707 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.718673    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9s98m" event={"ID":"9ab62697-06cf-4b69-abb4-cefd227bbd8a","Type":"ContainerStarted","Data":"41bd9a978a285cf1be7e937ed0189d62fb2835f4cdb43dd30f22565d4030d698"}
Nov 04 01:10:42.719884 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.719864    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pnhc2" event={"ID":"1b6b228e-6fd5-455f-91c3-498ac0b29d01","Type":"ContainerStarted","Data":"a8bed6841ea7c3859da9b984fd429fcfc15d2a530f6afb14ff58b8fef1fbf328"}
Nov 04 01:10:42.719984 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:42.719908    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pnhc2" event={"ID":"1b6b228e-6fd5-455f-91c3-498ac0b29d01","Type":"ContainerStarted","Data":"d521785aa434b98c89ae0fcf259439d7bab01a128e9166da44eb06c9a8dba061"}
Nov 04 01:10:43.724900 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:43.724856    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pnhc2" event={"ID":"1b6b228e-6fd5-455f-91c3-498ac0b29d01","Type":"ContainerStarted","Data":"0e08e701a6c2a39856c171ed83e7597718605bf5b2c753ba5a4fe992e1125d04"}
Nov 04 01:10:44.286112 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.286081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:44.429438 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.429400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:44.574766 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.574690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:44.732781 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.732751    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"]
Nov 04 01:10:44.736326 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.736270    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rf4vp" event={"ID":"ec448ba9-2485-4143-9b71-d5e3b51d507c","Type":"ContainerStarted","Data":"5f093338f3a2503612aea01e65f0fce0e90b6e178637744b47e44473de6df977"}
Nov 04 01:10:44.736441 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.736403    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.744456 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.744285    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:44.749023 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.749004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.749108 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.749033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.749108 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.749061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.749182 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.749138    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q76ww\" (UniqueName: \"kubernetes.io/projected/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-kube-api-access-q76ww\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.792466 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.792424    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 04 01:10:44.792645 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.792599    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"]
Nov 04 01:10:44.802101 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.802064    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 04 01:10:44.845017 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.844945    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 01:10:44.845017 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.845004    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pnqhw\""
Nov 04 01:10:44.845594 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.845580    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 01:10:44.845687 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.845676    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 01:10:44.849388 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.849365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.849502 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.849398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.849502 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.849430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.849502 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.849448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q76ww\" (UniqueName: \"kubernetes.io/projected/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-kube-api-access-q76ww\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.850728 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.850702    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.852375 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.852354    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.852772 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.852745    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:44.913273 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:44.913240    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q76ww\" (UniqueName: \"kubernetes.io/projected/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-kube-api-access-q76ww\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:45.052636 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:45.052602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:10:45.425192 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:10:45.425161    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc24cc4d_f739_4d7c_b32c_a134c5ca3ca3.slice/crio-44653bfe4ca11623d22a199932c081b4fe66f5ef93fc71cf830a64e2b98c9f66 WatchSource:0}: Error finding container 44653bfe4ca11623d22a199932c081b4fe66f5ef93fc71cf830a64e2b98c9f66: Status 404 returned error can't find the container with id 44653bfe4ca11623d22a199932c081b4fe66f5ef93fc71cf830a64e2b98c9f66
Nov 04 01:10:45.426915 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:45.426847    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"]
Nov 04 01:10:45.738549 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:45.738505    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k" event={"ID":"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3","Type":"ContainerStarted","Data":"44653bfe4ca11623d22a199932c081b4fe66f5ef93fc71cf830a64e2b98c9f66"}
Nov 04 01:10:45.740306 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:45.740280    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rf4vp" event={"ID":"ec448ba9-2485-4143-9b71-d5e3b51d507c","Type":"ContainerStarted","Data":"f97180fbd16c9545819d7200e5403db4b2d74e957fe6367156f8329b561c3e4d"}
Nov 04 01:10:45.740433 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:45.740413    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:45.817577 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:45.817525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:45.864130 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:45.864065    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-rf4vp" podStartSLOduration=2.2749686479999998 podStartE2EDuration="4.864046463s" totalImagesPullingTime="2.589077815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:45.863553146 +0000 UTC m=+49.896073553" watchObservedRunningTime="2026-11-04 01:10:45.864046463 +0000 UTC m=+49.896566876"
Nov 04 01:10:45.964857 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:45.964824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:46.438484 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:46.438414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:46.744589 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:46.744527    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pnhc2" event={"ID":"1b6b228e-6fd5-455f-91c3-498ac0b29d01","Type":"ContainerStarted","Data":"bd7a5e36010de57dc8cbf3f0946f572fad4be3b960ae49c616574af0ad2c035c"}
Nov 04 01:10:46.746207 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:46.746176    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9s98m" event={"ID":"9ab62697-06cf-4b69-abb4-cefd227bbd8a","Type":"ContainerStarted","Data":"a10f108d752898ad2019fa32b284d06e07ef553db685c5af9c133f6923729856"}
Nov 04 01:10:47.818575 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:47.818529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:47.869898 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:47.869850    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9s98m" podStartSLOduration=3.251913341 podStartE2EDuration="6.869832145s" totalImagesPullingTime="3.617918804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:47.869481797 +0000 UTC m=+51.902002210" watchObservedRunningTime="2026-11-04 01:10:47.869832145 +0000 UTC m=+51.902352555"
Nov 04 01:10:47.993670 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:47.993614    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pnhc2" podStartSLOduration=2.691344428 podStartE2EDuration="6.993599167s" totalImagesPullingTime="4.302254739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:47.992878982 +0000 UTC m=+52.025399393" watchObservedRunningTime="2026-11-04 01:10:47.993599167 +0000 UTC m=+52.026119578"
Nov 04 01:10:48.754072 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:48.754024    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k" event={"ID":"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3","Type":"ContainerStarted","Data":"5e85247617553ae7cb96bc4400b6ac7de73e9612249acf22e751b1824db8001e"}
Nov 04 01:10:48.754235 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:48.754095    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k" event={"ID":"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3","Type":"ContainerStarted","Data":"feff52e3ba2e0edf7085dd608c04e84eb4b4c64ccf986a85cdc87b81d3c64254"}
Nov 04 01:10:48.877763 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:48.877710    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k" podStartSLOduration=2.554748138 podStartE2EDuration="4.877696169s" totalImagesPullingTime="2.322948031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:48.876737918 +0000 UTC m=+52.909258330" watchObservedRunningTime="2026-11-04 01:10:48.877696169 +0000 UTC m=+52.910216579"
Nov 04 01:10:50.615546 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:50.615510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:51.445253 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:51.445221    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:51.591389 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:51.591362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:51.737562 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:51.737473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:51.980827 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:51.980791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:52.122754 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.122679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:52.268747 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.268717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:52.291911 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.290799    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vp26r"]
Nov 04 01:10:52.294341 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.294319    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.299104 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.299076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-tls\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.299228 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.299114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-wtmp\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.299228 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.299169    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.299228 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.299196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.299228 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.299216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-root\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.299384 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.299235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-metrics-client-ca\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.299384 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.299361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-textfile\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.299443 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.299419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95zdd\" (UniqueName: \"kubernetes.io/projected/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-kube-api-access-95zdd\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.299473 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.299461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-sys\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.350157 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.350124    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 01:10:52.400125 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-sys\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400125 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-tls\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400279 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-wtmp\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400279 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400279 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400161    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-sys\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400279 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400279 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-root\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400279 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-metrics-client-ca\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400502 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-textfile\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400502 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400289    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-root\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400502 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400299    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-wtmp\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400502 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95zdd\" (UniqueName: \"kubernetes.io/projected/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-kube-api-access-95zdd\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400691 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400648    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-textfile\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.400887 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.400870    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-metrics-client-ca\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.402431 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.402413    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.402973 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.402953    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zgtmx\""
Nov 04 01:10:52.403055 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.402973    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 01:10:52.403055 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.403017    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 01:10:52.411463 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.411443    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.413169 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.413145    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-tls\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.421358 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.421337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:52.464373 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.464345    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95zdd\" (UniqueName: \"kubernetes.io/projected/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-kube-api-access-95zdd\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.570385 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.570345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:52.606524 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.606492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:10:52.616013 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:10:52.615991    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcceb3236_3f5d_4711_86f2_6d13d8e2b92b.slice/crio-a26c6046116976075e2e1e39e4c42756012443570c8c0471ac99c3bb50e34d9a WatchSource:0}: Error finding container a26c6046116976075e2e1e39e4c42756012443570c8c0471ac99c3bb50e34d9a: Status 404 returned error can't find the container with id a26c6046116976075e2e1e39e4c42756012443570c8c0471ac99c3bb50e34d9a
Nov 04 01:10:52.766733 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.766696    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vp26r" event={"ID":"cceb3236-3f5d-4711-86f2-6d13d8e2b92b","Type":"ContainerStarted","Data":"a26c6046116976075e2e1e39e4c42756012443570c8c0471ac99c3bb50e34d9a"}
Nov 04 01:10:52.859322 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:52.859287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:53.004278 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:53.004246    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:53.149759 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:53.149683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:53.674208 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:53.674174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:53.679107 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:53.679086    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:10:53.871956 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:53.871927    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:54.074962 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:54.074924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:54.269921 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:54.269896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:54.423178 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:54.423105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:54.584204 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:54.584156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:54.775887 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:54.775851    2578 generic.go:356] "Generic (PLEG): container finished" podID="cceb3236-3f5d-4711-86f2-6d13d8e2b92b" containerID="422c52b52396e269bbddedef9de495b6f1c25f0a8b1ce0c399945558e6950d7d" exitCode=0
Nov 04 01:10:54.776048 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:54.775923    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vp26r" event={"ID":"cceb3236-3f5d-4711-86f2-6d13d8e2b92b","Type":"ContainerDied","Data":"422c52b52396e269bbddedef9de495b6f1c25f0a8b1ce0c399945558e6950d7d"}
Nov 04 01:10:54.968133 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:54.966997    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f4b759ddc-s75m9"]
Nov 04 01:10:54.970621 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:54.970602    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.021060 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.021034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34189a58-fb9a-4726-9160-6b3e765770ed-tmp\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.021226 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.021075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.021226 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.021099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34189a58-fb9a-4726-9160-6b3e765770ed-metrics-client-ca\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.021226 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.021121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-grpc-tls\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.021381 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.021258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.021381 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.021322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-tls\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.021381 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.021346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pkjb\" (UniqueName: \"kubernetes.io/projected/34189a58-fb9a-4726-9160-6b3e765770ed-kube-api-access-9pkjb\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.021515 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.021383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.021515 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.021400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.027811 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.027742    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Nov 04 01:10:55.027811 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.027742    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-721pcmfl1crkg\""
Nov 04 01:10:55.027811 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.027750    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Nov 04 01:10:55.027986 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.027810    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Nov 04 01:10:55.027986 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.027836    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Nov 04 01:10:55.027986 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.027948    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-csp49\""
Nov 04 01:10:55.027986 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.027966    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Nov 04 01:10:55.029088 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.029069    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f4b759ddc-s75m9"]
Nov 04 01:10:55.121798 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.121766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34189a58-fb9a-4726-9160-6b3e765770ed-metrics-client-ca\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.121798 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.121800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-grpc-tls\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.121999 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.121839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.121999 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.121883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-tls\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.121999 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.121920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pkjb\" (UniqueName: \"kubernetes.io/projected/34189a58-fb9a-4726-9160-6b3e765770ed-kube-api-access-9pkjb\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.122126 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.122071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.122126 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.122114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.122270 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.122248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34189a58-fb9a-4726-9160-6b3e765770ed-tmp\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.122346 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.122304    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.122696 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.122636    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34189a58-fb9a-4726-9160-6b3e765770ed-metrics-client-ca\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.122994 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.122943    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34189a58-fb9a-4726-9160-6b3e765770ed-tmp\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.124565 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.124519    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.124690 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.124667    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.124947 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.124918    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.124947 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.124937    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.125098 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.125074    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-tls\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.125151 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.125138    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-grpc-tls\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.185999 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.185969    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pkjb\" (UniqueName: \"kubernetes.io/projected/34189a58-fb9a-4726-9160-6b3e765770ed-kube-api-access-9pkjb\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.287246 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.287156    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:10:55.747821 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.747794    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:10:55.755689 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.755667    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f4b759ddc-s75m9"]
Nov 04 01:10:55.781426 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:10:55.781401    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34189a58_fb9a_4726_9160_6b3e765770ed.slice/crio-91ba5763b2b98c87a4b8498521a5c1824a96b80d421c2c59126705106b66dae0 WatchSource:0}: Error finding container 91ba5763b2b98c87a4b8498521a5c1824a96b80d421c2c59126705106b66dae0: Status 404 returned error can't find the container with id 91ba5763b2b98c87a4b8498521a5c1824a96b80d421c2c59126705106b66dae0
Nov 04 01:10:55.781620 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.781601    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vp26r" event={"ID":"cceb3236-3f5d-4711-86f2-6d13d8e2b92b","Type":"ContainerStarted","Data":"7d6650cf47bef3b22a4439d7c767ebdd3cb150a99340020c291057b5ef513dac"}
Nov 04 01:10:55.781676 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:55.781649    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vp26r" event={"ID":"cceb3236-3f5d-4711-86f2-6d13d8e2b92b","Type":"ContainerStarted","Data":"e418322e3a26997a847f92a8ecbae25fbbebcf4d6c06fd8d81ab157f25b21969"}
Nov 04 01:10:56.000671 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:56.000567    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vp26r" podStartSLOduration=2.35882051 podStartE2EDuration="4.00055317s" totalImagesPullingTime="1.576005062s" totalInitContainerRuntime="65.727598ms" isStatefulPod=true podCreationTimestamp="2026-11-04 01:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:10:56.000298675 +0000 UTC m=+60.032819116" watchObservedRunningTime="2026-11-04 01:10:56.00055317 +0000 UTC m=+60.033073578"
Nov 04 01:10:56.060628 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:56.060593    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:56.259206 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:56.259130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:56.405124 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:56.405085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:56.546606 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:56.546515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:56.690505 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:56.690471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:56.785764 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:56.785727    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9" event={"ID":"34189a58-fb9a-4726-9160-6b3e765770ed","Type":"ContainerStarted","Data":"91ba5763b2b98c87a4b8498521a5c1824a96b80d421c2c59126705106b66dae0"}
Nov 04 01:10:56.891127 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:56.891059    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:57.001879 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.001843    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"]
Nov 04 01:10:57.004108 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.004086    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:10:57.033289 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.033258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:57.038487 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.038457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrrf5\" (UniqueName: \"kubernetes.io/projected/45b64324-82f2-4075-80e1-50255e083d70-kube-api-access-mrrf5\") pod \"monitoring-plugin-77f4f76594-v7gwr\" (UID: \"45b64324-82f2-4075-80e1-50255e083d70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:10:57.038658 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.038639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45b64324-82f2-4075-80e1-50255e083d70-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-v7gwr\" (UID: \"45b64324-82f2-4075-80e1-50255e083d70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:10:57.058662 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.058635    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"]
Nov 04 01:10:57.059901 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.059857    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 04 01:10:57.059901 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.059882    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4phhd\""
Nov 04 01:10:57.139608 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.139560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45b64324-82f2-4075-80e1-50255e083d70-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-v7gwr\" (UID: \"45b64324-82f2-4075-80e1-50255e083d70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:10:57.139781 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.139631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrrf5\" (UniqueName: \"kubernetes.io/projected/45b64324-82f2-4075-80e1-50255e083d70-kube-api-access-mrrf5\") pod \"monitoring-plugin-77f4f76594-v7gwr\" (UID: \"45b64324-82f2-4075-80e1-50255e083d70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:10:57.142395 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.142334    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45b64324-82f2-4075-80e1-50255e083d70-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-v7gwr\" (UID: \"45b64324-82f2-4075-80e1-50255e083d70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:10:57.203276 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.203250    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrrf5\" (UniqueName: \"kubernetes.io/projected/45b64324-82f2-4075-80e1-50255e083d70-kube-api-access-mrrf5\") pod \"monitoring-plugin-77f4f76594-v7gwr\" (UID: \"45b64324-82f2-4075-80e1-50255e083d70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:10:57.215243 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.215211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:57.316893 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.316856    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:10:57.687994 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:10:57.687961    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b64324_82f2_4075_80e1_50255e083d70.slice/crio-4b5fa321f168972fc58af06bd573cd8c3fd7fa84747b39f996a04c65772cdbb2 WatchSource:0}: Error finding container 4b5fa321f168972fc58af06bd573cd8c3fd7fa84747b39f996a04c65772cdbb2: Status 404 returned error can't find the container with id 4b5fa321f168972fc58af06bd573cd8c3fd7fa84747b39f996a04c65772cdbb2
Nov 04 01:10:57.690505 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.690480    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"]
Nov 04 01:10:57.789893 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.789860    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr" event={"ID":"45b64324-82f2-4075-80e1-50255e083d70","Type":"ContainerStarted","Data":"4b5fa321f168972fc58af06bd573cd8c3fd7fa84747b39f996a04c65772cdbb2"}
Nov 04 01:10:57.877866 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.877833    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-c54ddf549-f2j28"]
Nov 04 01:10:57.880866 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.880850    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:57.937153 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.937085    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Nov 04 01:10:57.937329 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.937296    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Nov 04 01:10:57.937459 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.937327    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Nov 04 01:10:57.937551 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.937465    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Nov 04 01:10:57.937551 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.937467    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r28mp\""
Nov 04 01:10:57.937671 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.937588    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Nov 04 01:10:57.950564 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.950519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:57.950694 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.950572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:57.950694 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.950614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4qg7\" (UniqueName: \"kubernetes.io/projected/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-kube-api-access-d4qg7\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:57.950694 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.950638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-metrics-client-ca\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:57.950852 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.950696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-federate-client-tls\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:57.950852 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.950734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-client-tls\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:57.950852 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.950754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:57.950852 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.950786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-serving-certs-ca-bundle\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:57.991122 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.991088    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Nov 04 01:10:57.992196 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:57.992177    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c54ddf549-f2j28"]
Nov 04 01:10:58.051615 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.051579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-serving-certs-ca-bundle\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.052089 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.051635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.052089 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.051738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.052089 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.051789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4qg7\" (UniqueName: \"kubernetes.io/projected/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-kube-api-access-d4qg7\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.052089 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.051820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-metrics-client-ca\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.052089 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.051850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-federate-client-tls\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.052089 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.051881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-client-tls\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.052089 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.051923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.052470 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.052443    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-serving-certs-ca-bundle\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.052613 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.052589    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-metrics-client-ca\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.053073 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.053050    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.054635 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.054609    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.054750 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.054736    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-client-tls\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.054818 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.054779    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-federate-client-tls\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.054882 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.054857    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.116002 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.115962    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4qg7\" (UniqueName: \"kubernetes.io/projected/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-kube-api-access-d4qg7\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.193929 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.193897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:10:58.618903 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:10:58.618868    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7adfcf1_0fc4_4e7f_a94f_5cfaebcf397e.slice/crio-453d1ba76601b8f541b4c842044a41426909e0d924525bb0ff5f77f0ee0ce9ca WatchSource:0}: Error finding container 453d1ba76601b8f541b4c842044a41426909e0d924525bb0ff5f77f0ee0ce9ca: Status 404 returned error can't find the container with id 453d1ba76601b8f541b4c842044a41426909e0d924525bb0ff5f77f0ee0ce9ca
Nov 04 01:10:58.621794 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.621715    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c54ddf549-f2j28"]
Nov 04 01:10:58.795473 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.795432    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28" event={"ID":"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e","Type":"ContainerStarted","Data":"453d1ba76601b8f541b4c842044a41426909e0d924525bb0ff5f77f0ee0ce9ca"}
Nov 04 01:10:58.871658 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:58.871568    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:59.016692 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:59.016668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:10:59.801672 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:59.801636    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9" event={"ID":"34189a58-fb9a-4726-9160-6b3e765770ed","Type":"ContainerStarted","Data":"c590b1e5de5f8ece1887ec6f9d5185c31a5ffe9f814daadeafd5d6d1c899da97"}
Nov 04 01:10:59.802093 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:59.801697    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9" event={"ID":"34189a58-fb9a-4726-9160-6b3e765770ed","Type":"ContainerStarted","Data":"7fe195bd59fbd5482ca12aea628c6c7f54c57b2285e7d5cc589c16f54be30721"}
Nov 04 01:10:59.802093 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:10:59.801723    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9" event={"ID":"34189a58-fb9a-4726-9160-6b3e765770ed","Type":"ContainerStarted","Data":"d6417430d9cbd9e4545698e8da924a065e2410066c648c03a53b0929bcba131f"}
Nov 04 01:11:00.807297 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:00.807117    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr" event={"ID":"45b64324-82f2-4075-80e1-50255e083d70","Type":"ContainerStarted","Data":"27ef1a19cbfcf1bc4ae4652f016b575e9e42070364972bad56da9c5e0908be4b"}
Nov 04 01:11:00.807297 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:00.807185    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:11:00.810766 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:00.810743    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9" event={"ID":"34189a58-fb9a-4726-9160-6b3e765770ed","Type":"ContainerStarted","Data":"678e005c83327b9d594af421addd8d974223df1c1905259506ddd3c5bf4acf91"}
Nov 04 01:11:00.810916 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:00.810810    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9" event={"ID":"34189a58-fb9a-4726-9160-6b3e765770ed","Type":"ContainerStarted","Data":"8ff56286b5efd277b16234398bd46dca7bb66b1dc27721dc6b5ba2b40d5090a4"}
Nov 04 01:11:00.810916 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:00.810849    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9" event={"ID":"34189a58-fb9a-4726-9160-6b3e765770ed","Type":"ContainerStarted","Data":"691bba61ed77bcb038dd48b5718ef173091607878b69d623b2564c3dbc1ebbd1"}
Nov 04 01:11:00.811154 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:00.811133    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:00.813091 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:00.813071    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:11:00.929203 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:00.929142    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr" podStartSLOduration=2.576365757 podStartE2EDuration="4.929125028s" totalImagesPullingTime="2.352759271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:00.928128126 +0000 UTC m=+64.960648539" watchObservedRunningTime="2026-11-04 01:11:00.929125028 +0000 UTC m=+64.961645440"
Nov 04 01:11:01.057287 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.057221    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9" podStartSLOduration=2.478101689 podStartE2EDuration="7.057206503s" totalImagesPullingTime="4.579104814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:01.056908094 +0000 UTC m=+65.089428511" watchObservedRunningTime="2026-11-04 01:11:01.057206503 +0000 UTC m=+65.089726914"
Nov 04 01:11:01.417132 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.417101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:01.422363 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.422334    2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 01:11:01.426026 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.426000    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.482269 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482184    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 04 01:11:01.482434 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482302    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 04 01:11:01.482434 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482417    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 04 01:11:01.482575 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482418    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 04 01:11:01.482575 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482447    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 04 01:11:01.482575 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482425    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 04 01:11:01.482575 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482475    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 04 01:11:01.482575 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-web-config\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.482575 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482490    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 04 01:11:01.482575 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.482575 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482548    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 04 01:11:01.482921 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482690    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 04 01:11:01.482921 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482714    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jhbmd\""
Nov 04 01:11:01.482921 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.482921 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482749    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7cl16ii3sg24k\""
Nov 04 01:11:01.482921 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482750    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 04 01:11:01.482921 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482813    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 04 01:11:01.482921 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482723    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 04 01:11:01.482921 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.482921 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.482921 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483350 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.482974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483350 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:11:01.483350 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483350 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483350 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483144    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483350 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483350 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483350 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-config-out\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483350 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483350 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483779 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9rlx\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-kube-api-access-z9rlx\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483779 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483779 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-config\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483779 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.483779 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.483652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.584714 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.584685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9rlx\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-kube-api-access-z9rlx\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.584870 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.584728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.584870 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.584750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-config\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.584945 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.584866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.584945 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.584910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.584965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-web-config\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.584994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585040 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585207 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585207 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:11:01.585207 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585207 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585207 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585457 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585457 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585457 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:11:01.585457 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585457 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585457 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585457 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-config-out\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585457 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585878 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585878 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585518    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.585878 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.585853    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.586136 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.586112    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.588036 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.587928    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-config\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.588979 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.588740    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 04 01:11:01.588979 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.588908    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.589937 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.589909    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.590152 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.590126    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.590236 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.590159    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.592187 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.590472    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.592187 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.590512    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.592187 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.591170    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.592187 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.591034    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.592187 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.591279    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.592187 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.591376    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-config-out\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.592187 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.591432    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.592187 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.592183    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 01:11:01.593022 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.592954    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-web-config\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.593911 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.593837    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.595572 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.595551    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 04 01:11:01.596914 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.596888    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:11:01.597100 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.597075    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.597168 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.597115    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 01:11:01.600731 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.600709    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.640667 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.640631    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 01:11:01.646618 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.646593    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 01:11:01.647944 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.647917    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:11:01.653686 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.653660    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9rlx\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-kube-api-access-z9rlx\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.702483 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.702460    2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 01:11:01.710705 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.710684    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:11:01.752297 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.752238    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:01.770880 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.770859    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-x4nsn\""
Nov 04 01:11:01.775981 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.775961    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-8hhs6\""
Nov 04 01:11:01.777000 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.776983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:11:01.781869 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.781845    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:11:01.782125 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.782100    2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8lz6w\""
Nov 04 01:11:01.788082 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.788056    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:11:01.820116 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:01.819741    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28" event={"ID":"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e","Type":"ContainerStarted","Data":"90d1def415537d1b2bce05ccdaca46dbb9a6530e526edb4946532471f24ec81b"}
Nov 04 01:11:02.179215 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:11:02.179184    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e6a622_f28d_449c_9c31_08871e1fa26f.slice/crio-8639c952e7d30ce0524ef7dc08ef7bc081bee7e3ab40736197e77b6b650bed78 WatchSource:0}: Error finding container 8639c952e7d30ce0524ef7dc08ef7bc081bee7e3ab40736197e77b6b650bed78: Status 404 returned error can't find the container with id 8639c952e7d30ce0524ef7dc08ef7bc081bee7e3ab40736197e77b6b650bed78
Nov 04 01:11:02.182942 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:02.182922    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 01:11:02.203462 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:11:02.203440    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf124602_383f_4c7a_8325_6cbaf0d80d1e.slice/crio-e88ec241c5e6af119a4489d76f4ac2e294c5180a74211b4979ec659e726d29e5 WatchSource:0}: Error finding container e88ec241c5e6af119a4489d76f4ac2e294c5180a74211b4979ec659e726d29e5: Status 404 returned error can't find the container with id e88ec241c5e6af119a4489d76f4ac2e294c5180a74211b4979ec659e726d29e5
Nov 04 01:11:02.205292 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:02.205272    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l4plc"]
Nov 04 01:11:02.214397 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:11:02.214364    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54daba34_bdc5_4e9a_8fc2_124c44311571.slice/crio-62fc6158c4f0847ad98811b7b4be68941347727ff028fcdc10fe22d79494eb08 WatchSource:0}: Error finding container 62fc6158c4f0847ad98811b7b4be68941347727ff028fcdc10fe22d79494eb08: Status 404 returned error can't find the container with id 62fc6158c4f0847ad98811b7b4be68941347727ff028fcdc10fe22d79494eb08
Nov 04 01:11:02.215127 ip-10-0-128-142 kubenswrapper[2578]: W1104 01:11:02.215105    2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d83d70_c53d_4e05_9ef0_54918d176ee0.slice/crio-583c516ce22045069a5c63121f3a7f2859f27a8be9b239582c0b9361a673a995 WatchSource:0}: Error finding container 583c516ce22045069a5c63121f3a7f2859f27a8be9b239582c0b9361a673a995: Status 404 returned error can't find the container with id 583c516ce22045069a5c63121f3a7f2859f27a8be9b239582c0b9361a673a995
Nov 04 01:11:02.217897 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:02.217876    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c5jls"]
Nov 04 01:11:02.218788 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:02.218768    2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-plbjs"]
Nov 04 01:11:02.765225 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:02.765200    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rf4vp_ec448ba9-2485-4143-9b71-d5e3b51d507c/dns/0.log"
Nov 04 01:11:02.823262 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:02.823237    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-plbjs" event={"ID":"54daba34-bdc5-4e9a-8fc2-124c44311571","Type":"ContainerStarted","Data":"62fc6158c4f0847ad98811b7b4be68941347727ff028fcdc10fe22d79494eb08"}
Nov 04 01:11:02.824346 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:02.824324    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c5jls" event={"ID":"41d83d70-c53d-4e05-9ef0-54918d176ee0","Type":"ContainerStarted","Data":"583c516ce22045069a5c63121f3a7f2859f27a8be9b239582c0b9361a673a995"}
Nov 04 01:11:02.825418 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:02.825394    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l4plc" event={"ID":"af124602-383f-4c7a-8325-6cbaf0d80d1e","Type":"ContainerStarted","Data":"e88ec241c5e6af119a4489d76f4ac2e294c5180a74211b4979ec659e726d29e5"}
Nov 04 01:11:02.826629 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:02.826604    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerStarted","Data":"8639c952e7d30ce0524ef7dc08ef7bc081bee7e3ab40736197e77b6b650bed78"}
Nov 04 01:11:02.960375 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:02.960347    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rf4vp_ec448ba9-2485-4143-9b71-d5e3b51d507c/kube-rbac-proxy/0.log"
Nov 04 01:11:03.757765 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:03.757448    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xdspt_335e91c5-3f5e-49e7-ab4c-67ffb1e5d694/dns-node-resolver/0.log"
Nov 04 01:11:03.834064 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:03.834022    2578 generic.go:356] "Generic (PLEG): container finished" podID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerID="3ec5dd32d8120a12658c5e06cff824a780d9cd7957a306589bce2f52b83df21a" exitCode=0
Nov 04 01:11:03.834552 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:03.834188    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerDied","Data":"3ec5dd32d8120a12658c5e06cff824a780d9cd7957a306589bce2f52b83df21a"}
Nov 04 01:11:03.837149 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:03.837116    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28" event={"ID":"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e","Type":"ContainerStarted","Data":"177a709ae9481127acb285638ef6867053604f92e9f277824f3dc24ba2e4959e"}
Nov 04 01:11:03.837238 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:03.837168    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28" event={"ID":"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e","Type":"ContainerStarted","Data":"1b56952f2ffae349e41932482d76c62cee86be2ab3f488d0bb4d77b5a88271be"}
Nov 04 01:11:04.005991 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:04.005956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:04.101637 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:04.101511    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28" podStartSLOduration=2.980112464 podStartE2EDuration="7.101493845s" totalImagesPullingTime="4.121381381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:10:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:04.10101935 +0000 UTC m=+68.133539762" watchObservedRunningTime="2026-11-04 01:11:04.101493845 +0000 UTC m=+68.134014256"
Nov 04 01:11:04.155089 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:04.155000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:04.305904 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:04.305835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:04.557461 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:04.557435    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mgql9_d1a3f906-3026-4220-af30-3a682acafbbb/node-ca/0.log"
Nov 04 01:11:05.032269 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:05.032232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:05.177923 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:05.177763    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:05.557890 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:05.557851    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9s98m_9ab62697-06cf-4b69-abb4-cefd227bbd8a/serve-healthcheck-canary/0.log"
Nov 04 01:11:05.768501 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:05.768462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:05.849680 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:05.849598    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-plbjs" event={"ID":"54daba34-bdc5-4e9a-8fc2-124c44311571","Type":"ContainerStarted","Data":"0a96e55f2df09f07cd34af3f307f5ee167ba5a1db7748dd45aa040b7df6f2e01"}
Nov 04 01:11:05.849680 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:05.849657    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-plbjs" event={"ID":"54daba34-bdc5-4e9a-8fc2-124c44311571","Type":"ContainerStarted","Data":"e52b6809fa0a475f4fcaa9ab49d424b61f39c8bd2acb1d7124ec9e00b74d705b"}
Nov 04 01:11:05.912590 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:05.912550    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:05.974164 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:05.974090    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-plbjs" podStartSLOduration=67.330639996 podStartE2EDuration="1m9.97406706s" totalImagesPullingTime="2.643427064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:05.972342266 +0000 UTC m=+70.004862678" watchObservedRunningTime="2026-11-04 01:11:05.97406706 +0000 UTC m=+70.006587473"
Nov 04 01:11:06.830646 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:06.829528    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:07.418245 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:07.418135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:07.624811 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:07.624739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:07.859447 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:07.859409    2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l4plc" event={"ID":"af124602-383f-4c7a-8325-6cbaf0d80d1e","Type":"ContainerStarted","Data":"f52869a837d882f229d4c1bc56b8f60cf26080f61a1b391a6a2817aa2863d9f7"}
Nov 04 01:11:07.859892 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:07.859497    2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:11:07.981783 ip-10-0-128-142 kubenswrapper[2578]: I1104 01:11:07.981731    2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l4plc" podStartSLOduration=66.676066064 podStartE2EDuration="1m11.981714813s" totalImagesPullingTime="5.305648749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:11:07.981218964 +0000 UTC m=+72.013739379" watchObservedRunningTime="2026-11-04 01:11:07.981714813 +0000 UTC m=+72.014235224"
Nov 04 01:11:08.775304 ip-10-0-128-142 systemd[1]: Stopping Kubernetes Kubelet...
Nov 04 01:11:08.798612 ip-10-0-128-142 systemd[1]: kubelet.service: Deactivated successfully.
Nov 04 01:11:08.798787 ip-10-0-128-142 systemd[1]: Stopped Kubernetes Kubelet.
Nov 04 01:11:08.798830 ip-10-0-128-142 systemd[1]: kubelet.service: Consumed 4.148s CPU time.
Nov 04 01:11:08.802067 ip-10-0-128-142 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 01:11:08.884105 ip-10-0-128-142 kubenswrapper[5572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:11:08.884105 ip-10-0-128-142 kubenswrapper[5572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 01:11:08.884105 ip-10-0-128-142 kubenswrapper[5572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:11:08.884105 ip-10-0-128-142 kubenswrapper[5572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 01:11:08.887684 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887516    5572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:08.887684 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887684    5572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:08.887684 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887692    5572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887697    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887704    5572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887709    5572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887720    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887725    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887730    5572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887734    5572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887739    5572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887743    5572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887748    5572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887752    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887757    5572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887761    5572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887765    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887770    5572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887774    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887783    5572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887789    5572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887794    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:08.888022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887798    5572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887803    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887807    5572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887811    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887816    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887821    5572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887825    5572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887829    5572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887834    5572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887839    5572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887849    5572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887854    5572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887859    5572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887863    5572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887867    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887871    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887876    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887880    5572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887884    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:08.888725 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887888    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887893    5572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887897    5572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887906    5572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887910    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887915    5572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887919    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.887923    5572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888084    5572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888094    5572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888098    5572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888101    5572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888104    5572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888107    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888110    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888113    5572 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888115    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888118    5572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888121    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888125    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:08.889220 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888128    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888131    5572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888134    5572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888137    5572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888139    5572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888142    5572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888145    5572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888148    5572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888152    5572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888155    5572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888160    5572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888163    5572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888166    5572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888168    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888171    5572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888174    5572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888177    5572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888180    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888183    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888188    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:08.889772 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888191    5572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888193    5572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888198    5572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888203    5572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888207    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888215    5572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888220    5572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888224    5572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888229    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888232    5572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888234    5572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888237    5572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888240    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888243    5572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888247    5572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888256    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888261    5572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888263    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888266    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:08.890274 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888269    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888272    5572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888274    5572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888277    5572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888280    5572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.888282    5572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889420    5572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889430    5572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889434    5572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889438    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889442    5572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889445    5572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889448    5572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889451    5572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889454    5572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889456    5572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889460    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889463    5572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889466    5572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889469    5572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:08.890783 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889472    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889474    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889477    5572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889480    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889482    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889485    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889487    5572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889490    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889492    5572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889495    5572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889499    5572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889504    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889507    5572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889509    5572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889512    5572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889515    5572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889518    5572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889521    5572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889524    5572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:08.891298 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889526    5572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889545    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889551    5572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889555    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889558    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889561    5572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889563    5572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889566    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889569    5572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889572    5572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889575    5572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889578    5572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889581    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889584    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889586    5572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889589    5572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889591    5572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889594    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889597    5572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:08.892235 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889600    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889603    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889606    5572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889608    5572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889611    5572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889615    5572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889617    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889620    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889622    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889625    5572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889628    5572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889632    5572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889635    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889638    5572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889640    5572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889643    5572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889646    5572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889648    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889651    5572 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889654    5572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:08.893640 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889656    5572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889659    5572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889661    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889664    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889667    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889670    5572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889673    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889677    5572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889681    5572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889684    5572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889687    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889690    5572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889693    5572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889695    5572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889698    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889702    5572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889707    5572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889711    5572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889715    5572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889721    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:08.894254 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889725    5572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889728    5572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889731    5572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889733    5572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889736    5572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889739    5572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889741    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889744    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889747    5572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889749    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889752    5572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889757    5572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889760    5572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.889762    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890318    5572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890326    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890331    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890334    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890337    5572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:08.894752 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890340    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890343    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890346    5572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890348    5572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890351    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890354    5572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890356    5572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890359    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890362    5572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890364    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890367    5572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890370    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890373    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890375    5572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890378    5572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890381    5572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890384    5572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890387    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890389    5572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890392    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:08.895271 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890395    5572 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890397    5572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890400    5572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890403    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890408    5572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890410    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890413    5572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890415    5572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890418    5572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890421    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890424    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890426    5572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890429    5572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890432    5572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890434    5572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890437    5572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890440    5572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890442    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890445    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:08.895939 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890447    5572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890450    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890452    5572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890455    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890458    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890461    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890463    5572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890466    5572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890469    5572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890471    5572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890474    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890476    5572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890480    5572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890485    5572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890490    5572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890493    5572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890495    5572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890499    5572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890502    5572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:08.896432 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890505    5572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890508    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890510    5572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890513    5572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890516    5572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890519    5572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890522    5572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890526    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890528    5572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890601    5572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890604    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890607    5572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890610    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890613    5572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890615    5572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890619    5572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890622    5572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890624    5572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890627    5572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890630    5572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:08.896926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890633    5572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890635    5572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890638    5572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890641    5572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890644    5572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890647    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890650    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890652    5572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890655    5572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890658    5572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890662    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890665    5572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890669    5572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890673    5572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890676    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890679    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890682    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890686    5572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890690    5572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890693    5572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:08.897391 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890696    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890698    5572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.890701    5572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890802    5572 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890824    5572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890833    5572 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890840    5572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890847    5572 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890852    5572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890858    5572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890865    5572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890870    5572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890875    5572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890880    5572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890886    5572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890891    5572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890896    5572 flags.go:64] FLAG: --cgroup-root=""
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890900    5572 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890905    5572 flags.go:64] FLAG: --client-ca-file=""
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890910    5572 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890914    5572 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890922    5572 flags.go:64] FLAG: --cluster-domain=""
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890928    5572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 01:11:08.897906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890933    5572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890942    5572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890947    5572 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890959    5572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890963    5572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890968    5572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890973    5572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890978    5572 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890983    5572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890987    5572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.890995    5572 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891000    5572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891006    5572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891011    5572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891016    5572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891020    5572 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891025    5572 flags.go:64] FLAG: --enable-server="true"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891030    5572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891036    5572 flags.go:64] FLAG: --event-burst="100"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891041    5572 flags.go:64] FLAG: --event-qps="50"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891045    5572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891050    5572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891055    5572 flags.go:64] FLAG: --eviction-hard=""
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891061    5572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 01:11:08.898464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891066    5572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891071    5572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891075    5572 flags.go:64] FLAG: --eviction-soft=""
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891080    5572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891084    5572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891089    5572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891093    5572 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891098    5572 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891102    5572 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891107    5572 flags.go:64] FLAG: --feature-gates=""
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891113    5572 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891118    5572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891123    5572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891128    5572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891133    5572 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891137    5572 flags.go:64] FLAG: --help="false"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891142    5572 flags.go:64] FLAG: --hostname-override="ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891148    5572 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891154    5572 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891159    5572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891165    5572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891171    5572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891176    5572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 01:11:08.899208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891180    5572 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891185    5572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891190    5572 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891194    5572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891199    5572 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891204    5572 flags.go:64] FLAG: --kube-reserved=""
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891209    5572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891213    5572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891219    5572 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891223    5572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891228    5572 flags.go:64] FLAG: --lock-file=""
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891232    5572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891237    5572 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891242    5572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891251    5572 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891256    5572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891261    5572 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891265    5572 flags.go:64] FLAG: --logging-format="text"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891270    5572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891275    5572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891280    5572 flags.go:64] FLAG: --manifest-url=""
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891284    5572 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891291    5572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891296    5572 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891302    5572 flags.go:64] FLAG: --max-pods="110"
Nov 04 01:11:08.899967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891307    5572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891312    5572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891318    5572 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891324    5572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891329    5572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891334    5572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891339    5572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891350    5572 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891355    5572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891359    5572 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891364    5572 flags.go:64] FLAG: --pod-cidr=""
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891369    5572 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891382    5572 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891387    5572 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891392    5572 flags.go:64] FLAG: --port="10250"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891397    5572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891401    5572 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-02d69b6a52ac63d65"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891407    5572 flags.go:64] FLAG: --qos-reserved=""
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891411    5572 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891417    5572 flags.go:64] FLAG: --register-node="true"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891421    5572 flags.go:64] FLAG: --register-with-taints=""
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891428    5572 flags.go:64] FLAG: --registry-burst="10"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891433    5572 flags.go:64] FLAG: --registry-qps="5"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891437    5572 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891442    5572 flags.go:64] FLAG: --reserved-memory=""
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891448    5572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 01:11:08.900582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891453    5572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891458    5572 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891462    5572 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891467    5572 flags.go:64] FLAG: --runonce="false"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891471    5572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891477    5572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891481    5572 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891496    5572 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891501    5572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891507    5572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891512    5572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891517    5572 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891522    5572 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891527    5572 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891545    5572 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891550    5572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891560    5572 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891564    5572 flags.go:64] FLAG: --system-cgroups=""
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891569    5572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891578    5572 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891583    5572 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891588    5572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891597    5572 flags.go:64] FLAG: --tls-min-version=""
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891601    5572 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891606    5572 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 01:11:08.901188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891611    5572 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891616    5572 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891621    5572 flags.go:64] FLAG: --v="2"
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891628    5572 flags.go:64] FLAG: --version="false"
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891634    5572 flags.go:64] FLAG: --vmodule=""
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891638    5572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.891642    5572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891780    5572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891784    5572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891787    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891790    5572 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891793    5572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891796    5572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891798    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891803    5572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891806    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891809    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891812    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891815    5572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891818    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891820    5572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:08.901804 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891823    5572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891826    5572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891830    5572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891834    5572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891838    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891841    5572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891843    5572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891846    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891849    5572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891852    5572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891854    5572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891857    5572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891859    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891863    5572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891866    5572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891869    5572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891871    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891874    5572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891876    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:08.902428 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891880    5572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891882    5572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891885    5572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891887    5572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891890    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891893    5572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891897    5572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891901    5572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891905    5572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891909    5572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891915    5572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891920    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891924    5572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891935    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891940    5572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891944    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891948    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891953    5572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891957    5572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891961    5572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:08.903022 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891966    5572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891971    5572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891976    5572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891980    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891984    5572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.891989    5572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892000    5572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892005    5572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892010    5572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892014    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892018    5572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892022    5572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892027    5572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892031    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892036    5572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892040    5572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892044    5572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892048    5572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892059    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:08.903855 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892063    5572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892067    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892071    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892076    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892081    5572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892085    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892089    5572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892093    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892099    5572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892105    5572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892110    5572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892114    5572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892119    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892123    5572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892127    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892132    5572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892136    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892140    5572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892144    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:08.904619 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892150    5572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892154    5572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892158    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892163    5572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892167    5572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892171    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892180    5572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892185    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892189    5572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892193    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892198    5572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892202    5572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892207    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892212    5572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892216    5572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.892257    5572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:11:08.905337 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892322    5572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892328    5572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892334    5572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892338    5572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892343    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892347    5572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892351    5572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892355    5572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892360    5572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892364    5572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892369    5572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892373    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892377    5572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892382    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892386    5572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892390    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892397    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892401    5572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892405    5572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892410    5572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:08.905776 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892415    5572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892419    5572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892424    5572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892428    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892433    5572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892438    5572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892442    5572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892447    5572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892451    5572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892459    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892463    5572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892468    5572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892472    5572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892476    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892481    5572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892486    5572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892490    5572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892494    5572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892500    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:08.906357 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892504    5572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892508    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892513    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892518    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892522    5572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892526    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892546    5572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892551    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892556    5572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892564    5572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892570    5572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892574    5572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892578    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892582    5572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892586    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892590    5572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892594    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892598    5572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892603    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:08.907008 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892607    5572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892612    5572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892616    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892622    5572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892627    5572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892631    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892635    5572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892639    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892644    5572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892648    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892653    5572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892665    5572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892671    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892675    5572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892679    5572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892684    5572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892688    5572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892692    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892696    5572 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892701    5572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:08.907750 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892705    5572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892709    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892715    5572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892720    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892724    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892735    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892740    5572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892745    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892749    5572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892754    5572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892758    5572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892767    5572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892773    5572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892777    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892780    5572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892790    5572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892793    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892796    5572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892799    5572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:08.908242 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892802    5572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892804    5572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892807    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892810    5572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892814    5572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892818    5572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892822    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892826    5572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.892831    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.897173    5572 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.897189    5572 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.897207    5572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.897211    5572 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897286    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897291    5572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897295    5572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897298    5572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897301    5572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897304    5572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:08.908716 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897307    5572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897310    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897312    5572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897315    5572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897331    5572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897335    5572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897337    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897341    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897343    5572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897346    5572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897349    5572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897352    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897355    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897357    5572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897360    5572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897363    5572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897366    5572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897370    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897374    5572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897377    5572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:08.909170 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897380    5572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897383    5572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897386    5572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897389    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897392    5572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897395    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897399    5572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897402    5572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897404    5572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897407    5572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897410    5572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897413    5572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897415    5572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897418    5572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897421    5572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897425    5572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897429    5572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897432    5572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897435    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:08.909690 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897438    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897441    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897444    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897447    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897449    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897452    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897455    5572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897458    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897460    5572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897463    5572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897466    5572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897470    5572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897473    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897476    5572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897479    5572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897481    5572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897484    5572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897487    5572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897490    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897493    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:08.910265 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897495    5572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897498    5572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897500    5572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897503    5572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897506    5572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897508    5572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897511    5572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897513    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897516    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897519    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897522    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897525    5572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897528    5572 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897570    5572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897574    5572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897578    5572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897581    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897585    5572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897588    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:08.910898 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897591    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897594    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897596    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897599    5572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897602    5572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897606    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897609    5572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897612    5572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897615    5572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897618    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897620    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897623    5572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897626    5572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897628    5572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897631    5572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897634    5572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897636    5572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897639    5572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897641    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:08.911508 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897644    5572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897647    5572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897650    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.897680    5572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897833    5572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897837    5572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897841    5572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897844    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897846    5572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897849    5572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897852    5572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897855    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897858    5572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897876    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897880    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897882    5572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:08.912369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897886    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897890    5572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897892    5572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897901    5572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897904    5572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897908    5572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897913    5572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897917    5572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897920    5572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897923    5572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897928    5572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897932    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897937    5572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897941    5572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897945    5572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897949    5572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897953    5572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897958    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897962    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:08.912934 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897966    5572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897970    5572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897975    5572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897979    5572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897983    5572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897987    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897992    5572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.897996    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898000    5572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898005    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898009    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898012    5572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898015    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898018    5572 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898021    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898024    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898027    5572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898031    5572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898034    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:08.913600 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898036    5572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898039    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898042    5572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898044    5572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898047    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898050    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898053    5572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898056    5572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898058    5572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898061    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898064    5572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898067    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898069    5572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898072    5572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898075    5572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898077    5572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898080    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898083    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898086    5572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898088    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:08.914230 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898091    5572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898100    5572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898103    5572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898106    5572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898108    5572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898111    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898115    5572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898119    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898130    5572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898134    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898137    5572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898141    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898145    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898148    5572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898150    5572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898153    5572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898156    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898160    5572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898165    5572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:08.914801 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898169    5572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898173    5572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898177    5572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898181    5572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898185    5572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898189    5572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898193    5572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898197    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898201    5572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898205    5572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898209    5572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898213    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898217    5572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898221    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898225    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898230    5572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:08.915319 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898234    5572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.898275    5572 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898312    5572 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898317    5572 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898320    5572 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898323    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898326    5572 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898329    5572 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898332    5572 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898335    5572 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898337    5572 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898340    5572 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898343    5572 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898346    5572 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898348    5572 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898351    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 01:11:08.915832 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898353    5572 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898356    5572 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898359    5572 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898361    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898364    5572 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898366    5572 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898369    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898372    5572 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898375    5572 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898377    5572 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898380    5572 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898383    5572 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898385    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898388    5572 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898390    5572 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898393    5572 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898396    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898398    5572 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898401    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898403    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 01:11:08.916369 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898409    5572 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898412    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898415    5572 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898418    5572 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898420    5572 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898423    5572 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898434    5572 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898438    5572 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898440    5572 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898443    5572 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898446    5572 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898448    5572 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898451    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898454    5572 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898457    5572 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898459    5572 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898462    5572 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898465    5572 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898468    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 01:11:08.917096 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898471    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898474    5572 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898476    5572 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898479    5572 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898482    5572 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898484    5572 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898487    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898490    5572 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898492    5572 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898495    5572 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898497    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898500    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898503    5572 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898507    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898510    5572 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898514    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898516    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898519    5572 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898522    5572 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 01:11:08.917604 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898524    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898528    5572 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898570    5572 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898574    5572 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898576    5572 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898579    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898582    5572 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898585    5572 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898587    5572 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898590    5572 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898592    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898595    5572 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898598    5572 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898600    5572 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898603    5572 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898620    5572 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898624    5572 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898626    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898629    5572 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898632    5572 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 01:11:08.918250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898635    5572 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898638    5572 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898640    5572 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898643    5572 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898646    5572 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898649    5572 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898652    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898657    5572 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898661    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898665    5572 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898668    5572 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898671    5572 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898674    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:11:08.898679    5572 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.898749    5572 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.899924    5572 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.899995    5572 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.900198    5572 server.go:1014] "Starting client certificate rotation"
Nov 04 01:11:08.919295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.900334    5572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 01:11:08.920083 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.900397    5572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 01:04:56 +0000 UTC" deadline="2028-07-15 09:03:51.859617158 +0000 UTC"
Nov 04 01:11:08.920083 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.900431    5572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14863h52m42.959187634s"
Nov 04 01:11:08.920083 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.900689    5572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 01:11:08.920083 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.901831    5572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 01:11:08.920083 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.904375    5572 log.go:25] "Validated CRI v1 runtime API"
Nov 04 01:11:08.920083 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.906503    5572 log.go:25] "Validated CRI v1 image API"
Nov 04 01:11:08.920083 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.907278    5572 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 01:11:08.920083 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.909664    5572 fs.go:135] Filesystem UUIDs: map[6d99199f-72bf-4970-95cf-efcd7de33405:/dev/nvme0n1p3 70c35d1c-5a72-46f9-bf34-52cf8f3ed938:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Nov 04 01:11:08.920474 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.909682    5572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0bdc4f355aa5fcbd369073261e0da56da559ea2bbd1c5ff337d26575f3ff2cf3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0bdc4f355aa5fcbd369073261e0da56da559ea2bbd1c5ff337d26575f3ff2cf3/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/41bd9a978a285cf1be7e937ed0189d62fb2835f4cdb43dd30f22565d4030d698/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/41bd9a978a285cf1be7e937ed0189d62fb2835f4cdb43dd30f22565d4030d698/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/44029ff2416ffa01b9059a6d1e06d099880ae16d7c95ede95c922fdf85cf6a73/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/44029ff2416ffa01b9059a6d1e06d099880ae16d7c95ede95c922fdf85cf6a73/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/44653bfe4ca11623d22a199932c081b4fe66f5ef93fc71cf830a64e2b98c9f66/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/44653bfe4ca11623d22a199932c081b4fe66f5ef93fc71cf830a64e2b98c9f66/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/453d1ba76601b8f541b4c842044a41426909e0d924525bb0ff5f77f0ee0ce9ca/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/453d1ba76601b8f541b4c842044a41426909e0d924525bb0ff5f77f0ee0ce9ca/userdata/shm major:0 minor:307 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4b5fa321f168972fc58af06bd573cd8c3fd7fa84747b39f996a04c65772cdbb2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4b5fa321f168972fc58af06bd573cd8c3fd7fa84747b39f996a04c65772cdbb2/userdata/shm major:0 minor:298 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4d06af4651ea5b1352ac0b731357a379d657ebbf04b08a8b71f013a4b794047f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4d06af4651ea5b1352ac0b731357a379d657ebbf04b08a8b71f013a4b794047f/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/583c516ce22045069a5c63121f3a7f2859f27a8be9b239582c0b9361a673a995/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/583c516ce22045069a5c63121f3a7f2859f27a8be9b239582c0b9361a673a995/userdata/shm major:0 minor:373 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/62fc6158c4f0847ad98811b7b4be68941347727ff028fcdc10fe22d79494eb08/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/62fc6158c4f0847ad98811b7b4be68941347727ff028fcdc10fe22d79494eb08/userdata/shm major:0 minor:375 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/70aef28f3b64ab1915a533c794a25b6208da186648d540f57aeecc8ddd722221/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/70aef28f3b64ab1915a533c794a25b6208da186648d540f57aeecc8ddd722221/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/744928099cc137c52314c67fe79047467f07f9aa8511de031b501507def58f3a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/744928099cc137c52314c67fe79047467f07f9aa8511de031b501507def58f3a/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/74587aef909146b9b97b84698c14558c5fc9cff5660691c7890d9cfbf53ba851/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/74587aef909146b9b97b84698c14558c5fc9cff5660691c7890d9cfbf53ba851/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/770bc9a3fdf9188627e10d49293d93d4f611f1d6e26e1710403cf59d28054eff/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/770bc9a3fdf9188627e10d49293d93d4f611f1d6e26e1710403cf59d28054eff/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7941b992c631e2fab8f0f106013c6bb2ba197fd7146dd51d38e631ba0de992b8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7941b992c631e2fab8f0f106013c6bb2ba197fd7146dd51d38e631ba0de992b8/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7e5a5b6a7dc21ee11cb6f014bcdff00576cb2801dfafaba2a1cf4993b47cf0ba/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7e5a5b6a7dc21ee11cb6f014bcdff00576cb2801dfafaba2a1cf4993b47cf0ba/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8639c952e7d30ce0524ef7dc08ef7bc081bee7e3ab40736197e77b6b650bed78/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8639c952e7d30ce0524ef7dc08ef7bc081bee7e3ab40736197e77b6b650bed78/userdata/shm major:0 minor:369 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/91ba5763b2b98c87a4b8498521a5c1824a96b80d421c2c59126705106b66dae0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/91ba5763b2b98c87a4b8498521a5c1824a96b80d421c2c59126705106b66dae0/userdata/shm major:0 minor:292 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a26c6046116976075e2e1e39e4c42756012443570c8c0471ac99c3bb50e34d9a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a26c6046116976075e2e1e39e4c42756012443570c8c0471ac99c3bb50e34d9a/userdata/shm major:0 minor:271 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ac461c8ef39aef232c8d2a4f40ec47c4387371227940ae1af1fe1958e6b2c68c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ac461c8ef39aef232c8d2a4f40ec47c4387371227940ae1af1fe1958e6b2c68c/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c49fd70540af06678e24ff1496e4425dbf1eab4c451ece2944386396db8eea77/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c49fd70540af06678e24ff1496e4425dbf1eab4c451ece2944386396db8eea77/userdata/shm major:0 minor:62 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d521785aa434b98c89ae0fcf259439d7bab01a128e9166da44eb06c9a8dba061/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d521785aa434b98c89ae0fcf259439d7bab01a128e9166da44eb06c9a8dba061/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e88ec241c5e6af119a4489d76f4ac2e294c5180a74211b4979ec659e726d29e5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e88ec241c5e6af119a4489d76f4ac2e294c5180a74211b4979ec659e726d29e5/userdata/shm major:0 minor:371 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/01a7a8be-5a1a-4d39-9988-8163e34d69e5/volumes/kubernetes.io~projected/kube-api-access-xxwfl:{mountpoint:/var/lib/kubelet/pods/01a7a8be-5a1a-4d39-9988-8163e34d69e5/volumes/kubernetes.io~projected/kube-api-access-xxwfl major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1b6b228e-6fd5-455f-91c3-498ac0b29d01/volumes/kubernetes.io~projected/kube-api-access-sk9v8:{mountpoint:/var/lib/kubelet/pods/1b6b228e-6fd5-455f-91c3-498ac0b29d01/volumes/kubernetes.io~projected/kube-api-access-sk9v8 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1b6b228e-6fd5-455f-91c3-498ac0b29d01/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/1b6b228e-6fd5-455f-91c3-498ac0b29d01/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac/volumes/kubernetes.io~empty-dir/tmp major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac/volumes/kubernetes.io~projected/kube-api-access-wk4q9:{mountpoint:/var/lib/kubelet/pods/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac/volumes/kubernetes.io~projected/kube-api-access-wk4q9 major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694/volumes/kubernetes.io~projected/kube-api-access-hsmjz:{mountpoint:/var/lib/kubelet/pods/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694/volumes/kubernetes.io~projected/kube-api-access-hsmjz major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~projected/kube-api-access-9pkjb:{mountpoint:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~projected/kube-api-access-9pkjb major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36657689-6fdf-4f18-b466-52ab25506722/volumes/kubernetes.io~projected/kube-api-access-ktr2t:{mountpoint:/var/lib/kubelet/pods/36657689-6fdf-4f18-b466-52ab25506722/volumes/kubernetes.io~projected/kube-api-access-ktr2t major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3d8801a3-3cc4-4311-9876-152f71cc5687/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/3d8801a3-3cc4-4311-9876-152f71cc5687/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3d8801a3-3cc4-4311-9876-152f71cc5687/volumes/kubernetes.io~projected/kube-api-access-vds7d:{mountpoint:/var/lib/kubelet/pods/3d8801a3-3cc4-4311-9876-152f71cc5687/volumes/kubernetes.io~projected/kube-api-access-vds7d major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3d8801a3-3cc4-4311-9876-152f71cc5687/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/3d8801a3-3cc4-4311-9876-152f71cc5687/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/41d83d70-c53d-4e05-9ef0-54918d176ee0/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/41d83d70-c53d-4e05-9ef0-54918d176ee0/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:365 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/45b64324-82f2-4075-80e1-50255e083d70/volumes/kubernetes.io~projected/kube-api-access-mrrf5:{mountpoint:/var/lib/kubelet/pods/45b64324-82f2-4075-80e1-50255e083d70/volumes/kubernetes.io~projected/kube-api-access-mrrf5 major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/45b64324-82f2-4075-80e1-50255e083d70/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/45b64324-82f2-4075-80e1-50255e083d70/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/54daba34-bdc5-4e9a-8fc2-124c44311571/volumes/kubernetes.io~projected/kube-api-access-zqz8n:{mountpoint:/var/lib/kubelet/pods/54daba34-bdc5-4e9a-8fc2-124c44311571/volumes/kubernetes.io~projected/kube-api-access-zqz8n major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/54daba34-bdc5-4e9a-8fc2-124c44311571/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/54daba34-bdc5-4e9a-8fc2-124c44311571/volumes/kubernetes.io~secret/metrics-certs major:0 minor:366 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1/volumes/kubernetes.io~projected/kube-api-access-fglqf:{mountpoint:/var/lib/kubelet/pods/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1/volumes/kubernetes.io~projected/kube-api-access-fglqf major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volume-subpaths/web-config/config-reloader/2 major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volume-subpaths/web-config/prometheus/15 major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~empty-dir/config-out major:0 minor:360 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~projected/kube-api-access-z9rlx:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~projected/kube-api-access-z9rlx major:0 minor:367 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~projected/tls-assets major:0 minor:357 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/config major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:355 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:350 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:362 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:359 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:364 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/web-config major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9ab62697-06cf-4b69-abb4-cefd227bbd8a/volumes/kubernetes.io~projected/kube-api-access-jt9g6:{mountpoint:/var/lib/kubelet/pods/9ab62697-06cf-4b69-abb4-cefd227bbd8a/volumes/kubernetes.io~projected/kube-api-access-jt9g6 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9ab62697-06cf-4b69-abb4-cefd227bbd8a/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/9ab62697-06cf-4b69-abb4-cefd227bbd8a/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1b6756a-77d7-4a73-9900-9a739b6c3a21/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/a1b6756a-77d7-4a73-9900-9a739b6c3a21/volumes/kubernetes.io~secret/agent-certs major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~projected/kube-api-access-d4qg7:{mountpoint:/var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~projected/kube-api-access-d4qg7 major:0 minor:306 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:305 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:303 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aea8797d-c027-4b30-8e75-e65ed05158af/volumes/kubernetes.io~projected/kube-api-access-9jp9j:{mountpoint:/var/lib/kubelet/pods/aea8797d-c027-4b30-8e75-e65ed05158af/volumes/kubernetes.io~projected/kube-api-access-9jp9j major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/af124602-383f-4c7a-8325-6cbaf0d80d1e/volumes/kubernetes.io~projected/kube-api-access-h6j5x:{mountpoint:/var/lib/kubelet/pods/af124602-383f-4c7a-8325-6cbaf0d80d1e/volumes/kubernetes.io~projected/kube-api-access-h6j5x major:0 minor:368 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3/volumes/kubernetes.io~projected/kube-api-access-q76ww:{mountpoint:/var/lib/kubelet/pods/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3/volumes/kubernetes.io~projected/kube-api-access-q76ww major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:240 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cceb3236-3f5d-4711-86f2-6d13d8e2b92b/volumes/kubernetes.io~projected/kube-api-access-95zdd:{mountpoint:/var/lib/kubelet/pods/cceb3236-3f5d-4711-86f2-6d13d8e2b92b/volumes/kubernetes.io~projected/kube-api-access-95zdd major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cceb3236-3f5d-4711-86f2-6d13d8e2b92b/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/cceb3236-3f5d-4711-86f2-6d13d8e2b92b/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cceb3236-3f5d-4711-86f2-6d13d8e2b92b/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/cceb3236-3f5d-4711-86f2-6d13d8e2b92b/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d1a3f906-3026-4220-af30-3a682acafbbb/volumes/kubernetes.io~projected/kube-api-access-ghdgw:{mountpoint:/var/lib/kubelet/pods/d1a3f906-3026-4220-af30-3a682acafbbb/volumes/kubernetes.io~projected/kube-api-access-ghdgw major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ec448ba9-2485-4143-9b71-d5e3b51d507c/volumes/kubernetes.io~projected/kube-api-access-v56qh:{mountpoint:/var/lib/kubelet/pods/ec448ba9-2485-4143-9b71-d5e3b51d507c/volumes/kubernetes.io~projected/kube-api-access-v56qh major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ec448ba9-2485-4143-9b71-d5e3b51d507c/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/ec448ba9-2485-4143-9b71-d5e3b51d507c/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/f17c41a9c71f2259b312ef11323e4b555c342effcffbd69e191a59fbf3b7e213/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/7484f28e23dd0362186b9127348824d39a93cf473da9a0226b15a731e517e10a/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/67f7a4389d530f97fa2973b4e7cc39c67368a3a18aa0f84da695690ad5f3d763/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/90ab199245f4ba965829dd9745bef3b6684030e35a8cb9823909daa020195c75/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-113:{mountpoint:/var/lib/containers/storage/overlay/0c07f24b6a9133fc4affea74564498fb24435831ba7f447898c3b675b1f65fd2/merged major:0 minor:113 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/8808efcb0f53859ea42ad1dc8b5702f6ea5c905ae0be1b8b8a9c01ddc6167a0d/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/e5d6f3642c4da341a80905e7b46c74cdc1c1894c16f4a5b1ff5dc6110a517c99/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/a1834b0f02d7121371061167fe43e4c445b380c64540e3980e19cc2844e1fdc6/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/ce31f49c6e528674c2d7571e9a19d14a690c319c0230d6e066a1dcc00a7bd463/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/53ba5e37730ad72febb6c07b363c79dff32e4cd7b410f2f6837c3b60166ce3ce/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/d0f4bef9cc9d718af3f0b066ae5f9aab4633ea58d3a5e8a92d2d45764b73f739/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/0a747bca6e685d81de1d6af1e69b7f4a1fbec029a71761741e0a98bef791c036/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/2c3091411934d1ddd1870d250281ebce4a4e412730239e19a8ab39a14fa43588/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/87fd51d3c4adef4841ff62c61a5065226ed808b9d3ee3de9fca02eb560a98078/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/acb1a6875688ef8bf3c78a1060d1e11a8bf0e366b42d9937b216e30a851e8c6e/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-164:{mountpoint:/var/lib/containers/storage/overlay/3cdc68e169c4dce8cee60bbd9173e5db002c285ab3f27cfb959b996440cf49d7/merged major:0 minor:164 fsType:overlay blockSize:0} overlay_0-168:{mountpoint:/var/lib/containers/storage/overlay/26b94be7cab5736d34381a5c016a45e873dbc977fb33a4537a9fdd485f2e625d/merged major:0 minor:168 fsType:overlay blockSize:0} overlay_0-170:{mountpoint:/var/lib/containers/storage/overlay/ef2e63708e2a56a3e175717ba3f760acc671692a2193b11ba45c0b60607930a6/merged major:0 minor:170 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/77f59a49c29b617ebbe7dd3ab76e757f16ad69284a0dde0fecadca94b7528697/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/6ede707398fc58fbfea619b3a462908ba6581b08d240145c0ccb18ee9edeac3b/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/bf4a985edc3a0643851b00a827911031200d40c672d0e71e826f53f0b450c601/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/1fa4dc5bd3fb5aee08f23f60a96ad310fbb8704232b3fa7e4346b93c9abd7b32/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/282d2492964471a662b2ee0dfdbc09e57ca608916b5280f3a21f0ae911f65b95/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/46e3dbf4de3acfebd0adc0c61d83c83cd9f4077cc8a8bd8b3bd823c119a322fa/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/361dd61d1254d9350560a23f2c9070ae9d6ba633c048ce3aba37830ac850fa26/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/72dd8816d82a6240cc9aef8082582bd4a2b7ab3d0262a1ecad6b8a72b7a1ff05/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/43787de22ad536ec2db833c8c193f09c5b71726364aa1b74e0155a3c9e3d9edc/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/1987dabd00725339f8c7e68e0dd2d9872b2e8c4a4d25c8559ffc771cc3bf286d/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-244:{mountpoint:/var/lib/containers/storage/overlay/d31cc8d6f338c711ffcc69399fcee17e7f94941ff1ec962adf86f9cd35e1a8cf/merged major:0 minor:244 fsType:overlay blockSize:0} overlay_0-246:{mountpoint:/var/lib/containers/storage/overlay/291ed696135fa50990b379e3ec40d8792df2953a0893cf3fb6f685447517ac6d/merged major:0 minor:246 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/eb73f71239e3d721cae5703e9b9fc0b11d4c76a9e21db24abd4850cca8117d92/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/2f6fdcdca8fa34136da2a87cdc88329eed1b2db4a180a213803f8fabee364d74/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/5d27ad32e9d3f10ad16eaf0bfb750a158e5cd76a721451e2da192bde46924358/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/1a85bd36a64ae1864ff0768fdb334adac630baf62d5c3604a744a84d64bc7660/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/30cf31547bbe789a8044ac83d41648dd52f388d59817834d53d4b777e5c2c5de/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/fd85d999ced2bee4ea48f43154b2b9a66dc5b9a4a1398263cade8efd2e92b510/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/e8a3e95095050b40882ee0c63e71f2466e6c552de62b697e5488757735142e23/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/449d8c043d536f2122548a8a58519f1fa6234ab01d8daf03e93e83d2647d3fe4/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-309:{mountpoint:/var/lib/containers/storage/overlay/25f177af757b0fda7f7c4e86f204c2549d3dfe3a61b082b56e459dee3f32adee/merged major:0 minor:309 fsType:overlay blockSize:0} overlay_0-311:{mountpoint:/var/lib/containers/storage/overlay/921457d960e5bf67b03874853472687b72fdbaf0e022bca5185140e5a760e247/merged major:0 minor:311 fsType:overlay blockSize:0} overlay_0-313:{mountpoint:/var/lib/containers/storage/overlay/46c11dba26797ab82ab930baf2e130eb9fa514b925af04d291956f0bdd2514d1/merged major:0 minor:313 fsType:overlay blockSize:0} overlay_0-319:{mountpoint:/var/lib/containers/storage/overlay/a40cce67df9d6e5b119a16300855577d13a3b6a5a1570d81e6c440f37ccc38e3/merged major:0 minor:319 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/c47478f5c4800b3147e29ff572383be8100dda63a35b2486ddca39e40f848f40/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/ba7611589055ffd21a717b5afbe97d94b105623c5f00cc1b418215dfd0b6dacd/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-335:{mountpoint:/var/lib/containers/storage/overlay/f3d95a6be05ad1679b5679c342524669124394bf9d5b0f9c59b75021c7401d09/merged major:0 minor:335 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/166c415d036aaf6e2657616c23660e58842500c45d58123a0bdf08a1c8771898/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-345:{mountpoint:/var/lib/containers/storage/overlay/b42631fdf36a249333f3ea25bb6d2a0c92b5b6d6bd713f7e2475beec07089b16/merged major:0 minor:345 fsType:overlay blockSize:0} overlay_0-377:{mountpoint:/var/lib/containers/storage/overlay/53e98c55edfa4ab81475e385fd5a6158138573c3e9f9beb751a3af05708a3c6e/merged major:0 minor:377 fsType:overlay blockSize:0} overlay_0-379:{mountpoint:/var/lib/containers/storage/overlay/00a9d758a9fee62e20f402c0fcaf8814c8481f405de74575327139b6afac8876/merged major:0 minor:379 fsType:overlay blockSize:0} overlay_0-381:{mountpoint:/var/lib/containers/storage/overlay/50bf329d7f8260b5b6ecbe60849613fbf79ddacba8e1cc7a1444cfc0f9a6f4f1/merged major:0 minor:381 fsType:overlay blockSize:0} overlay_0-383:{mountpoint:/var/lib/containers/storage/overlay/9a85a7c6fcacd0e87c0068a29fda43f9164119d54644c8d97461391d64660d88/merged major:0 minor:383 fsType:overlay blockSize:0} overlay_0-385:{mountpoint:/var/lib/containers/storage/overlay/2bd3fdd72ff139cc10638368662b5cac28e0de2f041873b9349b32febcadecaf/merged major:0 minor:385 fsType:overlay blockSize:0} overlay_0-387:{mountpoint:/var/lib/containers/storage/overlay/382fd2e249dfd23c795f02d04a894c86e455a52c71c832885bd3d5b592ff7616/merged major:0 minor:387 fsType:overlay blockSize:0} overlay_0-392:{mountpoint:/var/lib/containers/storage/overlay/8c655b0bbeadf777c6917b2d17d61677e91872ec73881181f852497b39a70248/merged major:0 minor:392 fsType:overlay blockSize:0} overlay_0-397:{mountpoint:/var/lib/containers/storage/overlay/c737a2bdd1cb165be0b90fe245a557f78fd61f78e9310be40280ac610744f1f6/merged major:0 minor:397 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/4c4d1350044003f48729ae1d4265822807350a7a1fd0fccfd95511629e46cf5d/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-408:{mountpoint:/var/lib/containers/storage/overlay/94f7332856764881b8d113b48a7840a045aa9a9d67e927c4f133e044be2c3b7e/merged major:0 minor:408 fsType:overlay blockSize:0} overlay_0-414:{mountpoint:/var/lib/containers/storage/overlay/c31e0a6f12021385d228ceb7fe8be91928ae1b864c91a0ab47c7c06f79e1cec4/merged major:0 minor:414 fsType:overlay blockSize:0} overlay_0-420:{mountpoint:/var/lib/containers/storage/overlay/4eefb76392b52182a44bee595632730bf74d13d736a61c2310bd66003aa0a479/merged major:0 minor:420 fsType:overlay blockSize:0} overlay_0-426:{mountpoint:/var/lib/containers/storage/overlay/a0ee20053ae2e340e41d4d2887e6ec130be04cb35cec804b0086b62e9869eb06/merged major:0 minor:426 fsType:overlay blockSize:0} overlay_0-431:{mountpoint:/var/lib/containers/storage/overlay/dc766e7656e74622088bad83a38f5670aeabc1d5ab51fcb8ea1f135391b326f3/merged major:0 minor:431 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/0ecb28faf988690ec0e17c9ffd6b03fb342da8f89e75d5d8947e74a7ce52dab2/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/74343ffd46dc06f5c88f55f19b857d735d79a73de1292d63fe4a47aba27ef96c/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/ff022339e08562e7516f558c36f154820123ea0652bdcc006bf8d2d4e8f50f16/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/61a537605ffb95a5b75af4dfa8d326af06258edadfab34d8cdfe6aec5da11e22/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/8fa89ff39026238f6bbe416ae392d550502c2bf278942cadc7c6892db4a837a4/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/be9de24311e1743bc7b0aa8bf3c312a80665e2e9bcae3906f76f78592da31b02/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/f5d8ff6a378058cd25502502808c7a93df1ee0182ccd72eccf4b75691bb75df5/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/0c8e728a393f1dc8d6a269cf600c86a9befc05f77cf79608ca2bc7b41c471d83/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/c0e48f9a0fcbc627d1100607aa4304ba120ff9be97e3e11bb7437d9d3ee0a4f0/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/1b0bff13285ea1ee62fa4914b36d749b63e3722f7fd4825eae9ec614d6e0b800/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.917641    5572 manager.go:217] Machine: {Timestamp:2026-11-04 01:11:08.917145436 +0000 UTC m=+0.067353194 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3119275 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24c277e9e65a91b5b2a297746c9454 SystemUUID:ec24c277-e9e6-5a91-b5b2-a297746c9454 BootID:bdb09196-6800-42a7-9431-3d569a5e3460 Filesystems:[{Device:/var/lib/kubelet/pods/36657689-6fdf-4f18-b466-52ab25506722/volumes/kubernetes.io~projected/kube-api-access-ktr2t DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/44653bfe4ca11623d22a199932c081b4fe66f5ef93fc71cf830a64e2b98c9f66/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:358 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-387 DeviceMajor:0 DeviceMinor:387 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/91ba5763b2b98c87a4b8498521a5c1824a96b80d421c2c59126705106b66dae0/userdata/shm DeviceMajor:0 DeviceMinor:292 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:361 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3d8801a3-3cc4-4311-9876-152f71cc5687/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:51 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/54daba34-bdc5-4e9a-8fc2-124c44311571/volumes/kubernetes.io~projected/kube-api-access-zqz8n DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ec448ba9-2485-4143-9b71-d5e3b51d507c/volumes/kubernetes.io~projected/kube-api-access-v56qh DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1/volumes/kubernetes.io~projected/kube-api-access-fglqf DeviceMajor:0 DeviceMinor:49 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4b5fa321f168972fc58af06bd573cd8c3fd7fa84747b39f996a04c65772cdbb2/userdata/shm DeviceMajor:0 DeviceMinor:298 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:355 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:364 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8639c952e7d30ce0524ef7dc08ef7bc081bee7e3ab40736197e77b6b650bed78/userdata/shm DeviceMajor:0 DeviceMinor:369 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/74587aef909146b9b97b84698c14558c5fc9cff5660691c7890d9cfbf53ba851/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~projected/kube-api-access-d4qg7 DeviceMajor:0 DeviceMinor:306 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:359 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-383 DeviceMajor:0 DeviceMinor:383 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-414 DeviceMajor:0 DeviceMinor:414 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:47 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-113 DeviceMajor:0 DeviceMinor:113 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:350 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:362 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a1b6756a-77d7-4a73-9900-9a739b6c3a21/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:52 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/770bc9a3fdf9188627e10d49293d93d4f611f1d6e26e1710403cf59d28054eff/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-381 DeviceMajor:0 DeviceMinor:381 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-335 DeviceMajor:0 DeviceMinor:335 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/70aef28f3b64ab1915a533c794a25b6208da186648d540f57aeecc8ddd722221/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:305 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-385 DeviceMajor:0 DeviceMinor:385 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/aea8797d-c027-4b30-8e75-e65ed05158af/volumes/kubernetes.io~projected/kube-api-access-9jp9j DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cceb3236-3f5d-4711-86f2-6d13d8e2b92b/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:269 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/583c516ce22045069a5c63121f3a7f2859f27a8be9b239582c0b9361a673a995/userdata/shm DeviceMajor:0 DeviceMinor:373 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-408 DeviceMajor:0 DeviceMinor:408 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c49fd70540af06678e24ff1496e4425dbf1eab4c451ece2944386396db8eea77/userdata/shm DeviceMajor:0 DeviceMinor:62 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3d8801a3-3cc4-4311-9876-152f71cc5687/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/41d83d70-c53d-4e05-9ef0-54918d176ee0/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:365 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~projected/kube-api-access-z9rlx DeviceMajor:0 DeviceMinor:367 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9ab62697-06cf-4b69-abb4-cefd227bbd8a/volumes/kubernetes.io~projected/kube-api-access-jt9g6 DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3d8801a3-3cc4-4311-9876-152f71cc5687/volumes/kubernetes.io~projected/kube-api-access-vds7d DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7e5a5b6a7dc21ee11cb6f014bcdff00576cb2801dfafaba2a1cf4993b47cf0ba/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d521785aa434b98c89ae0fcf259439d7bab01a128e9166da44eb06c9a8dba061/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:289 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/45b64324-82f2-4075-80e1-50255e083d70/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:296 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:304 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-319 DeviceMajor:0 DeviceMinor:319 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac/volumes/kubernetes.io~projected/kube-api-access-wk4q9 DeviceMajor:0 DeviceMinor:50 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-345 DeviceMajor:0 DeviceMinor:345 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:360 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-392 DeviceMajor:0 DeviceMinor:392 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:302 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/01a7a8be-5a1a-4d39-9988-8163e34d69e5/volumes/kubernetes.io~projected/kube-api-access-xxwfl DeviceMajor:0 DeviceMinor:53 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:236 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:286 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:363 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4d06af4651ea5b1352ac0b731357a379d657ebbf04b08a8b71f013a4b794047f/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1b6b228e-6fd5-455f-91c3-498ac0b29d01/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1b6b228e-6fd5-455f-91c3-498ac0b29d01/volumes/kubernetes.io~projected/kube-api-access-sk9v8 DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-311 DeviceMajor:0 DeviceMinor:311 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694/volumes/kubernetes.io~projected/kube-api-access-hsmjz DeviceMajor:0 DeviceMinor:54 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/54daba34-bdc5-4e9a-8fc2-124c44311571/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:366 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-420 DeviceMajor:0 DeviceMinor:420 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-164 DeviceMajor:0 DeviceMinor:164 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9ab62697-06cf-4b69-abb4-cefd227bbd8a/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:287 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~projected/kube-api-access-9pkjb DeviceMajor:0 DeviceMinor:291 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e88ec241c5e6af119a4489d76f4ac2e294c5180a74211b4979ec659e726d29e5/userdata/shm DeviceMajor:0 DeviceMinor:371 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-377 DeviceMajor:0 DeviceMinor:377 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cceb3236-3f5d-4711-86f2-6d13d8e2b92b/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:265 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:303 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-431 DeviceMajor:0 DeviceMinor:431 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-170 DeviceMajor:0 DeviceMinor:170 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3/volumes/kubernetes.io~projected/kube-api-access-q76ww DeviceMajor:0 DeviceMinor:241 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:290 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-313 DeviceMajor:0 DeviceMinor:313 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:361 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0bdc4f355aa5fcbd369073261e0da56da559ea2bbd1c5ff337d26575f3ff2cf3/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/41bd9a978a285cf1be7e937ed0189d62fb2835f4cdb43dd30f22565d4030d698/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/cceb3236-3f5d-4711-86f2-6d13d8e2b92b/volumes/kubernetes.io~projected/kube-api-access-95zdd DeviceMajor:0 DeviceMinor:270 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a26c6046116976075e2e1e39e4c42756012443570c8c0471ac99c3bb50e34d9a/userdata/shm DeviceMajor:0 DeviceMinor:271 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:288 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d1a3f906-3026-4220-af30-3a682acafbbb/volumes/kubernetes.io~projected/kube-api-access-ghdgw DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/744928099cc137c52314c67fe79047467f07f9aa8511de031b501507def58f3a/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ec448ba9-2485-4143-9b71-d5e3b51d507c/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/34189a58-fb9a-4726-9160-6b3e765770ed/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:282 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7941b992c631e2fab8f0f106013c6bb2ba197fd7146dd51d38e631ba0de992b8/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:356 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-426 DeviceMajor:0 DeviceMinor:426 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:357 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:361 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:48 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-244 DeviceMajor:0 DeviceMinor:244 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-246 DeviceMajor:0 DeviceMinor:246 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/453d1ba76601b8f541b4c842044a41426909e0d924525bb0ff5f77f0ee0ce9ca/userdata/shm DeviceMajor:0 DeviceMinor:307 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/af124602-383f-4c7a-8325-6cbaf0d80d1e/volumes/kubernetes.io~projected/kube-api-access-h6j5x DeviceMajor:0 DeviceMinor:368 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-397 DeviceMajor:0 DeviceMinor:397 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ac461c8ef39aef232c8d2a4f40ec47c4387371227940ae1af1fe1958e6b2c68c/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-168 DeviceMajor:0 DeviceMinor:168 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:240 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:361 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/44029ff2416ffa01b9059a6d1e06d099880ae16d7c95ede95c922fdf85cf6a73/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/45b64324-82f2-4075-80e1-50255e083d70/volumes/kubernetes.io~projected/kube-api-access-mrrf5 DeviceMajor:0 DeviceMinor:297 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-309 DeviceMajor:0 DeviceMinor:309 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/62fc6158c4f0847ad98811b7b4be68941347727ff028fcdc10fe22d79494eb08/userdata/shm DeviceMajor:0 DeviceMinor:375 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-379 DeviceMajor:0 DeviceMinor:379 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:41bd9a978a285cf MacAddress:9a:89:89:07:2f:74 Speed:10000 Mtu:8901} {Name:44653bfe4ca1162 MacAddress:9a:00:79:3e:6a:68 Speed:10000 Mtu:8901} {Name:453d1ba76601b8f MacAddress:ba:8b:6d:dd:81:1d Speed:10000 Mtu:8901} {Name:4b5fa321f168972 MacAddress:86:2d:90:8f:ca:51 Speed:10000 Mtu:8901} {Name:583c516ce220450 MacAddress:da:09:af:4f:e7:20 Speed:10000 Mtu:8901} {Name:62fc6158c4f0847 MacAddress:2e:4c:2f:bf:28:db Speed:10000 Mtu:8901} {Name:770bc9a3fdf9188 MacAddress:42:bd:0d:49:dc:81 Speed:10000 Mtu:8901} {Name:8639c952e7d30ce MacAddress:9a:3d:0f:40:0a:15 Speed:10000 Mtu:8901} {Name:91ba5763b2b98c8 MacAddress:da:df:2f:19:16:7a Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:dd:32:3e:8b Speed:0 Mtu:9001} {Name:br-int MacAddress:f6:c4:3b:dc:66:c2 Speed:0 Mtu:8901} {Name:d521785aa434b98 MacAddress:d6:36:6b:cd:ad:6b Speed:10000 Mtu:8901} {Name:e88ec241c5e6af1 MacAddress:3a:ad:73:1d:fe:ca Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:dd:32:3e:8b Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:fa:fc:9a:aa:90:cc Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:9a:62:44:57:c8:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.918078    5572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.918137    5572 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.918506    5572 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.918553    5572 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-142.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.918778    5572 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.918792    5572 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.918811    5572 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.918830    5572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.919008    5572 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.919254    5572 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.919406    5572 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.919459    5572 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.919474    5572 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.919489    5572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.919502    5572 kubelet.go:405] "Adding apiserver pod source"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.919514    5572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.920433    5572 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 01:11:08.920886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.920447    5572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 01:11:08.921778 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.921133    5572 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 01:11:08.925786 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.925736    5572 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 01:11:08.925786 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.925751    5572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 01:11:08.925913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.925849    5572 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 04 01:11:08.926088 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926075    5572 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 01:11:08.926134 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926106    5572 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 01:11:08.926258 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926208    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 01:11:08.926307 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926265    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 01:11:08.926307 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926273    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 01:11:08.926307 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926286    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 01:11:08.926307 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926293    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 01:11:08.926307 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926299    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 01:11:08.926307 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926305    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 01:11:08.926307 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926310    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 01:11:08.926600 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926318    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 01:11:08.926600 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926324    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 01:11:08.926600 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926350    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 01:11:08.926600 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926362    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 01:11:08.926600 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926390    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 01:11:08.926600 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.926396    5572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 01:11:08.930003 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.929989    5572 server.go:1263] "Started kubelet"
Nov 04 01:11:08.930188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.930104    5572 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 01:11:08.930383 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.930088    5572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 01:11:08.930383 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.930361    5572 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 01:11:08.930773 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.930757    5572 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 01:11:08.930865 ip-10-0-128-142 systemd[1]: Started Kubernetes Kubelet.
Nov 04 01:11:08.931590 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.931514    5572 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 01:11:08.934072 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.934056    5572 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 01:11:08.934167 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.934136    5572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 01:11:08.934229 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.934189    5572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 01:04:57 +0000 UTC" deadline="2028-04-30 01:31:44.546557103 +0000 UTC"
Nov 04 01:11:08.934229 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.934220    5572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13032h20m35.612340073s"
Nov 04 01:11:08.934399 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.934357    5572 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 01:11:08.934399 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.934370    5572 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 01:11:08.934511 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:08.934389    5572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-142.us-west-2.compute.internal\" not found"
Nov 04 01:11:08.934511 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.934457    5572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 01:11:08.937151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.936932    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aea8797d-c027-4b30-8e75-e65ed05158af" volumeName="kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-binary-copy" seLinuxMountContext=""
Nov 04 01:11:08.937151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.937003    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3" volumeName="kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 04 01:11:08.937151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.937026    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d1a3f906-3026-4220-af30-3a682acafbbb" volumeName="kubernetes.io/configmap/d1a3f906-3026-4220-af30-3a682acafbbb-serviceca" seLinuxMountContext=""
Nov 04 01:11:08.937151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.937040    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d1a3f906-3026-4220-af30-3a682acafbbb" volumeName="kubernetes.io/projected/d1a3f906-3026-4220-af30-3a682acafbbb-kube-api-access-ghdgw" seLinuxMountContext=""
Nov 04 01:11:08.937151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.937058    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45b64324-82f2-4075-80e1-50255e083d70" volumeName="kubernetes.io/projected/45b64324-82f2-4075-80e1-50255e083d70-kube-api-access-mrrf5" seLinuxMountContext=""
Nov 04 01:11:08.937151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.937071    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aea8797d-c027-4b30-8e75-e65ed05158af" volumeName="kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 04 01:11:08.937151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.937084    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b6b228e-6fd5-455f-91c3-498ac0b29d01" volumeName="kubernetes.io/projected/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-api-access-sk9v8" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.937101    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34189a58-fb9a-4726-9160-6b3e765770ed" volumeName="kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938299    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="54daba34-bdc5-4e9a-8fc2-124c44311571" volumeName="kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938321    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="631c65a6-6bc5-4d54-8e52-ac6cc89bfad1" volumeName="kubernetes.io/projected/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-kube-api-access-fglqf" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938343    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec448ba9-2485-4143-9b71-d5e3b51d507c" volumeName="kubernetes.io/empty-dir/ec448ba9-2485-4143-9b71-d5e3b51d507c-tmp-dir" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938358    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34189a58-fb9a-4726-9160-6b3e765770ed" volumeName="kubernetes.io/empty-dir/34189a58-fb9a-4726-9160-6b3e765770ed-tmp" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938375    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-metrics-client-certs" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938388    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938453    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e" volumeName="kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938482    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e" volumeName="kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-client-tls" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938500    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3" volumeName="kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-tls" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938513    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cceb3236-3f5d-4711-86f2-6d13d8e2b92b" volumeName="kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938525    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec448ba9-2485-4143-9b71-d5e3b51d507c" volumeName="kubernetes.io/projected/ec448ba9-2485-4143-9b71-d5e3b51d507c-kube-api-access-v56qh" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938571    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d8801a3-3cc4-4311-9876-152f71cc5687" volumeName="kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-script-lib" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938585    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45b64324-82f2-4075-80e1-50255e083d70" volumeName="kubernetes.io/secret/45b64324-82f2-4075-80e1-50255e083d70-monitoring-plugin-cert" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938602    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aea8797d-c027-4b30-8e75-e65ed05158af" volumeName="kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938614    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec448ba9-2485-4143-9b71-d5e3b51d507c" volumeName="kubernetes.io/secret/ec448ba9-2485-4143-9b71-d5e3b51d507c-metrics-tls" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938630    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="41d83d70-c53d-4e05-9ef0-54918d176ee0" volumeName="kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938648    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-web-config" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938661    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938678    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-kube-rbac-proxy" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938691    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-tls" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938716    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e" volumeName="kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-metrics-client-ca" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938730    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cceb3236-3f5d-4711-86f2-6d13d8e2b92b" volumeName="kubernetes.io/projected/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-kube-api-access-95zdd" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938747    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec448ba9-2485-4143-9b71-d5e3b51d507c" volumeName="kubernetes.io/configmap/ec448ba9-2485-4143-9b71-d5e3b51d507c-config-volume" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938759    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25fa3dbe-9f99-4c9a-bb48-afe5dac916ac" volumeName="kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-tuned" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938771    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34189a58-fb9a-4726-9160-6b3e765770ed" volumeName="kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-tls" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938789    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938801    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-db" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938824    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-kube-api-access-z9rlx" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938836    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e" volumeName="kubernetes.io/projected/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-kube-api-access-d4qg7" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938848    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af124602-383f-4c7a-8325-6cbaf0d80d1e" volumeName="kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938867    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b6b228e-6fd5-455f-91c3-498ac0b29d01" volumeName="kubernetes.io/configmap/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-rbac-proxy-cm" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938881    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34189a58-fb9a-4726-9160-6b3e765770ed" volumeName="kubernetes.io/projected/34189a58-fb9a-4726-9160-6b3e765770ed-kube-api-access-9pkjb" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938898    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d8801a3-3cc4-4311-9876-152f71cc5687" volumeName="kubernetes.io/projected/3d8801a3-3cc4-4311-9876-152f71cc5687-kube-api-access-vds7d" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938910    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-thanos-prometheus-http-client-file" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938921    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1b6756a-77d7-4a73-9900-9a739b6c3a21" volumeName="kubernetes.io/configmap/a1b6756a-77d7-4a73-9900-9a739b6c3a21-konnectivity-ca" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938938    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e" volumeName="kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.938952    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b6b228e-6fd5-455f-91c3-498ac0b29d01" volumeName="kubernetes.io/secret/1b6b228e-6fd5-455f-91c3-498ac0b29d01-insights-runtime-extractor-tls" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939040    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939058    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3" volumeName="kubernetes.io/configmap/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-metrics-client-ca" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939076    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cceb3236-3f5d-4711-86f2-6d13d8e2b92b" volumeName="kubernetes.io/empty-dir/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-textfile" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939089    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01a7a8be-5a1a-4d39-9988-8163e34d69e5" volumeName="kubernetes.io/projected/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kube-api-access-xxwfl" seLinuxMountContext=""
Nov 04 01:11:08.939109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939105    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34189a58-fb9a-4726-9160-6b3e765770ed" volumeName="kubernetes.io/configmap/34189a58-fb9a-4726-9160-6b3e765770ed-metrics-client-ca" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939177    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34189a58-fb9a-4726-9160-6b3e765770ed" volumeName="kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-grpc-tls" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939251    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="631c65a6-6bc5-4d54-8e52-ac6cc89bfad1" volumeName="kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cni-binary-copy" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939270    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ab62697-06cf-4b69-abb4-cefd227bbd8a" volumeName="kubernetes.io/projected/9ab62697-06cf-4b69-abb4-cefd227bbd8a-kube-api-access-jt9g6" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939328    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cceb3236-3f5d-4711-86f2-6d13d8e2b92b" volumeName="kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-metrics-client-ca" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939344    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b6b228e-6fd5-455f-91c3-498ac0b29d01" volumeName="kubernetes.io/empty-dir/1b6b228e-6fd5-455f-91c3-498ac0b29d01-data-volume" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939385    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25fa3dbe-9f99-4c9a-bb48-afe5dac916ac" volumeName="kubernetes.io/projected/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-kube-api-access-wk4q9" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939428    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939443    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ab62697-06cf-4b69-abb4-cefd227bbd8a" volumeName="kubernetes.io/secret/9ab62697-06cf-4b69-abb4-cefd227bbd8a-cert" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939485    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e" volumeName="kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-serving-certs-ca-bundle" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939500    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d8801a3-3cc4-4311-9876-152f71cc5687" volumeName="kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-config" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939514    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="54daba34-bdc5-4e9a-8fc2-124c44311571" volumeName="kubernetes.io/projected/54daba34-bdc5-4e9a-8fc2-124c44311571-kube-api-access-zqz8n" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939591    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="631c65a6-6bc5-4d54-8e52-ac6cc89bfad1" volumeName="kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-daemon-config" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939608    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939640    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-metrics-client-ca" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939653    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-config-out" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939666    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1b6756a-77d7-4a73-9900-9a739b6c3a21" volumeName="kubernetes.io/secret/a1b6756a-77d7-4a73-9900-9a739b6c3a21-agent-certs" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939687    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cceb3236-3f5d-4711-86f2-6d13d8e2b92b" volumeName="kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-tls" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939700    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25fa3dbe-9f99-4c9a-bb48-afe5dac916ac" volumeName="kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-tmp" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939716    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34189a58-fb9a-4726-9160-6b3e765770ed" volumeName="kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939733    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d8801a3-3cc4-4311-9876-152f71cc5687" volumeName="kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-env-overrides" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939746    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d8801a3-3cc4-4311-9876-152f71cc5687" volumeName="kubernetes.io/secret/3d8801a3-3cc4-4311-9876-152f71cc5687-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939762    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36657689-6fdf-4f18-b466-52ab25506722" volumeName="kubernetes.io/projected/36657689-6fdf-4f18-b466-52ab25506722-kube-api-access-ktr2t" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939867    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.939887    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-tls-assets" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940256    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-config" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940283    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cceb3236-3f5d-4711-86f2-6d13d8e2b92b" volumeName="kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940298    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="335e91c5-3f5e-49e7-ab4c-67ffb1e5d694" volumeName="kubernetes.io/empty-dir/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-tmp-dir" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940321    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="335e91c5-3f5e-49e7-ab4c-67ffb1e5d694" volumeName="kubernetes.io/projected/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-kube-api-access-hsmjz" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940333    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34189a58-fb9a-4726-9160-6b3e765770ed" volumeName="kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940344    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34189a58-fb9a-4726-9160-6b3e765770ed" volumeName="kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940356    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940368    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e" volumeName="kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940379    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aea8797d-c027-4b30-8e75-e65ed05158af" volumeName="kubernetes.io/projected/aea8797d-c027-4b30-8e75-e65ed05158af-kube-api-access-9jp9j" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940390    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3" volumeName="kubernetes.io/projected/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-kube-api-access-q76ww" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940410    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36657689-6fdf-4f18-b466-52ab25506722" volumeName="kubernetes.io/configmap/36657689-6fdf-4f18-b466-52ab25506722-iptables-alerter-script" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940421    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96e6a622-f28d-449c-9c31-08871e1fa26f" volumeName="kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-grpc-tls" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940432    5572 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e" volumeName="kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-federate-client-tls" seLinuxMountContext=""
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940443    5572 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.940451    5572 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.941555    5572 factory.go:55] Registering systemd factory
Nov 04 01:11:08.941568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.941574    5572 factory.go:223] Registration of the systemd container factory successfully
Nov 04 01:11:08.943312 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.942793    5572 factory.go:153] Registering CRI-O factory
Nov 04 01:11:08.943312 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.942810    5572 factory.go:223] Registration of the crio container factory successfully
Nov 04 01:11:08.943312 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.942944    5572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 01:11:08.943312 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.942967    5572 factory.go:103] Registering Raw factory
Nov 04 01:11:08.943312 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.942981    5572 manager.go:1199] Started watching for new ooms in manager
Nov 04 01:11:08.943312 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.943307    5572 manager.go:319] Starting recovery of all containers
Nov 04 01:11:08.963815 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.963773    5572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 01:11:08.965340 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.965317    5572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 01:11:08.965340 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.965343    5572 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 01:11:08.965510 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.965363    5572 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 01:11:08.965510 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:08.965402    5572 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 04 01:11:08.986395 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.986359    5572 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="559f9be1cd61f0fc93f0e7f538a0e552139aa4fe3e4c4239ef4098b57d5b5ac3" exitCode=0
Nov 04 01:11:08.986395 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.986388    5572 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="22a75b91037637acfbb03d98d4f382f80e3ff5ce12494621c19d6e7e997a14a9" exitCode=0
Nov 04 01:11:08.986395 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.986395    5572 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="e194fc52b447707781e17f4fefcb22eabf56462233703dffc175d522bdc32afb" exitCode=0
Nov 04 01:11:08.986395 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.986400    5572 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="ccb3e8e1eca1fecd0d6271052867931e7783e9328a80725e00e4b0c7eb877c05" exitCode=0
Nov 04 01:11:08.986695 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.986406    5572 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="972ef04c5ffa427bd53e047003ef9a95a4862da24f28e31f0b5a514a62be158f" exitCode=0
Nov 04 01:11:08.986695 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.986414    5572 generic.go:356] "Generic (PLEG): container finished" podID="aea8797d-c027-4b30-8e75-e65ed05158af" containerID="4a63b157ae2e21a81cb3fa2508caee4ac9c5041bd4588d5768a7971c8db32ec1" exitCode=0
Nov 04 01:11:08.994313 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:08.994282    5572 generic.go:356] "Generic (PLEG): container finished" podID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerID="3ec5dd32d8120a12658c5e06cff824a780d9cd7957a306589bce2f52b83df21a" exitCode=0
Nov 04 01:11:09.008892 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.008868    5572 generic.go:356] "Generic (PLEG): container finished" podID="cceb3236-3f5d-4711-86f2-6d13d8e2b92b" containerID="422c52b52396e269bbddedef9de495b6f1c25f0a8b1ce0c399945558e6950d7d" exitCode=0
Nov 04 01:11:09.012849 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.012816    5572 generic.go:356] "Generic (PLEG): container finished" podID="ec177e465a97bf965e66ed6a00cb6b1c" containerID="e09eb9b4acd0393a8e172b4a0fa2da5f81604d3365eb141280713ce62f61d1e6" exitCode=0
Nov 04 01:11:09.036779 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:09.036747    5572 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-142.us-west-2.compute.internal\" not found"
Nov 04 01:11:09.050738 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.050717    5572 manager.go:324] Recovery completed
Nov 04 01:11:09.065897 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:09.065865    5572 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 04 01:11:09.070274 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.070248    5572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:11:09.072409 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.072380    5572 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:11:09.073224 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.073204    5572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:11:09.073313 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.073239    5572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:11:09.073313 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.073257    5572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:11:09.076910 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.076891    5572 cpu_manager.go:226] "Starting" policy="none"
Nov 04 01:11:09.076910 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.076907    5572 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 01:11:09.077034 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.076912    5572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:11:09.077034 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.076927    5572 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 01:11:09.077121 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.077096    5572 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 04 01:11:09.077213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.077113    5572 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 04 01:11:09.077213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.077154    5572 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 04 01:11:09.077213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.077160    5572 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 04 01:11:09.077213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.077166    5572 policy_none.go:50] "Start"
Nov 04 01:11:09.077213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.077174    5572 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 01:11:09.077213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.077184    5572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 01:11:09.077948 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.077927    5572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:11:09.078017 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.077962    5572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:11:09.078017 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.077972    5572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:11:09.078400 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.078387    5572 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 04 01:11:09.078441 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.078403    5572 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 04 01:11:09.078441 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.078410    5572 policy_none.go:44] "Start"
Nov 04 01:11:09.082942 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.082908    5572 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 01:11:09.087230 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.087211    5572 manager.go:341] "Starting Device Plugin manager"
Nov 04 01:11:09.087300 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:09.087248    5572 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 01:11:09.087300 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.087261    5572 server.go:87] "Starting device plugin registration server"
Nov 04 01:11:09.087621 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.087607    5572 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 01:11:09.087654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.087624    5572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 01:11:09.087729 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.087712    5572 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 01:11:09.087856 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.087818    5572 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 01:11:09.087953 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.087865    5572 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 01:11:09.087953 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.087872    5572 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 01:11:09.088604 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.088516    5572 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T01:11:09.08785412Z","UUID":"95fdb814-6d82-43f3-9641-f24695e47cd8","Handler":null,"Name":"","Endpoint":""}
Nov 04 01:11:09.089642 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:09.089625    5572 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 01:11:09.089717 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:09.089664    5572 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-142.us-west-2.compute.internal\" not found"
Nov 04 01:11:09.089860 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.089841    5572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 01:11:09.089953 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.089865    5572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 01:11:09.117481 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.117457    5572 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:11:09.117946 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.117930    5572 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 04 01:11:09.118970 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.118957    5572 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:11:09.188787 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.188704    5572 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 01:11:09.189815 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.189796    5572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 01:11:09.189916 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.189828    5572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 01:11:09.189916 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.189839    5572 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-142.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 01:11:09.189916 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.189887    5572 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.209294 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.209265    5572 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 01:11:09.266650 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.266591    5572 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"]
Nov 04 01:11:09.267287 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.267252    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal" event={"ID":"a2c9bab5e4ee3b4b58012399d0a10eff","Type":"ContainerStarted","Data":"eb342467819b6f0a501f57c74fc3b6ad6d7e239e26be2f611a1be38b3976f43c"}
Nov 04 01:11:09.267394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.267287    5572 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.267394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.267295    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal" event={"ID":"a2c9bab5e4ee3b4b58012399d0a10eff","Type":"ContainerStarted","Data":"70aef28f3b64ab1915a533c794a25b6208da186648d540f57aeecc8ddd722221"}
Nov 04 01:11:09.267394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.267327    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal" event={"ID":"ec177e465a97bf965e66ed6a00cb6b1c","Type":"ContainerStarted","Data":"0e751dc5ffa44de699c01b79bb9ebfb0950851d6db5e1366b60d833e880e47bc"}
Nov 04 01:11:09.267394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.267342    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal" event={"ID":"ec177e465a97bf965e66ed6a00cb6b1c","Type":"ContainerDied","Data":"e09eb9b4acd0393a8e172b4a0fa2da5f81604d3365eb141280713ce62f61d1e6"}
Nov 04 01:11:09.267394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.267353    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal" event={"ID":"ec177e465a97bf965e66ed6a00cb6b1c","Type":"ContainerStarted","Data":"44029ff2416ffa01b9059a6d1e06d099880ae16d7c95ede95c922fdf85cf6a73"}
Nov 04 01:11:09.267671 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.267487    5572 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.310608 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.310571    5572 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.310755 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.310690    5572 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.322627 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.322604    5572 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:11:09.322753 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:09.322649    5572 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.323071 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.323054    5572 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:11:09.323110 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:09.323098    5572 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.419785 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.419755    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.419785 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.419787    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2c9bab5e4ee3b4b58012399d0a10eff-config\") pod \"kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"a2c9bab5e4ee3b4b58012399d0a10eff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.419991 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.419806    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.520413 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.520379    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.520413 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.520412    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2c9bab5e4ee3b4b58012399d0a10eff-config\") pod \"kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"a2c9bab5e4ee3b4b58012399d0a10eff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.520612 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.520430    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.520612 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.520480    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a2c9bab5e4ee3b4b58012399d0a10eff-config\") pod \"kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"a2c9bab5e4ee3b4b58012399d0a10eff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.520612 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.520489    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.520612 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.520547    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec177e465a97bf965e66ed6a00cb6b1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" (UID: \"ec177e465a97bf965e66ed6a00cb6b1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:09.920459 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:09.920389    5572 apiserver.go:52] "Watching apiserver"
Nov 04 01:11:10.017162 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.017129    5572 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 01:11:10.017752 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.017726    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-mgql9","openshift-monitoring/telemeter-client-c54ddf549-f2j28","openshift-dns/node-resolver-xdspt","openshift-insights/insights-runtime-extractor-pnhc2","openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm","openshift-ingress-canary/ingress-canary-9s98m","openshift-network-diagnostics/network-check-target-l4plc","kube-system/global-pull-secret-syncer-c5jls","kube-system/konnectivity-agent-gpw4g","openshift-cluster-node-tuning-operator/tuned-n9vdh","openshift-dns/dns-default-rf4vp","openshift-monitoring/thanos-querier-f4b759ddc-s75m9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal","openshift-monitoring/prometheus-k8s-0","openshift-ovn-kubernetes/ovnkube-node-q2lpn","kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal","openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr","openshift-monitoring/node-exporter-vp26r","openshift-multus/network-metrics-daemon-plbjs","openshift-multus/multus-pmzlg","openshift-network-operator/iptables-alerter-pn797","openshift-multus/multus-additional-cni-plugins-hmcdr"]
Nov 04 01:11:10.028005 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.027980    5572 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:10.028136 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.028096    5572 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:10.036436 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.036412    5572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 01:11:10.070854 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070812    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 01:11:10.070854 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070820    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 01:11:10.070854 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070827    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 01:11:10.070854 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070844    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070892    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070900    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070926    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070943    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070951    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070953    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070965    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070933    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.070976    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.071023    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.071071    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.071079    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.071112    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.071115    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 01:11:10.071147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.071114    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 01:11:10.071852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.071836    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 01:11:10.071933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.071867    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 01:11:10.072004 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.071990    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 01:11:10.072053 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.072005    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 01:11:10.072120 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.072109    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 01:11:10.072155 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.072141    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 01:11:10.072202 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.072172    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 01:11:10.072350 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.072336    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 01:11:10.078756 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.078709    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:10.111025 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.110996    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 01:11:10.111147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.111132    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 01:11:10.113848 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.113812    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 01:11:10.114105 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.114091    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 01:11:10.114173 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.114096    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 01:11:10.114173 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.114116    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 01:11:10.114455 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.114440    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 01:11:10.114588 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.114570    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 04 01:11:10.114698 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.114603    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Nov 04 01:11:10.114698 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.114616    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 01:11:10.114698 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.114615    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 04 01:11:10.114872 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.114703    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 04 01:11:10.114872 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.114758    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 01:11:10.114872 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.114807    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 04 01:11:10.124167 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124147    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-modprobe-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.124256 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124173    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36657689-6fdf-4f18-b466-52ab25506722-host-slash\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:11:10.124256 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124190    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b6b228e-6fd5-455f-91c3-498ac0b29d01-crio-socket\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:11:10.124256 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124211    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-kubelet-config\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:11:10.124395 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124264    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:11:10.124395 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124291    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqz8n\" (UniqueName: \"kubernetes.io/projected/54daba34-bdc5-4e9a-8fc2-124c44311571-kube-api-access-zqz8n\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:11:10.124395 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124322    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-etc-kubernetes\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.124486 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124415    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1b6756a-77d7-4a73-9900-9a739b6c3a21-agent-certs\") pod \"konnectivity-agent-gpw4g\" (UID: \"a1b6756a-77d7-4a73-9900-9a739b6c3a21\") " pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:11:10.124486 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124465    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.124570 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124508    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-config\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.124570 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124547    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-device-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.124637 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124576    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a3f906-3026-4220-af30-3a682acafbbb-host\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:11:10.124678 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124644    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-cnibin\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.124719 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124679    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-root\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.124761 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124742    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-serving-certs-ca-bundle\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.124804 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124789    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab62697-06cf-4b69-abb4-cefd227bbd8a-cert\") pod \"ingress-canary-9s98m\" (UID: \"9ab62697-06cf-4b69-abb4-cefd227bbd8a\") " pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:11:10.124804 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124788    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-config\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.124889 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124876    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-sys\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.124921 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124906    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.124959 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124923    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v56qh\" (UniqueName: \"kubernetes.io/projected/ec448ba9-2485-4143-9b71-d5e3b51d507c-kube-api-access-v56qh\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:11:10.125007 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124979    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-serving-certs-ca-bundle\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.125007 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.124963    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-env-overrides\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.125099 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125010    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.125099 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125026    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-tuned\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.125099 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125043    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-tmp-dir\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:11:10.125099 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125058    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.125099 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125091    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.125308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125119    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-env-overrides\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.125308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125172    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-tmp-dir\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:11:10.125308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125202    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.125308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125223    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-netns\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.125308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125223    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-tuned\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.125308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125239    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-hostroot\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.125308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125274    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-tls\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.125308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125305    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.125587 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125333    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-systemd\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.125587 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125360    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxwfl\" (UniqueName: \"kubernetes.io/projected/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kube-api-access-xxwfl\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.125587 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125387    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-kubelet\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.125587 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125393    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.125587 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125422    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.125587 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125486    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-federate-client-tls\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.125587 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125518    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.125587 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125565    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-metrics-client-ca\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125591    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125616    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125641    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125670    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125697    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec448ba9-2485-4143-9b71-d5e3b51d507c-tmp-dir\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125723    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-var-lib-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125747    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-etc-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125764    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-metrics-client-ca\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125770    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-node-log\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125796    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec448ba9-2485-4143-9b71-d5e3b51d507c-tmp-dir\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125806    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125823    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125833    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125868    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-sys\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125898    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-sys-fs\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125916    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-conf\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.125923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125930    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-lib-modules\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.125982    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126003    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-log-socket\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126029    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126035    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126121    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126150    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b6b228e-6fd5-455f-91c3-498ac0b29d01-data-volume\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126167    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-systemd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126192    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126224    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126236    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b6b228e-6fd5-455f-91c3-498ac0b29d01-data-volume\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126262    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-system-cni-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126305    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126353    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-socket-dir-parent\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126389    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-bin\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126416    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vds7d\" (UniqueName: \"kubernetes.io/projected/3d8801a3-3cc4-4311-9876-152f71cc5687-kube-api-access-vds7d\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126477    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126481    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-socket-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.126508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126514    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk9v8\" (UniqueName: \"kubernetes.io/projected/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-api-access-sk9v8\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:11:10.126996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126558    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cnibin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.126996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126584    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-multus-certs\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.126996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126606    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-ovn\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.126996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126640    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-web-config\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.126996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126717    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.126996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126765    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-kubelet\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.126996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126867    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmjz\" (UniqueName: \"kubernetes.io/projected/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-kube-api-access-hsmjz\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:11:10.126996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126889    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aea8797d-c027-4b30-8e75-e65ed05158af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.127238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.126996    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-k8s-cni-cncf-io\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.127238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127056    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-slash\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.127238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127083    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-textfile\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.127238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127114    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-config-out\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.127238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127163    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-textfile\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.127238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127188    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-config-out\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.127238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127189    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghdgw\" (UniqueName: \"kubernetes.io/projected/d1a3f906-3026-4220-af30-3a682acafbbb-kube-api-access-ghdgw\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:11:10.127238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127222    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q76ww\" (UniqueName: \"kubernetes.io/projected/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-kube-api-access-q76ww\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:11:10.127443 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127246    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrrf5\" (UniqueName: \"kubernetes.io/projected/45b64324-82f2-4075-80e1-50255e083d70-kube-api-access-mrrf5\") pod \"monitoring-plugin-77f4f76594-v7gwr\" (UID: \"45b64324-82f2-4075-80e1-50255e083d70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:11:10.127443 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127366    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-host\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.127443 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127399    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:11:10.127443 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127432    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-tmp\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.127591 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127448    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk4q9\" (UniqueName: \"kubernetes.io/projected/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-kube-api-access-wk4q9\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.127591 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127464    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-dbus\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:11:10.127591 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127482    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-hosts-file\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:11:10.127591 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127579    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-tmp\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.127778 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127599    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-systemd-units\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.127778 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127637    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.127778 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127648    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:11:10.127778 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127670    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b6b228e-6fd5-455f-91c3-498ac0b29d01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:11:10.127778 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127696    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-bin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.127778 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127698    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.127778 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127743    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.127778 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127762    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-netns\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.127778 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127780    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-tls\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.128125 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127829    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-client-tls\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.128125 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127859    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.128125 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127884    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-var-lib-kubelet\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.128125 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127911    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d8801a3-3cc4-4311-9876-152f71cc5687-ovn-node-metrics-cert\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.128125 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.127949    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95zdd\" (UniqueName: \"kubernetes.io/projected/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-kube-api-access-95zdd\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.128125 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128003    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.128125 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128035    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.128125 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128058    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec448ba9-2485-4143-9b71-d5e3b51d507c-metrics-tls\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:11:10.128125 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128084    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fglqf\" (UniqueName: \"kubernetes.io/projected/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-kube-api-access-fglqf\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.128434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128189    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.128434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128224    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-run\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.128434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128250    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1a3f906-3026-4220-af30-3a682acafbbb-serviceca\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:11:10.128434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128279    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:11:10.128434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128297    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.128434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128348    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-system-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.128434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128377    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-netd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.128434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128429    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.128434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128435    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.128733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128458    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.128733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128485    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:11:10.128733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128552    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jp9j\" (UniqueName: \"kubernetes.io/projected/aea8797d-c027-4b30-8e75-e65ed05158af-kube-api-access-9jp9j\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.128733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128588    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.128733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128616    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.128733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128642    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pkjb\" (UniqueName: \"kubernetes.io/projected/34189a58-fb9a-4726-9160-6b3e765770ed-kube-api-access-9pkjb\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.128733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128667    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.128733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128697    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-registration-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.128733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128722    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-conf-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128758    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128821    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128853    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9rlx\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-kube-api-access-z9rlx\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128903    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45b64324-82f2-4075-80e1-50255e083d70-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-v7gwr\" (UID: \"45b64324-82f2-4075-80e1-50255e083d70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128907    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1a3f906-3026-4220-af30-3a682acafbbb-serviceca\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128942    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34189a58-fb9a-4726-9160-6b3e765770ed-tmp\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128970    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.128997    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36657689-6fdf-4f18-b466-52ab25506722-iptables-alerter-script\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129020    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34189a58-fb9a-4726-9160-6b3e765770ed-tmp\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129024    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129052    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysconfig\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129080    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1b6756a-77d7-4a73-9900-9a739b6c3a21-konnectivity-ca\") pod \"konnectivity-agent-gpw4g\" (UID: \"a1b6756a-77d7-4a73-9900-9a739b6c3a21\") " pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129121    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.129135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129138    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129187    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36657689-6fdf-4f18-b466-52ab25506722-iptables-alerter-script\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129212    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt9g6\" (UniqueName: \"kubernetes.io/projected/9ab62697-06cf-4b69-abb4-cefd227bbd8a-kube-api-access-jt9g6\") pod \"ingress-canary-9s98m\" (UID: \"9ab62697-06cf-4b69-abb4-cefd227bbd8a\") " pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129259    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cni-binary-copy\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129279    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1b6756a-77d7-4a73-9900-9a739b6c3a21-konnectivity-ca\") pod \"konnectivity-agent-gpw4g\" (UID: \"a1b6756a-77d7-4a73-9900-9a739b6c3a21\") " pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129297    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34189a58-fb9a-4726-9160-6b3e765770ed-metrics-client-ca\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129328    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-wtmp\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129359    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-config\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129394    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-multus\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129413    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-script-lib\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129456    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cni-binary-copy\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129459    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-metrics-client-ca\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129494    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-grpc-tls\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129508    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34189a58-fb9a-4726-9160-6b3e765770ed-metrics-client-ca\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129583    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4qg7\" (UniqueName: \"kubernetes.io/projected/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-kube-api-access-d4qg7\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129612    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129650    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-kubernetes\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129674    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-metrics-client-ca\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129680    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktr2t\" (UniqueName: \"kubernetes.io/projected/36657689-6fdf-4f18-b466-52ab25506722-kube-api-access-ktr2t\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129616    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3d8801a3-3cc4-4311-9876-152f71cc5687-ovnkube-script-lib\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129707    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec448ba9-2485-4143-9b71-d5e3b51d507c-config-volume\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129783    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129811    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-daemon-config\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.129867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129842    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.130577 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129908    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec448ba9-2485-4143-9b71-d5e3b51d507c-config-volume\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:11:10.130577 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.129982    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-daemon-config\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.160859 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.160820    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 04 01:11:10.160859 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.160851    5572 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:11:10.161042 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:10.160901    5572 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:10.161042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.160830    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Nov 04 01:11:10.161042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.160949    5572 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 01:11:10.161042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.160978    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 04 01:11:10.161042 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:10.160998    5572 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-142.us-west-2.compute.internal"
Nov 04 01:11:10.161420 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161400    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 04 01:11:10.161495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161405    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Nov 04 01:11:10.161495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161460    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Nov 04 01:11:10.161610 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161509    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 01:11:10.161610 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161560    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8lz6w\""
Nov 04 01:11:10.161610 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161574    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 04 01:11:10.161610 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161577    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 01:11:10.161806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161640    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 01:11:10.161806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161653    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pnqhw\""
Nov 04 01:11:10.161806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161720    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Nov 04 01:11:10.161806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161763    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Nov 04 01:11:10.161806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161778    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Nov 04 01:11:10.161806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161799    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Nov 04 01:11:10.162081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161836    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 04 01:11:10.162081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.161898    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hz84q\""
Nov 04 01:11:10.162081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162007    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q5jlj\""
Nov 04 01:11:10.162081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162014    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Nov 04 01:11:10.162081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162039    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 04 01:11:10.162081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162060    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 04 01:11:10.162334 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162092    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 04 01:11:10.162334 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162116    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 01:11:10.162334 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162123    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d8jdw\""
Nov 04 01:11:10.162334 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162166    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Nov 04 01:11:10.162334 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162203    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 01:11:10.162334 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162204    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 01:11:10.162334 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162247    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j9t67\""
Nov 04 01:11:10.162334 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162331    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ldpj7\""
Nov 04 01:11:10.162743 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162410    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g9sbp\""
Nov 04 01:11:10.162743 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162475    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 01:11:10.162743 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162573    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qr45v\""
Nov 04 01:11:10.162743 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162602    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 04 01:11:10.162743 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162639    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zgtmx\""
Nov 04 01:11:10.162743 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162705    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-csp49\""
Nov 04 01:11:10.162940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162770    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 04 01:11:10.162940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162823    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-721pcmfl1crkg\""
Nov 04 01:11:10.162940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162871    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r28mp\""
Nov 04 01:11:10.162940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162917    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 04 01:11:10.163075 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.162966    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.163361    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-9dncz\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.163415    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-prqm6\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.163451    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.163481    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.163708    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.163730    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.163884    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-rjcnb\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.164029    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.164390    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-x4nsn\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.164461    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4z2qg\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.164623    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.164862    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-7mrtt\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.164941    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jhbmd\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165011    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1b6756a-77d7-4a73-9900-9a739b6c3a21-agent-certs\") pod \"konnectivity-agent-gpw4g\" (UID: \"a1b6756a-77d7-4a73-9900-9a739b6c3a21\") " pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165056    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ab62697-06cf-4b69-abb4-cefd227bbd8a-cert\") pod \"ingress-canary-9s98m\" (UID: \"9ab62697-06cf-4b69-abb4-cefd227bbd8a\") " pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165076    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-8hhs6\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165123    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4phhd\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165224    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7cl16ii3sg24k\""
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165339    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165353    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165438    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41d83d70-c53d-4e05-9ef0-54918d176ee0-original-pull-secret\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165547    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-tls\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165613    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165734    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-federate-client-tls\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165875    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.165880    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.167372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.166071    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.168349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.167472    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.168349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.167834    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.168349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.167924    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-web-config\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.168349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168018    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.168349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168029    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b6b228e-6fd5-455f-91c3-498ac0b29d01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:11:10.168349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168055    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-telemeter-client-tls\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.168349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168078    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.168349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168108    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-tls\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.168349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168202    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.168349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168225    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d8801a3-3cc4-4311-9876-152f71cc5687-ovn-node-metrics-cert\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.168349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168277    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec448ba9-2485-4143-9b71-d5e3b51d507c-metrics-tls\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:11:10.168656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168588    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:11:10.168692 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168660    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.168725 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168713    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:11:10.168859 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168841    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.168914 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168901    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.168947 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.168903    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.169809 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.169785    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45b64324-82f2-4075-80e1-50255e083d70-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-v7gwr\" (UID: \"45b64324-82f2-4075-80e1-50255e083d70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:11:10.169859 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.169814    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34189a58-fb9a-4726-9160-6b3e765770ed-secret-grpc-tls\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.169859 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.169813    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54daba34-bdc5-4e9a-8fc2-124c44311571-metrics-certs\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:11:10.169949 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.169868    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-secret-telemeter-client\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.170124 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.170105    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-config\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.170303 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.170285    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.172176 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.172136    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.179199 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.179181    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqz8n\" (UniqueName: \"kubernetes.io/projected/54daba34-bdc5-4e9a-8fc2-124c44311571-kube-api-access-zqz8n\") pod \"network-metrics-daemon-plbjs\" (UID: \"54daba34-bdc5-4e9a-8fc2-124c44311571\") " pod="openshift-multus/network-metrics-daemon-plbjs"
Nov 04 01:11:10.180175 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.180147    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v56qh\" (UniqueName: \"kubernetes.io/projected/ec448ba9-2485-4143-9b71-d5e3b51d507c-kube-api-access-v56qh\") pod \"dns-default-rf4vp\" (UID: \"ec448ba9-2485-4143-9b71-d5e3b51d507c\") " pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:11:10.180424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.180408    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxwfl\" (UniqueName: \"kubernetes.io/projected/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kube-api-access-xxwfl\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.181663 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.181631    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk9v8\" (UniqueName: \"kubernetes.io/projected/1b6b228e-6fd5-455f-91c3-498ac0b29d01-kube-api-access-sk9v8\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:11:10.181757 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.181738    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmjz\" (UniqueName: \"kubernetes.io/projected/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-kube-api-access-hsmjz\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:11:10.181957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.181939    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vds7d\" (UniqueName: \"kubernetes.io/projected/3d8801a3-3cc4-4311-9876-152f71cc5687-kube-api-access-vds7d\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.182860 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.182840    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk4q9\" (UniqueName: \"kubernetes.io/projected/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-kube-api-access-wk4q9\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.182959 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.182915    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghdgw\" (UniqueName: \"kubernetes.io/projected/d1a3f906-3026-4220-af30-3a682acafbbb-kube-api-access-ghdgw\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:11:10.183053 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.183038    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q76ww\" (UniqueName: \"kubernetes.io/projected/bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3-kube-api-access-q76ww\") pod \"prometheus-operator-9cd89b74c-4nf8k\" (UID: \"bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-4nf8k"
Nov 04 01:11:10.184333 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.184317    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fglqf\" (UniqueName: \"kubernetes.io/projected/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-kube-api-access-fglqf\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.184798 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.184780    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrrf5\" (UniqueName: \"kubernetes.io/projected/45b64324-82f2-4075-80e1-50255e083d70-kube-api-access-mrrf5\") pod \"monitoring-plugin-77f4f76594-v7gwr\" (UID: \"45b64324-82f2-4075-80e1-50255e083d70\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:11:10.184866 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.184811    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95zdd\" (UniqueName: \"kubernetes.io/projected/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-kube-api-access-95zdd\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.186430 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.186410    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/af124602-383f-4c7a-8325-6cbaf0d80d1e-kube-api-access-h6j5x\") pod \"network-check-target-l4plc\" (UID: \"af124602-383f-4c7a-8325-6cbaf0d80d1e\") " pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:11:10.186751 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.186735    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pkjb\" (UniqueName: \"kubernetes.io/projected/34189a58-fb9a-4726-9160-6b3e765770ed-kube-api-access-9pkjb\") pod \"thanos-querier-f4b759ddc-s75m9\" (UID: \"34189a58-fb9a-4726-9160-6b3e765770ed\") " pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:10.186847 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.186833    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4qg7\" (UniqueName: \"kubernetes.io/projected/a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e-kube-api-access-d4qg7\") pod \"telemeter-client-c54ddf549-f2j28\" (UID: \"a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e\") " pod="openshift-monitoring/telemeter-client-c54ddf549-f2j28"
Nov 04 01:11:10.186971 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.186957    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9rlx\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-kube-api-access-z9rlx\") pod \"prometheus-k8s-0\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:10.187885 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.187866    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktr2t\" (UniqueName: \"kubernetes.io/projected/36657689-6fdf-4f18-b466-52ab25506722-kube-api-access-ktr2t\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:11:10.187965 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.187890    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jp9j\" (UniqueName: \"kubernetes.io/projected/aea8797d-c027-4b30-8e75-e65ed05158af-kube-api-access-9jp9j\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.188151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.188134    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt9g6\" (UniqueName: \"kubernetes.io/projected/9ab62697-06cf-4b69-abb4-cefd227bbd8a-kube-api-access-jt9g6\") pod \"ingress-canary-9s98m\" (UID: \"9ab62697-06cf-4b69-abb4-cefd227bbd8a\") " pod="openshift-ingress-canary/ingress-canary-9s98m"
Nov 04 01:11:10.226618 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.226587    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:10.230621 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230597    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-registration-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.230733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230624    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-conf-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.230733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230644    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysconfig\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.230733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230662    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-wtmp\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.230733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230682    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-multus\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.230733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230706    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-kubernetes\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.230733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230717    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-registration-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230716    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-conf-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230740    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysconfig\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230751    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-node-exporter-wtmp\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230759    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-kubernetes\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230772    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-multus\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230769    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-modprobe-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230836    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36657689-6fdf-4f18-b466-52ab25506722-host-slash\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230853    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-modprobe-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230869    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b6b228e-6fd5-455f-91c3-498ac0b29d01-crio-socket\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230880    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36657689-6fdf-4f18-b466-52ab25506722-host-slash\") pod \"iptables-alerter-pn797\" (UID: \"36657689-6fdf-4f18-b466-52ab25506722\") " pod="openshift-network-operator/iptables-alerter-pn797"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230894    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-kubelet-config\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230921    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-etc-kubernetes\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230946    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230960    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-kubelet-config\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230963    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b6b228e-6fd5-455f-91c3-498ac0b29d01-crio-socket\") pod \"insights-runtime-extractor-pnhc2\" (UID: \"1b6b228e-6fd5-455f-91c3-498ac0b29d01\") " pod="openshift-insights/insights-runtime-extractor-pnhc2"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230970    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-etc-kubernetes\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230972    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-device-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231006    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a3f906-3026-4220-af30-3a682acafbbb-host\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.230986    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231018    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-device-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.231038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231034    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1a3f906-3026-4220-af30-3a682acafbbb-host\") pod \"node-ca-mgql9\" (UID: \"d1a3f906-3026-4220-af30-3a682acafbbb\") " pod="openshift-image-registry/node-ca-mgql9"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231063    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-cnibin\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231079    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-root\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231107    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-sys\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231131    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-root\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231136    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231106    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-cnibin\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231143    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cceb3236-3f5d-4711-86f2-6d13d8e2b92b-sys\") pod \"node-exporter-vp26r\" (UID: \"cceb3236-3f5d-4711-86f2-6d13d8e2b92b\") " pod="openshift-monitoring/node-exporter-vp26r"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231159    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231178    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-netns\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231192    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-hostroot\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231209    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-systemd\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231241    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-netns\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231247    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-hostroot\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231258    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-kubelet\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231269    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-d\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231287    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-systemd\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231300    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231262    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231326    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-var-lib-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231329    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-kubelet\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231352    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-var-lib-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231366    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231387    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-etc-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231409    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-node-log\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231423    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-sys\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231437    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-sys-fs\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231450    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-conf\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231451    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-etc-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231472    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-lib-modules\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231497    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-sys\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231498    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231497    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-node-log\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231502    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-sys-fs\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231528    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-log-socket\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231565    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-log-socket\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231571    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-etc-sysctl-conf\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231585    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-systemd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231604    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231615    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-lib-modules\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231622    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-system-cni-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231627    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-systemd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231528    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-openvswitch\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231655    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231656    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-socket-dir-parent\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231683    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-bin\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231703    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-socket-dir-parent\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231716    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-socket-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231721    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aea8797d-c027-4b30-8e75-e65ed05158af-system-cni-dir\") pod \"multus-additional-cni-plugins-hmcdr\" (UID: \"aea8797d-c027-4b30-8e75-e65ed05158af\") " pod="openshift-multus/multus-additional-cni-plugins-hmcdr"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231732    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cnibin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231747    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-multus-certs\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231740    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-bin\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231762    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-socket-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231773    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-ovn\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231785    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-multus-certs\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231797    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-cnibin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231798    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-kubelet\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231827    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-kubelet\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231829    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-k8s-cni-cncf-io\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231866    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-slash\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231871    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-run-k8s-cni-cncf-io\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231803    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-run-ovn\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.231852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231894    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-host\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231902    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-slash\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231913    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-dbus\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231942    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-hosts-file\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231957    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41d83d70-c53d-4e05-9ef0-54918d176ee0-dbus\") pod \"global-pull-secret-syncer-c5jls\" (UID: \"41d83d70-c53d-4e05-9ef0-54918d176ee0\") " pod="kube-system/global-pull-secret-syncer-c5jls"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231946    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-host\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231969    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/335e91c5-3f5e-49e7-ab4c-67ffb1e5d694-hosts-file\") pod \"node-resolver-xdspt\" (UID: \"335e91c5-3f5e-49e7-ab4c-67ffb1e5d694\") " pod="openshift-dns/node-resolver-xdspt"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231967    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-systemd-units\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231997    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-systemd-units\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.231999    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-bin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232017    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-host-var-lib-cni-bin\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232035    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232059    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-netns\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232076    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-multus-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232086    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-var-lib-kubelet\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232103    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-run-netns\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232113    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-run\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232130    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-var-lib-kubelet\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232139    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-system-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232156    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25fa3dbe-9f99-4c9a-bb48-afe5dac916ac-run\") pod \"tuned-n9vdh\" (UID: \"25fa3dbe-9f99-4c9a-bb48-afe5dac916ac\") " pod="openshift-cluster-node-tuning-operator/tuned-n9vdh"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232164    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-netd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232186    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/631c65a6-6bc5-4d54-8e52-ac6cc89bfad1-system-cni-dir\") pod \"multus-pmzlg\" (UID: \"631c65a6-6bc5-4d54-8e52-ac6cc89bfad1\") " pod="openshift-multus/multus-pmzlg"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232192    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232188    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3d8801a3-3cc4-4311-9876-152f71cc5687-host-cni-netd\") pod \"ovnkube-node-q2lpn\" (UID: \"3d8801a3-3cc4-4311-9876-152f71cc5687\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:10.234705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:10.232270    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01a7a8be-5a1a-4d39-9988-8163e34d69e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q94zm\" (UID: \"01a7a8be-5a1a-4d39-9988-8163e34d69e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q94zm"
Nov 04 01:11:11.039279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:11.039246    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerStarted","Data":"7e54e98c1699984d03e1884ed6e3fa3cf2ec779d1fdcd8726bc957001745116a"}
Nov 04 01:11:11.039667 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:11.039336    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerStarted","Data":"6cde29e7b3b92ef757474a1eb2bd26fa024b12a10b74911714372bd978c2dfc7"}
Nov 04 01:11:11.039667 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:11.039364    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerStarted","Data":"2c4f7078bf8697e8fddece8ae29d4182db57020b2eacb0225e7a8f96959b1d21"}
Nov 04 01:11:11.346638 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:11.346567    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f4b759ddc-s75m9"
Nov 04 01:11:11.415777 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:11.415745    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:11.559653 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:11.559605    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:11.667290 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:11.667219    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:11.870028 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:11.869999    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gpw4g"
Nov 04 01:11:12.045136 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:12.045108    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:12.045517 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:12.045301    5572 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 01:11:12.814303 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:12.814239    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:12.958957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:12.958923    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:12.999974 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:12.999946    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rf4vp"
Nov 04 01:11:13.198821 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:13.198789    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:11:13.345343 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:13.345312    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:13.429760 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:13.429722    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:13.429916 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:13.429903    5572 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 01:11:13.445114 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:13.445078    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:13.492342 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:13.492242    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:13.511796 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:13.511770    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:11:13.516400 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:13.516379    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v7gwr"
Nov 04 01:11:13.770766 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:13.770668    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:13.941586 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:13.941517    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:19.727670 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:19.727596    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:11:20.761867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:20.761833    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:20.905133 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:20.905097    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:23.987828 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:23.987797    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:24.148487 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:24.148432    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:27.411414 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:27.411383    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:11:28.184447 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:28.184412    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:28.342345 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:28.342317    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:30.843143 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:30.843109    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:31.680952 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:31.680922    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:33.704849 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:33.704810    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2lpn"
Nov 04 01:11:33.973223 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:33.973147    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:34.114505 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:34.114475    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:34.916545 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:34.916505    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:35.060207 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:35.060173    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:35.759839 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:35.759807    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:35.902831 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:35.902800    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:39.730561 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:39.730516    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l4plc"
Nov 04 01:11:39.913958 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:39.913917    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:40.058241 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:40.058156    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:43.198075 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:11:43.198036    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:11:44.935049 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:44.935013    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:45.080513 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:45.080483    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:45.345772 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:45.345735    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:45.487639 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:45.487584    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:48.354772 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:48.354739    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 01:11:48.355357 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:48.355323    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="prometheus" containerID="cri-o://31d63527c1618cf5b12100cb78e0339afdb5090a84414d7a3acf4966ef844fba" gracePeriod=600
Nov 04 01:11:48.355488 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:48.355439    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="thanos-sidecar" containerID="cri-o://d8acbbb0647525f9f795f916308abb4c72e1848fc12867cb61ecc8fd7f9a2281" gracePeriod=600
Nov 04 01:11:48.355574 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:48.355451    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy" containerID="cri-o://6cde29e7b3b92ef757474a1eb2bd26fa024b12a10b74911714372bd978c2dfc7" gracePeriod=600
Nov 04 01:11:48.355574 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:48.355485    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy-web" containerID="cri-o://2c4f7078bf8697e8fddece8ae29d4182db57020b2eacb0225e7a8f96959b1d21" gracePeriod=600
Nov 04 01:11:48.355685 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:48.355595    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="config-reloader" containerID="cri-o://cbf4ba1b1daaa1481f1e165a5cba8e56a81e74ef9da254afa3df076cf5880fca" gracePeriod=600
Nov 04 01:11:48.355685 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:48.355598    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7e54e98c1699984d03e1884ed6e3fa3cf2ec779d1fdcd8726bc957001745116a" gracePeriod=600
Nov 04 01:11:49.177895 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.177864    5572 generic.go:356] "Generic (PLEG): container finished" podID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerID="7e54e98c1699984d03e1884ed6e3fa3cf2ec779d1fdcd8726bc957001745116a" exitCode=0
Nov 04 01:11:49.177895 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.177889    5572 generic.go:356] "Generic (PLEG): container finished" podID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerID="6cde29e7b3b92ef757474a1eb2bd26fa024b12a10b74911714372bd978c2dfc7" exitCode=0
Nov 04 01:11:49.177895 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.177898    5572 generic.go:356] "Generic (PLEG): container finished" podID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerID="2c4f7078bf8697e8fddece8ae29d4182db57020b2eacb0225e7a8f96959b1d21" exitCode=0
Nov 04 01:11:49.178123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.177905    5572 generic.go:356] "Generic (PLEG): container finished" podID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerID="d8acbbb0647525f9f795f916308abb4c72e1848fc12867cb61ecc8fd7f9a2281" exitCode=0
Nov 04 01:11:49.178123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.177911    5572 generic.go:356] "Generic (PLEG): container finished" podID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerID="cbf4ba1b1daaa1481f1e165a5cba8e56a81e74ef9da254afa3df076cf5880fca" exitCode=0
Nov 04 01:11:49.178123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.177916    5572 generic.go:356] "Generic (PLEG): container finished" podID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerID="31d63527c1618cf5b12100cb78e0339afdb5090a84414d7a3acf4966ef844fba" exitCode=0
Nov 04 01:11:49.178123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.177947    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerDied","Data":"7e54e98c1699984d03e1884ed6e3fa3cf2ec779d1fdcd8726bc957001745116a"}
Nov 04 01:11:49.178123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.178013    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerDied","Data":"6cde29e7b3b92ef757474a1eb2bd26fa024b12a10b74911714372bd978c2dfc7"}
Nov 04 01:11:49.178123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.178040    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerDied","Data":"2c4f7078bf8697e8fddece8ae29d4182db57020b2eacb0225e7a8f96959b1d21"}
Nov 04 01:11:49.178123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.178065    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerDied","Data":"d8acbbb0647525f9f795f916308abb4c72e1848fc12867cb61ecc8fd7f9a2281"}
Nov 04 01:11:49.178123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.178088    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerDied","Data":"cbf4ba1b1daaa1481f1e165a5cba8e56a81e74ef9da254afa3df076cf5880fca"}
Nov 04 01:11:49.178123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:49.178110    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerDied","Data":"31d63527c1618cf5b12100cb78e0339afdb5090a84414d7a3acf4966ef844fba"}
Nov 04 01:11:50.759964 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:50.759923    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:50.901167 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:50.901135    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:53.631256 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:53.631221    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:59.719865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:59.719826    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:11:59.862294 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:11:59.862260    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:12:02.312832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:12:02.312796    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:12:02.454602 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:12:02.454574    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:12:13.198851 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:12:13.198814    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:12:14.128201 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:12:14.128167    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:12:18.784884 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:12:18.784852    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:12:35.726784 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:12:35.726745    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:12:35.871393 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:12:35.871362    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:12:43.198329 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:12:43.198285    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:12:55.918421 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:12:55.918386    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:12:56.062989 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:12:56.062905    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:13:13.197550 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:13:13.197487    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:13:14.484228 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:14.484195    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:13:19.137779 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:19.137737    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:13:43.198187 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:13:43.198148    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:13:48.479912 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:13:48.479864    5572 log.go:32] "StopPodSandbox from runtime service failed" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" podSandboxID="8639c952e7d30ce0524ef7dc08ef7bc081bee7e3ab40736197e77b6b650bed78"
Nov 04 01:13:48.480359 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:13:48.479918    5572 kuberuntime_manager.go:1939] "Failed to stop sandbox" podSandboxID={"Type":"cri-o","ID":"8639c952e7d30ce0524ef7dc08ef7bc081bee7e3ab40736197e77b6b650bed78"}
Nov 04 01:13:48.480359 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:13:48.480009    5572 kubelet.go:2243] "Unhandled Error" err="failed to \"KillPodSandbox\" for \"96e6a622-f28d-449c-9c31-08871e1fa26f\" with KillPodSandboxError: \"rpc error: code = DeadlineExceeded desc = context deadline exceeded\"" logger="UnhandledError"
Nov 04 01:13:48.480359 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:13:48.480023    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"96e6a622-f28d-449c-9c31-08871e1fa26f\" with KillPodSandboxError: \"rpc error: code = DeadlineExceeded desc = context deadline exceeded\"" pod="openshift-monitoring/prometheus-k8s-0" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f"
Nov 04 01:13:50.387232 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.387210    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.431564 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431515    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-kubelet-serving-ca-bundle\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.431715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431588    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-config-out\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.431715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431633    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-tls\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.431715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431666    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.431715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431701    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-kube-rbac-proxy\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.431925 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431728    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-config\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.431925 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431758    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-metrics-client-certs\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.431925 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431787    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-grpc-tls\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.431925 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431826    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-1\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.431925 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431834    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-kubelet-serving-ca-bundle" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:13:50.431925 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431856    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-web-config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-web-config\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.431925 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431899    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-thanos-prometheus-http-client-file\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.431925 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431928    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-db\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.432335 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431966    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-2\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.432335 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.431999    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.432335 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.432038    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-trusted-ca-bundle\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.432335 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.432073    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-kube-api-access-z9rlx\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-kube-api-access-z9rlx\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.432335 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.432103    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-0\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.432335 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.432143    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-serving-certs-ca-bundle\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.432335 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.432179    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-metrics-client-ca\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.432335 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.432214    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-tls-assets\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-tls-assets\") pod \"96e6a622-f28d-449c-9c31-08871e1fa26f\" (UID: \"96e6a622-f28d-449c-9c31-08871e1fa26f\") "
Nov 04 01:13:50.432750 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.432456    5572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.432945 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.432890    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-trusted-ca-bundle" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:13:50.433695 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.433476    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-1" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:13:50.435723 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.435467    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-2" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:13:50.435846 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.435816    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-0" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:13:50.435919 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.435901    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-serving-certs-ca-bundle" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:13:50.436041 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.435973    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-thanos-sidecar-tls" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:13:50.436207 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.436161    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-tls" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:13:50.436280 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.436245    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-metrics-client-ca" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:13:50.436441 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.436406    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-db" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:13:50.436640 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.436611    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-kube-rbac-proxy" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:13:50.437669 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.437586    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-thanos-prometheus-http-client-file" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:13:50.437669 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.437619    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-tls-assets" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:13:50.437669 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.437642    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-config-out" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:13:50.437874 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.437728    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-metrics-client-certs" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:13:50.437874 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.437816    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-config" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:13:50.438024 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.438005    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-kube-api-access-z9rlx" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "kube-api-access-z9rlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:13:50.438085 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.438064    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-grpc-tls" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:13:50.438189 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.438170    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-kube-rbac-proxy-web" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:13:50.445956 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.445934    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-web-config" pod "96e6a622-f28d-449c-9c31-08871e1fa26f" (UID: "96e6a622-f28d-449c-9c31-08871e1fa26f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:13:50.533497 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533465    5572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533497 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533494    5572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533506    5572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-kube-rbac-proxy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533516    5572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-config\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533525    5572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-metrics-client-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533554    5572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-grpc-tls\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533567    5572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533579    5572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-web-config\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533587    5572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533596    5572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-db\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533605    5572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533614    5572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96e6a622-f28d-449c-9c31-08871e1fa26f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533622    5572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533631    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9rlx\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-kube-api-access-z9rlx\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533639    5572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533648    5572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533656    5572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96e6a622-f28d-449c-9c31-08871e1fa26f-configmap-metrics-client-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533666    5572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96e6a622-f28d-449c-9c31-08871e1fa26f-tls-assets\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.533675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.533675    5572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96e6a622-f28d-449c-9c31-08871e1fa26f-config-out\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:13:50.580483 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.580454    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96e6a622-f28d-449c-9c31-08871e1fa26f","Type":"ContainerDied","Data":"8639c952e7d30ce0524ef7dc08ef7bc081bee7e3ab40736197e77b6b650bed78"}
Nov 04 01:13:50.580656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.580499    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.580656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.580552    5572 scope.go:122] "RemoveContainer" containerID="7e54e98c1699984d03e1884ed6e3fa3cf2ec779d1fdcd8726bc957001745116a"
Nov 04 01:13:50.588484 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.588351    5572 scope.go:122] "RemoveContainer" containerID="6cde29e7b3b92ef757474a1eb2bd26fa024b12a10b74911714372bd978c2dfc7"
Nov 04 01:13:50.595201 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.595185    5572 scope.go:122] "RemoveContainer" containerID="2c4f7078bf8697e8fddece8ae29d4182db57020b2eacb0225e7a8f96959b1d21"
Nov 04 01:13:50.601478 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.601464    5572 scope.go:122] "RemoveContainer" containerID="d8acbbb0647525f9f795f916308abb4c72e1848fc12867cb61ecc8fd7f9a2281"
Nov 04 01:13:50.608088 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.608066    5572 scope.go:122] "RemoveContainer" containerID="cbf4ba1b1daaa1481f1e165a5cba8e56a81e74ef9da254afa3df076cf5880fca"
Nov 04 01:13:50.615203 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.615177    5572 scope.go:122] "RemoveContainer" containerID="31d63527c1618cf5b12100cb78e0339afdb5090a84414d7a3acf4966ef844fba"
Nov 04 01:13:50.623694 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.623677    5572 scope.go:122] "RemoveContainer" containerID="3ec5dd32d8120a12658c5e06cff824a780d9cd7957a306589bce2f52b83df21a"
Nov 04 01:13:50.738070 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.738028    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 01:13:50.742232 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.742207    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 01:13:50.781927 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.781889    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 01:13:50.782252 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782233    5572 cpu_manager.go:414] "containerMap: removing container" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="thanos-sidecar"
Nov 04 01:13:50.782362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782252    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="thanos-sidecar"
Nov 04 01:13:50.782362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782273    5572 cpu_manager.go:414] "containerMap: removing container" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy-web"
Nov 04 01:13:50.782362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782281    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy-web"
Nov 04 01:13:50.782362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782293    5572 cpu_manager.go:414] "containerMap: removing container" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="config-reloader"
Nov 04 01:13:50.782362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782300    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="config-reloader"
Nov 04 01:13:50.782362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782312    5572 cpu_manager.go:414] "containerMap: removing container" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="prometheus"
Nov 04 01:13:50.782362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782319    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="prometheus"
Nov 04 01:13:50.782362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782331    5572 cpu_manager.go:414] "containerMap: removing container" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="init-config-reloader"
Nov 04 01:13:50.782362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782339    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="init-config-reloader"
Nov 04 01:13:50.782362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782354    5572 cpu_manager.go:414] "containerMap: removing container" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy"
Nov 04 01:13:50.782362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782361    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy"
Nov 04 01:13:50.782913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782371    5572 cpu_manager.go:414] "containerMap: removing container" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy-thanos"
Nov 04 01:13:50.782913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782379    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy-thanos"
Nov 04 01:13:50.782913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782450    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="thanos-sidecar"
Nov 04 01:13:50.782913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782464    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy-web"
Nov 04 01:13:50.782913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782474    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="config-reloader"
Nov 04 01:13:50.782913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782484    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="prometheus"
Nov 04 01:13:50.782913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782493    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy"
Nov 04 01:13:50.782913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.782501    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" containerName="kube-rbac-proxy-thanos"
Nov 04 01:13:50.787387 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.787363    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.836824 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.836796    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 04 01:13:50.836824 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.836797    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 04 01:13:50.837044 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.836867    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 04 01:13:50.837044 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.836883    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 04 01:13:50.837348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837333    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 04 01:13:50.837430 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837409    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 04 01:13:50.837430 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837411    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 04 01:13:50.837556 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837466    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 04 01:13:50.837556 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837471    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 04 01:13:50.837556 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837495    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jhbmd\""
Nov 04 01:13:50.837697 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837671    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 04 01:13:50.837697 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837674    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 04 01:13:50.837797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837705    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 04 01:13:50.837797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837724    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 04 01:13:50.837894 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837803    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.837945 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837913    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-web-config\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838008 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837947    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838008 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.837980    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7cl16ii3sg24k\""
Nov 04 01:13:50.838104 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838014    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838152 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838125    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838204 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838183    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838304 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838286    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838364 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838323    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnflj\" (UniqueName: \"kubernetes.io/projected/4539d83a-2619-4cc4-9323-e573091c2e15-kube-api-access-xnflj\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838364 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838354    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838431 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838411    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838442    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838502 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838465    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4539d83a-2619-4cc4-9323-e573091c2e15-config-out\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838502 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838485    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838587 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838567    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838617 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838594    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-config\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838617 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838609    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4539d83a-2619-4cc4-9323-e573091c2e15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838687 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838627    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838687 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838675    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838751 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838726    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.838785 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.838751    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.883797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.883714    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 04 01:13:50.883963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.883817    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 04 01:13:50.884573 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.884526    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 01:13:50.939070 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939039    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939214 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939079    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-config\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939214 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939097    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4539d83a-2619-4cc4-9323-e573091c2e15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939214 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939117    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939214 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939179    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939230    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939266    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939296    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939322    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-web-config\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939352    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939372    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939396    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939420    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939463    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939463    5572 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 01:13:50.939700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939497    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnflj\" (UniqueName: \"kubernetes.io/projected/4539d83a-2619-4cc4-9323-e573091c2e15-kube-api-access-xnflj\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939527    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939588    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939618    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939644    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4539d83a-2619-4cc4-9323-e573091c2e15-config-out\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.939700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939672    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.940186 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939807    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.940186 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.939925    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.940186 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.940123    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.940771 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.940749    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.940980 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.940957    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.942301 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.942275    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.943353 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.942814    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.943353 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.942999    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.943353 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.943069    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.943353 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.943313    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.943662 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.943548    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4539d83a-2619-4cc4-9323-e573091c2e15-config-out\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.943907 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.943882    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-web-config\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.944096 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.944073    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.944173 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.944119    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4539d83a-2619-4cc4-9323-e573091c2e15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.944480 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.944452    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.944669 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.944649    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4539d83a-2619-4cc4-9323-e573091c2e15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.944807 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.944793    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-config\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.945052 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.945029    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.945487 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.945472    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4539d83a-2619-4cc4-9323-e573091c2e15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:50.970571 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.970546    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96e6a622-f28d-449c-9c31-08871e1fa26f" path="/var/lib/kubelet/pods/96e6a622-f28d-449c-9c31-08871e1fa26f/volumes"
Nov 04 01:13:50.997425 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:50.997403    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnflj\" (UniqueName: \"kubernetes.io/projected/4539d83a-2619-4cc4-9323-e573091c2e15-kube-api-access-xnflj\") pod \"prometheus-k8s-0\" (UID: \"4539d83a-2619-4cc4-9323-e573091c2e15\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:51.106664 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:51.106621    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:13:51.528104 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:51.528075    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 04 01:13:51.531834 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:13:51.531802    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4539d83a_2619_4cc4_9323_e573091c2e15.slice/crio-d80817bbdf4f3785195353f2ab8c201a40feef4bc9522968ef0df7e0d1458993 WatchSource:0}: Error finding container d80817bbdf4f3785195353f2ab8c201a40feef4bc9522968ef0df7e0d1458993: Status 404 returned error can't find the container with id d80817bbdf4f3785195353f2ab8c201a40feef4bc9522968ef0df7e0d1458993
Nov 04 01:13:51.586463 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:51.586432    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4539d83a-2619-4cc4-9323-e573091c2e15","Type":"ContainerStarted","Data":"d80817bbdf4f3785195353f2ab8c201a40feef4bc9522968ef0df7e0d1458993"}
Nov 04 01:13:52.590835 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:52.590803    5572 generic.go:356] "Generic (PLEG): container finished" podID="4539d83a-2619-4cc4-9323-e573091c2e15" containerID="979233903cc6ec3a38632cd199d20c5f42ce2a15c7cb97fabff5e308c839a652" exitCode=0
Nov 04 01:13:52.591230 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:52.590893    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4539d83a-2619-4cc4-9323-e573091c2e15","Type":"ContainerDied","Data":"979233903cc6ec3a38632cd199d20c5f42ce2a15c7cb97fabff5e308c839a652"}
Nov 04 01:13:53.597971 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:53.597932    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4539d83a-2619-4cc4-9323-e573091c2e15","Type":"ContainerStarted","Data":"839b0cecb695ee92581ca9ac5fd665c83c007539055181f553685ea42dda3b01"}
Nov 04 01:13:53.598359 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:53.598004    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4539d83a-2619-4cc4-9323-e573091c2e15","Type":"ContainerStarted","Data":"c3af9ad322ed6f45b07e1f31cb830d72876167362058849778b7360e709cf962"}
Nov 04 01:13:53.598359 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:53.598032    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4539d83a-2619-4cc4-9323-e573091c2e15","Type":"ContainerStarted","Data":"d12c388e5590864844e4bca0e99fad713a8e144dc7f9233183b08816d8855488"}
Nov 04 01:13:53.598359 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:53.598061    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4539d83a-2619-4cc4-9323-e573091c2e15","Type":"ContainerStarted","Data":"28855366264d26945683f9738bab722506af99d5ce8d6dc5dfd8c1c7a14b141c"}
Nov 04 01:13:53.598359 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:53.598084    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4539d83a-2619-4cc4-9323-e573091c2e15","Type":"ContainerStarted","Data":"508c23fa41be563bd0aaedc9b398a040b80232e11f9fb73dab96f61a91df0e3b"}
Nov 04 01:13:53.598359 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:53.598106    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4539d83a-2619-4cc4-9323-e573091c2e15","Type":"ContainerStarted","Data":"f522810d3397ca5426f30fad617da3429e5e61af6bf01699afeb22359b2e50be"}
Nov 04 01:13:53.724171 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:53.724117    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.705874479 podStartE2EDuration="3.724103221s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.228742ms" isStatefulPod=false podCreationTimestamp="2026-11-04 01:13:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:13:53.723280384 +0000 UTC m=+164.873488140" watchObservedRunningTime="2026-11-04 01:13:53.724103221 +0000 UTC m=+164.874310980"
Nov 04 01:13:56.106934 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:13:56.106888    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:14:13.198309 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:14:13.198272    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:14:14.826797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:14:14.826761    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:14:19.477655 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:14:19.477564    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:14:29.575590 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:14:29.575556    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:14:43.198426 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:14:43.198388    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:14:51.106892 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:14:51.106846    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:14:51.122263 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:14:51.122239    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:14:51.808005 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:14:51.807976    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 04 01:14:56.025397 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:14:56.025360    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:14:57.186061 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:14:57.186026    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:14:59.542964 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:14:59.542927    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:14:59.685776 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:14:59.685745    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:15:13.198122 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:15:13.198079    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:15:15.164219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:15:15.164181    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:15:19.810426 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:15:19.810392    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:15:20.761198 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:15:20.761168    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:15:20.908865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:15:20.908832    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:15:29.929522 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:15:29.929484    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:15:43.198317 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:15:43.198279    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:15:44.511871 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:15:44.511833    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:15:44.653989 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:15:44.653948    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:16:13.197818 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:16:13.197779    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:16:15.558568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:16:15.558512    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:16:20.165505 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:16:20.165462    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:16:30.285178 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:16:30.285141    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:16:43.198175 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:16:43.198135    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:17:13.198668 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:17:13.198631    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:17:15.869443 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:15.869404    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:20.519102 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:20.519018    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:30.657215 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:30.657176    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:40.787012 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:40.786981    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:40.978371 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:40.978336    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:41.125609 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:41.125519    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:42.322040 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:42.322007    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:42.467458 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:42.467418    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:43.198846 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:17:43.198814    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:17:43.644878 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:43.644803    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:44.617549 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.617499    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"]
Nov 04 01:17:44.620212 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.620195    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:17:44.669017 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.668988    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 04 01:17:44.701963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.701930    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dthq9\" (UniqueName: \"kubernetes.io/projected/476cbc30-dc5f-42f2-9f05-cd4b2322d183-kube-api-access-dthq9\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:17:44.701963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.701966    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:17:44.702152 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.702101    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:17:44.715168 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.715138    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 04 01:17:44.715389 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.715375    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-4f2k8\""
Nov 04 01:17:44.715963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.715945    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"]
Nov 04 01:17:44.803391 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.803363    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:17:44.803622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.803426    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dthq9\" (UniqueName: \"kubernetes.io/projected/476cbc30-dc5f-42f2-9f05-cd4b2322d183-kube-api-access-dthq9\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:17:44.803622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.803454    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:17:44.803755 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.803741    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:17:44.803839 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.803820    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:17:44.863275 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.863239    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dthq9\" (UniqueName: \"kubernetes.io/projected/476cbc30-dc5f-42f2-9f05-cd4b2322d183-kube-api-access-dthq9\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:17:44.935282 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:44.935204    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:17:45.298867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:45.298838    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"]
Nov 04 01:17:45.302857 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:17:45.302829    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476cbc30_dc5f_42f2_9f05_cd4b2322d183.slice/crio-3edcd09355d6b51c5530c6bd03c3e8382de2bb72dd1a84feac4e60e7294ae4dd WatchSource:0}: Error finding container 3edcd09355d6b51c5530c6bd03c3e8382de2bb72dd1a84feac4e60e7294ae4dd: Status 404 returned error can't find the container with id 3edcd09355d6b51c5530c6bd03c3e8382de2bb72dd1a84feac4e60e7294ae4dd
Nov 04 01:17:45.305267 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:45.305251    5572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 01:17:45.360392 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:45.360349    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp" event={"ID":"476cbc30-dc5f-42f2-9f05-cd4b2322d183","Type":"ContainerStarted","Data":"3edcd09355d6b51c5530c6bd03c3e8382de2bb72dd1a84feac4e60e7294ae4dd"}
Nov 04 01:17:45.871983 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:45.871954    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"]
Nov 04 01:17:45.875431 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:45.875414    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:17:45.970153 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:45.970116    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-q8bkr\""
Nov 04 01:17:45.970954 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:45.970930    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"]
Nov 04 01:17:45.974228 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:45.974208    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"]
Nov 04 01:17:45.976732 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:45.976709    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:17:46.013811 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.013776    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:17:46.013981 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.013829    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlx7q\" (UniqueName: \"kubernetes.io/projected/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-kube-api-access-nlx7q\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:17:46.013981 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.013929    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:17:46.025569 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.025522    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-q4l92\""
Nov 04 01:17:46.034068 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.034042    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"]
Nov 04 01:17:46.070998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.070960    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"]
Nov 04 01:17:46.073366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.073350    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:17:46.114463 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.114433    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:17:46.114635 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.114482    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5hvh\" (UniqueName: \"kubernetes.io/projected/1e5088d8-9e23-4832-b16b-07276fda4f3c-kube-api-access-d5hvh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:17:46.114635 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.114577    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:17:46.114635 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.114630    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:17:46.114770 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.114751    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:17:46.114812 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.114800    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:17:46.114864 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.114839    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlx7q\" (UniqueName: \"kubernetes.io/projected/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-kube-api-access-nlx7q\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:17:46.114909 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.114882    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rpgj\" (UniqueName: \"kubernetes.io/projected/cb156515-96b5-4df1-a762-01b1b7d377c5-kube-api-access-9rpgj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:17:46.114961 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.114944    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:17:46.115013 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.114950    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:17:46.115165 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.115151    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:17:46.123130 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.123075    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-4n46n\""
Nov 04 01:17:46.129786 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.129760    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"]
Nov 04 01:17:46.170501 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.170474    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"]
Nov 04 01:17:46.172461 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.172429    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlx7q\" (UniqueName: \"kubernetes.io/projected/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-kube-api-access-nlx7q\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:17:46.173188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.173173    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:17:46.188938 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.188916    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:17:46.216059 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216030    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:17:46.216243 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216124    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:17:46.216243 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216171    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnlcg\" (UniqueName: \"kubernetes.io/projected/ec6763ea-e759-4474-808d-c4683bb6ca08-kube-api-access-lnlcg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:17:46.216243 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216199    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:17:46.216243 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216228    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rpgj\" (UniqueName: \"kubernetes.io/projected/cb156515-96b5-4df1-a762-01b1b7d377c5-kube-api-access-9rpgj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:17:46.216519 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216340    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:17:46.216519 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216401    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5hvh\" (UniqueName: \"kubernetes.io/projected/1e5088d8-9e23-4832-b16b-07276fda4f3c-kube-api-access-d5hvh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:17:46.216519 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216489    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:17:46.216672 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216589    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:17:46.216672 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216642    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:17:46.216746 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216691    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:17:46.216852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216833    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:17:46.216924 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.216894    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:17:46.221899 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.221878    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-vzcnq\""
Nov 04 01:17:46.228102 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.228079    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"]
Nov 04 01:17:46.273961 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.273923    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5hvh\" (UniqueName: \"kubernetes.io/projected/1e5088d8-9e23-4832-b16b-07276fda4f3c-kube-api-access-d5hvh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:17:46.274122 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.274011    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rpgj\" (UniqueName: \"kubernetes.io/projected/cb156515-96b5-4df1-a762-01b1b7d377c5-kube-api-access-9rpgj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:17:46.289729 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.289703    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:17:46.318036 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.318002    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:17:46.318165 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.318049    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnlcg\" (UniqueName: \"kubernetes.io/projected/ec6763ea-e759-4474-808d-c4683bb6ca08-kube-api-access-lnlcg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:17:46.318165 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.318118    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:17:46.318454 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.318430    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:17:46.318505 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.318449    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:17:46.376117 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.376050    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnlcg\" (UniqueName: \"kubernetes.io/projected/ec6763ea-e759-4474-808d-c4683bb6ca08-kube-api-access-lnlcg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:17:46.385763 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.385731    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:17:46.490038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.489996    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:17:46.555838 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.553238    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"]
Nov 04 01:17:46.559239 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:17:46.559208    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6973f2_f5a9_4d89_8685_e8dea8b370e1.slice/crio-add73dbca85873848d5541316b355ac100d4fefa77da4b59897bf002649164f1 WatchSource:0}: Error finding container add73dbca85873848d5541316b355ac100d4fefa77da4b59897bf002649164f1: Status 404 returned error can't find the container with id add73dbca85873848d5541316b355ac100d4fefa77da4b59897bf002649164f1
Nov 04 01:17:46.652806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.652729    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"]
Nov 04 01:17:46.656495 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:17:46.656464    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5088d8_9e23_4832_b16b_07276fda4f3c.slice/crio-2b18525d5345feb548bd18aced17e3399a18b02ff14fbc8e70d29ea15ec6577b WatchSource:0}: Error finding container 2b18525d5345feb548bd18aced17e3399a18b02ff14fbc8e70d29ea15ec6577b: Status 404 returned error can't find the container with id 2b18525d5345feb548bd18aced17e3399a18b02ff14fbc8e70d29ea15ec6577b
Nov 04 01:17:46.753281 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.753227    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"]
Nov 04 01:17:46.757224 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:17:46.757192    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb156515_96b5_4df1_a762_01b1b7d377c5.slice/crio-2a124620103f0953e0afecdf69d5ee3f27a57da02e232e4b5af211ac8a6dd4b3 WatchSource:0}: Error finding container 2a124620103f0953e0afecdf69d5ee3f27a57da02e232e4b5af211ac8a6dd4b3: Status 404 returned error can't find the container with id 2a124620103f0953e0afecdf69d5ee3f27a57da02e232e4b5af211ac8a6dd4b3
Nov 04 01:17:46.862230 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:46.862190    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"]
Nov 04 01:17:46.865497 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:17:46.865467    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6763ea_e759_4474_808d_c4683bb6ca08.slice/crio-c47fd8f33167f63f5f771f3ac64867433d1ab3b537c094a5d966f5f1c734eea4 WatchSource:0}: Error finding container c47fd8f33167f63f5f771f3ac64867433d1ab3b537c094a5d966f5f1c734eea4: Status 404 returned error can't find the container with id c47fd8f33167f63f5f771f3ac64867433d1ab3b537c094a5d966f5f1c734eea4
Nov 04 01:17:47.371017 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:47.370974    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4" event={"ID":"1e5088d8-9e23-4832-b16b-07276fda4f3c","Type":"ContainerStarted","Data":"2b18525d5345feb548bd18aced17e3399a18b02ff14fbc8e70d29ea15ec6577b"}
Nov 04 01:17:47.372293 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:47.372264    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq" event={"ID":"ec6763ea-e759-4474-808d-c4683bb6ca08","Type":"ContainerStarted","Data":"c47fd8f33167f63f5f771f3ac64867433d1ab3b537c094a5d966f5f1c734eea4"}
Nov 04 01:17:47.373663 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:47.373609    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4" event={"ID":"cb156515-96b5-4df1-a762-01b1b7d377c5","Type":"ContainerStarted","Data":"2a124620103f0953e0afecdf69d5ee3f27a57da02e232e4b5af211ac8a6dd4b3"}
Nov 04 01:17:47.374876 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:47.374843    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w" event={"ID":"fa6973f2-f5a9-4d89-8685-e8dea8b370e1","Type":"ContainerStarted","Data":"add73dbca85873848d5541316b355ac100d4fefa77da4b59897bf002649164f1"}
Nov 04 01:17:49.061696 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:49.061662    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:49.209910 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:49.209874    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:50.397495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.397459    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"]
Nov 04 01:17:50.402195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.402174    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.451618 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.451084    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kcfvk\""
Nov 04 01:17:50.458240 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.458208    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.458390 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.458264    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.458390 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.458312    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.458390 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.458350    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7861fe1b-d946-4a30-bb32-53d82f3f969b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.458688 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.458378    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.458688 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.458418    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.458688 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.458459    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.458688 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.458512    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpgdj\" (UniqueName: \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-kube-api-access-tpgdj\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.458688 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.458557    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.481311 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.481283    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 04 01:17:50.481481 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.481442    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 04 01:17:50.497156 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.497129    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 04 01:17:50.498516 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.498493    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"]
Nov 04 01:17:50.505072 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.504991    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:50.561797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.560029    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7861fe1b-d946-4a30-bb32-53d82f3f969b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.561797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.560075    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.561797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.560105    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.561797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.560151    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.561797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.560206    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpgdj\" (UniqueName: \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-kube-api-access-tpgdj\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.561797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.560241    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.561797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.560275    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.561797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.560317    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.561797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.560367    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.561797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.561428    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.562990 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.562789    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.563106 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.562993    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7861fe1b-d946-4a30-bb32-53d82f3f969b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.563511 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.563393    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.563511 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.563464    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.569585 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.569564    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.581067 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.581037    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.629524 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.629492    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.634940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.634822    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpgdj\" (UniqueName: \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-kube-api-access-tpgdj\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-wbbff\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.722920 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.722887    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:50.729133 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.728978    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:50.874114 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:50.874073    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:51.166505 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:51.166439    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"]
Nov 04 01:17:51.174309 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:17:51.174275    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7861fe1b_d946_4a30_bb32_53d82f3f969b.slice/crio-3c206fce77aec75fb613ffbaf0c4ceaf0eafe93f79a7733b67c8e1469e991fa7 WatchSource:0}: Error finding container 3c206fce77aec75fb613ffbaf0c4ceaf0eafe93f79a7733b67c8e1469e991fa7: Status 404 returned error can't find the container with id 3c206fce77aec75fb613ffbaf0c4ceaf0eafe93f79a7733b67c8e1469e991fa7
Nov 04 01:17:51.396173 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:51.396136    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" event={"ID":"7861fe1b-d946-4a30-bb32-53d82f3f969b","Type":"ContainerStarted","Data":"3c206fce77aec75fb613ffbaf0c4ceaf0eafe93f79a7733b67c8e1469e991fa7"}
Nov 04 01:17:55.030615 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:55.030498    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:17:55.425239 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:55.425057    5572 generic.go:356] "Generic (PLEG): container finished" podID="476cbc30-dc5f-42f2-9f05-cd4b2322d183" containerID="3ac55d4a74da285a458b8cf0920e111f677ba2d3bfae935595037bcb4430cd21" exitCode=0
Nov 04 01:17:55.425239 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:55.425173    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp" event={"ID":"476cbc30-dc5f-42f2-9f05-cd4b2322d183","Type":"ContainerDied","Data":"3ac55d4a74da285a458b8cf0920e111f677ba2d3bfae935595037bcb4430cd21"}
Nov 04 01:17:56.432183 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:56.432014    5572 generic.go:356] "Generic (PLEG): container finished" podID="cb156515-96b5-4df1-a762-01b1b7d377c5" containerID="2d4ef611e4a964bd2647dcd8842b277996203b8fbf473046916c894aab072e91" exitCode=0
Nov 04 01:17:56.432183 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:56.432122    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4" event={"ID":"cb156515-96b5-4df1-a762-01b1b7d377c5","Type":"ContainerDied","Data":"2d4ef611e4a964bd2647dcd8842b277996203b8fbf473046916c894aab072e91"}
Nov 04 01:17:57.436391 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:57.436363    5572 generic.go:356] "Generic (PLEG): container finished" podID="1e5088d8-9e23-4832-b16b-07276fda4f3c" containerID="0ddf89234f8309eac5db778810ff59d88e9719541db988f662b7997ba62a4f9b" exitCode=0
Nov 04 01:17:57.436760 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:57.436455    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4" event={"ID":"1e5088d8-9e23-4832-b16b-07276fda4f3c","Type":"ContainerDied","Data":"0ddf89234f8309eac5db778810ff59d88e9719541db988f662b7997ba62a4f9b"}
Nov 04 01:17:57.437901 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:57.437879    5572 generic.go:356] "Generic (PLEG): container finished" podID="ec6763ea-e759-4474-808d-c4683bb6ca08" containerID="88f1d75d698efec4ef80af4ace356ff080c27ceb21598ff59f36d2eacffd48b1" exitCode=0
Nov 04 01:17:57.437971 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:57.437935    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq" event={"ID":"ec6763ea-e759-4474-808d-c4683bb6ca08","Type":"ContainerDied","Data":"88f1d75d698efec4ef80af4ace356ff080c27ceb21598ff59f36d2eacffd48b1"}
Nov 04 01:17:57.690452 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:57.690416    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:17:57.690566 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:57.690503    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:17:57.690624 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:57.690592    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:17:58.444108 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:58.444062    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" event={"ID":"7861fe1b-d946-4a30-bb32-53d82f3f969b","Type":"ContainerStarted","Data":"7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595"}
Nov 04 01:17:58.445761 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:58.445730    5572 generic.go:356] "Generic (PLEG): container finished" podID="fa6973f2-f5a9-4d89-8685-e8dea8b370e1" containerID="ffae303879a896ca5b58a0bed7f936a0ca45e4d2ebefad895fa92ffe4564ff04" exitCode=0
Nov 04 01:17:58.445891 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:58.445776    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w" event={"ID":"fa6973f2-f5a9-4d89-8685-e8dea8b370e1","Type":"ContainerDied","Data":"ffae303879a896ca5b58a0bed7f936a0ca45e4d2ebefad895fa92ffe4564ff04"}
Nov 04 01:17:58.557489 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:58.557427    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" podStartSLOduration=2.04576359 podStartE2EDuration="8.557410796s" totalImagesPullingTime="6.511647206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:17:58.557312786 +0000 UTC m=+409.707520555" watchObservedRunningTime="2026-11-04 01:17:58.557410796 +0000 UTC m=+409.707618555"
Nov 04 01:17:58.723367 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:58.723285    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:58.730711 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:58.730678    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:59.451947 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:59.451911    5572 generic.go:356] "Generic (PLEG): container finished" podID="476cbc30-dc5f-42f2-9f05-cd4b2322d183" containerID="c09123c287154bfddb6fe280815b4aa187db239173821d685ef083584a49928e" exitCode=0
Nov 04 01:17:59.452311 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:59.451995    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp" event={"ID":"476cbc30-dc5f-42f2-9f05-cd4b2322d183","Type":"ContainerDied","Data":"c09123c287154bfddb6fe280815b4aa187db239173821d685ef083584a49928e"}
Nov 04 01:17:59.452311 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:59.452260    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:59.453337 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:59.453320    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:17:59.977524 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:59.977492    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"]
Nov 04 01:17:59.980110 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:17:59.980092    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:00.044971 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.044693    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"]
Nov 04 01:18:00.168945 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.168879    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:00.168945 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.168921    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:00.169061 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.169024    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz2tx\" (UniqueName: \"kubernetes.io/projected/6f481365-a823-49b4-bd79-30b4ea7b9c29-kube-api-access-vz2tx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:00.270158 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.270129    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:00.270291 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.270188    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:00.270291 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.270235    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz2tx\" (UniqueName: \"kubernetes.io/projected/6f481365-a823-49b4-bd79-30b4ea7b9c29-kube-api-access-vz2tx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:00.270615 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.270590    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:00.270615 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.270597    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:00.328213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.328184    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz2tx\" (UniqueName: \"kubernetes.io/projected/6f481365-a823-49b4-bd79-30b4ea7b9c29-kube-api-access-vz2tx\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:00.457913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.457880    5572 generic.go:356] "Generic (PLEG): container finished" podID="cb156515-96b5-4df1-a762-01b1b7d377c5" containerID="f1abefea9f969c4f702a644d49f5d3b5c89d5d79e345788981cc592a9795fa84" exitCode=0
Nov 04 01:18:00.458384 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.457962    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4" event={"ID":"cb156515-96b5-4df1-a762-01b1b7d377c5","Type":"ContainerDied","Data":"f1abefea9f969c4f702a644d49f5d3b5c89d5d79e345788981cc592a9795fa84"}
Nov 04 01:18:00.460037 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.460015    5572 generic.go:356] "Generic (PLEG): container finished" podID="fa6973f2-f5a9-4d89-8685-e8dea8b370e1" containerID="c87196a35f8fbbfa4e74cb4ce90d7519d5555bdc72ab3cd5f57092daf5f9c00b" exitCode=0
Nov 04 01:18:00.460117 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.460097    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w" event={"ID":"fa6973f2-f5a9-4d89-8685-e8dea8b370e1","Type":"ContainerDied","Data":"c87196a35f8fbbfa4e74cb4ce90d7519d5555bdc72ab3cd5f57092daf5f9c00b"}
Nov 04 01:18:00.462377 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.462356    5572 generic.go:356] "Generic (PLEG): container finished" podID="1e5088d8-9e23-4832-b16b-07276fda4f3c" containerID="4cc0b8394d06aabf618352ad6adf36ef96831420a56e8d41b51bbd94085fb06a" exitCode=0
Nov 04 01:18:00.462464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.462433    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4" event={"ID":"1e5088d8-9e23-4832-b16b-07276fda4f3c","Type":"ContainerDied","Data":"4cc0b8394d06aabf618352ad6adf36ef96831420a56e8d41b51bbd94085fb06a"}
Nov 04 01:18:00.594062 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.593985    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:00.976941 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:00.976877    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"]
Nov 04 01:18:01.469381 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:01.469344    5572 generic.go:356] "Generic (PLEG): container finished" podID="ec6763ea-e759-4474-808d-c4683bb6ca08" containerID="66a6cce811304ac6586b569065a7b3ad21c6b09eec68b2d0f90ecdd17dc612a1" exitCode=0
Nov 04 01:18:01.469875 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:01.469389    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq" event={"ID":"ec6763ea-e759-4474-808d-c4683bb6ca08","Type":"ContainerDied","Data":"66a6cce811304ac6586b569065a7b3ad21c6b09eec68b2d0f90ecdd17dc612a1"}
Nov 04 01:18:01.471257 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:01.471230    5572 generic.go:356] "Generic (PLEG): container finished" podID="6f481365-a823-49b4-bd79-30b4ea7b9c29" containerID="8660c6b523aeb6c37aa490339a9a1c1a7693b327a876572e1a665854e169e403" exitCode=0
Nov 04 01:18:01.471892 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:01.471874    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k" event={"ID":"6f481365-a823-49b4-bd79-30b4ea7b9c29","Type":"ContainerDied","Data":"8660c6b523aeb6c37aa490339a9a1c1a7693b327a876572e1a665854e169e403"}
Nov 04 01:18:01.471981 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:01.471916    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k" event={"ID":"6f481365-a823-49b4-bd79-30b4ea7b9c29","Type":"ContainerStarted","Data":"88351b3f010f89abb6276e8eddd851d3546c32f55c6207577d681f7a4342a7a6"}
Nov 04 01:18:02.481861 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:02.481020    5572 generic.go:356] "Generic (PLEG): container finished" podID="6f481365-a823-49b4-bd79-30b4ea7b9c29" containerID="d45ef4426253dfe2f3842e42969073f7c3cf67f42ce9f7976b533e3d5c19dd62" exitCode=0
Nov 04 01:18:02.481861 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:02.481139    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k" event={"ID":"6f481365-a823-49b4-bd79-30b4ea7b9c29","Type":"ContainerDied","Data":"d45ef4426253dfe2f3842e42969073f7c3cf67f42ce9f7976b533e3d5c19dd62"}
Nov 04 01:18:12.561843 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:12.561381    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp" event={"ID":"476cbc30-dc5f-42f2-9f05-cd4b2322d183","Type":"ContainerStarted","Data":"9329e0a04a2e6c01edd2154b19615b24563fc10756a61115748dcf57731ceb62"}
Nov 04 01:18:13.214132 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:18:13.214054    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:18:13.569351 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.569264    5572 generic.go:356] "Generic (PLEG): container finished" podID="476cbc30-dc5f-42f2-9f05-cd4b2322d183" containerID="9329e0a04a2e6c01edd2154b19615b24563fc10756a61115748dcf57731ceb62" exitCode=0
Nov 04 01:18:13.569833 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.569403    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp" event={"ID":"476cbc30-dc5f-42f2-9f05-cd4b2322d183","Type":"ContainerDied","Data":"9329e0a04a2e6c01edd2154b19615b24563fc10756a61115748dcf57731ceb62"}
Nov 04 01:18:13.724430 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.724396    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:18:13.796934 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.796908    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/476cbc30-dc5f-42f2-9f05-cd4b2322d183-kube-api-access-dthq9\" (UniqueName: \"kubernetes.io/projected/476cbc30-dc5f-42f2-9f05-cd4b2322d183-kube-api-access-dthq9\") pod \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") "
Nov 04 01:18:13.797069 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.796949    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-bundle\" (UniqueName: \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-bundle\") pod \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") "
Nov 04 01:18:13.797069 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.796976    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-util\" (UniqueName: \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-util\") pod \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\" (UID: \"476cbc30-dc5f-42f2-9f05-cd4b2322d183\") "
Nov 04 01:18:13.797469 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.797440    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-bundle" pod "476cbc30-dc5f-42f2-9f05-cd4b2322d183" (UID: "476cbc30-dc5f-42f2-9f05-cd4b2322d183"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:13.799881 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.799848    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/476cbc30-dc5f-42f2-9f05-cd4b2322d183-kube-api-access-dthq9" pod "476cbc30-dc5f-42f2-9f05-cd4b2322d183" (UID: "476cbc30-dc5f-42f2-9f05-cd4b2322d183"). InnerVolumeSpecName "kube-api-access-dthq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:18:13.804427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.804393    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-util" pod "476cbc30-dc5f-42f2-9f05-cd4b2322d183" (UID: "476cbc30-dc5f-42f2-9f05-cd4b2322d183"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:13.898136 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.898107    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dthq9\" (UniqueName: \"kubernetes.io/projected/476cbc30-dc5f-42f2-9f05-cd4b2322d183-kube-api-access-dthq9\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:13.898297 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.898141    5572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-bundle\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:13.898297 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:13.898158    5572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/476cbc30-dc5f-42f2-9f05-cd4b2322d183-util\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:14.576596 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:14.576418    5572 generic.go:356] "Generic (PLEG): container finished" podID="cb156515-96b5-4df1-a762-01b1b7d377c5" containerID="e1055b5bf9e363eee1fee85f9ba072f1fea56c3b4124e3efaf038e4833e9f8d4" exitCode=0
Nov 04 01:18:14.576596 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:14.576513    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4" event={"ID":"cb156515-96b5-4df1-a762-01b1b7d377c5","Type":"ContainerDied","Data":"e1055b5bf9e363eee1fee85f9ba072f1fea56c3b4124e3efaf038e4833e9f8d4"}
Nov 04 01:18:14.579598 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:14.579325    5572 generic.go:356] "Generic (PLEG): container finished" podID="fa6973f2-f5a9-4d89-8685-e8dea8b370e1" containerID="6393a15a3a98ae6270b1cffb84e65920187ec62b73805c90e06c288dd17a4438" exitCode=0
Nov 04 01:18:14.579598 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:14.579421    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w" event={"ID":"fa6973f2-f5a9-4d89-8685-e8dea8b370e1","Type":"ContainerDied","Data":"6393a15a3a98ae6270b1cffb84e65920187ec62b73805c90e06c288dd17a4438"}
Nov 04 01:18:14.583320 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:14.581931    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp" event={"ID":"476cbc30-dc5f-42f2-9f05-cd4b2322d183","Type":"ContainerDied","Data":"3edcd09355d6b51c5530c6bd03c3e8382de2bb72dd1a84feac4e60e7294ae4dd"}
Nov 04 01:18:14.583320 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:14.581970    5572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3edcd09355d6b51c5530c6bd03c3e8382de2bb72dd1a84feac4e60e7294ae4dd"
Nov 04 01:18:14.583320 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:14.582032    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b26wp"
Nov 04 01:18:14.589899 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:14.589872    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4" event={"ID":"1e5088d8-9e23-4832-b16b-07276fda4f3c","Type":"ContainerStarted","Data":"4ec5a3f8c4a65dbdda28f1176fcfc65998adf0fa1faf871949910f2670f5a720"}
Nov 04 01:18:14.955650 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:14.955598    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4" podStartSLOduration=3.584890136 podStartE2EDuration="29.955583069s" totalImagesPullingTime="26.370692933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:17:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:18:14.954865755 +0000 UTC m=+426.105073517" watchObservedRunningTime="2026-11-04 01:18:14.955583069 +0000 UTC m=+426.105791105"
Nov 04 01:18:15.596033 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.595995    5572 generic.go:356] "Generic (PLEG): container finished" podID="ec6763ea-e759-4474-808d-c4683bb6ca08" containerID="a84328a8bc205d7907aac6d5a6b24afc51ca5f9170be68852f6ed66ab9351d96" exitCode=0
Nov 04 01:18:15.596468 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.596085    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq" event={"ID":"ec6763ea-e759-4474-808d-c4683bb6ca08","Type":"ContainerDied","Data":"a84328a8bc205d7907aac6d5a6b24afc51ca5f9170be68852f6ed66ab9351d96"}
Nov 04 01:18:15.598160 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.598131    5572 generic.go:356] "Generic (PLEG): container finished" podID="1e5088d8-9e23-4832-b16b-07276fda4f3c" containerID="4ec5a3f8c4a65dbdda28f1176fcfc65998adf0fa1faf871949910f2670f5a720" exitCode=0
Nov 04 01:18:15.598282 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.598213    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4" event={"ID":"1e5088d8-9e23-4832-b16b-07276fda4f3c","Type":"ContainerDied","Data":"4ec5a3f8c4a65dbdda28f1176fcfc65998adf0fa1faf871949910f2670f5a720"}
Nov 04 01:18:15.600094 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.600075    5572 generic.go:356] "Generic (PLEG): container finished" podID="6f481365-a823-49b4-bd79-30b4ea7b9c29" containerID="bb445c65e9adefb517e35834b89f518541bd7999e1fd83ce48a6efca6b6e4d73" exitCode=0
Nov 04 01:18:15.600224 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.600156    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k" event={"ID":"6f481365-a823-49b4-bd79-30b4ea7b9c29","Type":"ContainerDied","Data":"bb445c65e9adefb517e35834b89f518541bd7999e1fd83ce48a6efca6b6e4d73"}
Nov 04 01:18:15.714442 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.714414    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:15.727359 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.727334    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:18:15.755467 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.755448    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:18:15.815490 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.815461    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-kube-api-access-nlx7q\" (UniqueName: \"kubernetes.io/projected/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-kube-api-access-nlx7q\") pod \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") "
Nov 04 01:18:15.815686 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.815515    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-util\" (UniqueName: \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-util\") pod \"cb156515-96b5-4df1-a762-01b1b7d377c5\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") "
Nov 04 01:18:15.815686 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.815580    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-bundle\") pod \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") "
Nov 04 01:18:15.815686 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.815609    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb156515-96b5-4df1-a762-01b1b7d377c5-kube-api-access-9rpgj\" (UniqueName: \"kubernetes.io/projected/cb156515-96b5-4df1-a762-01b1b7d377c5-kube-api-access-9rpgj\") pod \"cb156515-96b5-4df1-a762-01b1b7d377c5\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") "
Nov 04 01:18:15.815686 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.815654    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-bundle\") pod \"cb156515-96b5-4df1-a762-01b1b7d377c5\" (UID: \"cb156515-96b5-4df1-a762-01b1b7d377c5\") "
Nov 04 01:18:15.816652 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.815702    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-util\" (UniqueName: \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-util\") pod \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\" (UID: \"fa6973f2-f5a9-4d89-8685-e8dea8b370e1\") "
Nov 04 01:18:15.816652 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.816197    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-bundle" pod "fa6973f2-f5a9-4d89-8685-e8dea8b370e1" (UID: "fa6973f2-f5a9-4d89-8685-e8dea8b370e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:15.816652 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.816513    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-bundle" pod "cb156515-96b5-4df1-a762-01b1b7d377c5" (UID: "cb156515-96b5-4df1-a762-01b1b7d377c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:15.818329 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.818301    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-kube-api-access-nlx7q" pod "fa6973f2-f5a9-4d89-8685-e8dea8b370e1" (UID: "fa6973f2-f5a9-4d89-8685-e8dea8b370e1"). InnerVolumeSpecName "kube-api-access-nlx7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:18:15.818568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.818545    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb156515-96b5-4df1-a762-01b1b7d377c5-kube-api-access-9rpgj" pod "cb156515-96b5-4df1-a762-01b1b7d377c5" (UID: "cb156515-96b5-4df1-a762-01b1b7d377c5"). InnerVolumeSpecName "kube-api-access-9rpgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:18:15.820774 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.820753    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-util" pod "cb156515-96b5-4df1-a762-01b1b7d377c5" (UID: "cb156515-96b5-4df1-a762-01b1b7d377c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:15.820886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.820865    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-util" pod "fa6973f2-f5a9-4d89-8685-e8dea8b370e1" (UID: "fa6973f2-f5a9-4d89-8685-e8dea8b370e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:15.862209 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.862155    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:15.916339 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.916264    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlx7q\" (UniqueName: \"kubernetes.io/projected/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-kube-api-access-nlx7q\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:15.916339 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.916291    5572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-util\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:15.916339 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.916301    5572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-bundle\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:15.916339 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.916309    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rpgj\" (UniqueName: \"kubernetes.io/projected/cb156515-96b5-4df1-a762-01b1b7d377c5-kube-api-access-9rpgj\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:15.916339 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.916320    5572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb156515-96b5-4df1-a762-01b1b7d377c5-bundle\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:15.916339 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:15.916329    5572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa6973f2-f5a9-4d89-8685-e8dea8b370e1-util\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:16.605621 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.605576    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4" event={"ID":"cb156515-96b5-4df1-a762-01b1b7d377c5","Type":"ContainerDied","Data":"2a124620103f0953e0afecdf69d5ee3f27a57da02e232e4b5af211ac8a6dd4b3"}
Nov 04 01:18:16.606083 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.605587    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79gzr4"
Nov 04 01:18:16.606083 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.605670    5572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a124620103f0953e0afecdf69d5ee3f27a57da02e232e4b5af211ac8a6dd4b3"
Nov 04 01:18:16.607590 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.607562    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w" event={"ID":"fa6973f2-f5a9-4d89-8685-e8dea8b370e1","Type":"ContainerDied","Data":"add73dbca85873848d5541316b355ac100d4fefa77da4b59897bf002649164f1"}
Nov 04 01:18:16.607590 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.607587    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c68wh9w"
Nov 04 01:18:16.607785 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.607611    5572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="add73dbca85873848d5541316b355ac100d4fefa77da4b59897bf002649164f1"
Nov 04 01:18:16.749140 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.749115    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:18:16.777330 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.777308    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:16.780135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.780117    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:18:16.824929 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.824897    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-bundle\") pod \"ec6763ea-e759-4474-808d-c4683bb6ca08\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") "
Nov 04 01:18:16.825051 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.824973    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e5088d8-9e23-4832-b16b-07276fda4f3c-kube-api-access-d5hvh\" (UniqueName: \"kubernetes.io/projected/1e5088d8-9e23-4832-b16b-07276fda4f3c-kube-api-access-d5hvh\") pod \"1e5088d8-9e23-4832-b16b-07276fda4f3c\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") "
Nov 04 01:18:16.825051 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.825011    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ec6763ea-e759-4474-808d-c4683bb6ca08-kube-api-access-lnlcg\" (UniqueName: \"kubernetes.io/projected/ec6763ea-e759-4474-808d-c4683bb6ca08-kube-api-access-lnlcg\") pod \"ec6763ea-e759-4474-808d-c4683bb6ca08\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") "
Nov 04 01:18:16.825051 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.825045    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-bundle\") pod \"6f481365-a823-49b4-bd79-30b4ea7b9c29\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") "
Nov 04 01:18:16.825151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.825099    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-util\" (UniqueName: \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-util\") pod \"1e5088d8-9e23-4832-b16b-07276fda4f3c\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") "
Nov 04 01:18:16.825151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.825129    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-util\" (UniqueName: \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-util\") pod \"6f481365-a823-49b4-bd79-30b4ea7b9c29\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") "
Nov 04 01:18:16.825216 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.825157    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-bundle\") pod \"1e5088d8-9e23-4832-b16b-07276fda4f3c\" (UID: \"1e5088d8-9e23-4832-b16b-07276fda4f3c\") "
Nov 04 01:18:16.825216 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.825206    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-util\" (UniqueName: \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-util\") pod \"ec6763ea-e759-4474-808d-c4683bb6ca08\" (UID: \"ec6763ea-e759-4474-808d-c4683bb6ca08\") "
Nov 04 01:18:16.825296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.825235    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f481365-a823-49b4-bd79-30b4ea7b9c29-kube-api-access-vz2tx\" (UniqueName: \"kubernetes.io/projected/6f481365-a823-49b4-bd79-30b4ea7b9c29-kube-api-access-vz2tx\") pod \"6f481365-a823-49b4-bd79-30b4ea7b9c29\" (UID: \"6f481365-a823-49b4-bd79-30b4ea7b9c29\") "
Nov 04 01:18:16.826146 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.826009    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-bundle" pod "1e5088d8-9e23-4832-b16b-07276fda4f3c" (UID: "1e5088d8-9e23-4832-b16b-07276fda4f3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:16.826146 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.826042    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-bundle" pod "ec6763ea-e759-4474-808d-c4683bb6ca08" (UID: "ec6763ea-e759-4474-808d-c4683bb6ca08"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:16.827173 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.827135    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-bundle" pod "6f481365-a823-49b4-bd79-30b4ea7b9c29" (UID: "6f481365-a823-49b4-bd79-30b4ea7b9c29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:16.827285 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.827217    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e5088d8-9e23-4832-b16b-07276fda4f3c-kube-api-access-d5hvh" pod "1e5088d8-9e23-4832-b16b-07276fda4f3c" (UID: "1e5088d8-9e23-4832-b16b-07276fda4f3c"). InnerVolumeSpecName "kube-api-access-d5hvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:18:16.827389 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.827372    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6763ea-e759-4474-808d-c4683bb6ca08-kube-api-access-lnlcg" pod "ec6763ea-e759-4474-808d-c4683bb6ca08" (UID: "ec6763ea-e759-4474-808d-c4683bb6ca08"). InnerVolumeSpecName "kube-api-access-lnlcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:18:16.827475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.827461    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f481365-a823-49b4-bd79-30b4ea7b9c29-kube-api-access-vz2tx" pod "6f481365-a823-49b4-bd79-30b4ea7b9c29" (UID: "6f481365-a823-49b4-bd79-30b4ea7b9c29"). InnerVolumeSpecName "kube-api-access-vz2tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:18:16.831992 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.831967    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-util" pod "ec6763ea-e759-4474-808d-c4683bb6ca08" (UID: "ec6763ea-e759-4474-808d-c4683bb6ca08"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:16.833999 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.833963    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-util" pod "6f481365-a823-49b4-bd79-30b4ea7b9c29" (UID: "6f481365-a823-49b4-bd79-30b4ea7b9c29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:16.834525 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.834508    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-util" pod "1e5088d8-9e23-4832-b16b-07276fda4f3c" (UID: "1e5088d8-9e23-4832-b16b-07276fda4f3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:16.926279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.926203    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5hvh\" (UniqueName: \"kubernetes.io/projected/1e5088d8-9e23-4832-b16b-07276fda4f3c-kube-api-access-d5hvh\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:16.926279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.926229    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnlcg\" (UniqueName: \"kubernetes.io/projected/ec6763ea-e759-4474-808d-c4683bb6ca08-kube-api-access-lnlcg\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:16.926279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.926239    5572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-bundle\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:16.926279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.926249    5572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-util\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:16.926279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.926257    5572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f481365-a823-49b4-bd79-30b4ea7b9c29-util\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:16.926279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.926264    5572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e5088d8-9e23-4832-b16b-07276fda4f3c-bundle\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:16.926279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.926272    5572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-util\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:16.926279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.926281    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz2tx\" (UniqueName: \"kubernetes.io/projected/6f481365-a823-49b4-bd79-30b4ea7b9c29-kube-api-access-vz2tx\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:16.926664 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:16.926290    5572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec6763ea-e759-4474-808d-c4683bb6ca08-bundle\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:17.613462 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:17.613433    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4"
Nov 04 01:18:17.613915 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:17.613435    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cgq5z4" event={"ID":"1e5088d8-9e23-4832-b16b-07276fda4f3c","Type":"ContainerDied","Data":"2b18525d5345feb548bd18aced17e3399a18b02ff14fbc8e70d29ea15ec6577b"}
Nov 04 01:18:17.613915 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:17.613567    5572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b18525d5345feb548bd18aced17e3399a18b02ff14fbc8e70d29ea15ec6577b"
Nov 04 01:18:17.615393 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:17.615337    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k"
Nov 04 01:18:17.615512 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:17.615340    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6nwb9k" event={"ID":"6f481365-a823-49b4-bd79-30b4ea7b9c29","Type":"ContainerDied","Data":"88351b3f010f89abb6276e8eddd851d3546c32f55c6207577d681f7a4342a7a6"}
Nov 04 01:18:17.615512 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:17.615457    5572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88351b3f010f89abb6276e8eddd851d3546c32f55c6207577d681f7a4342a7a6"
Nov 04 01:18:17.617425 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:17.617404    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq" event={"ID":"ec6763ea-e759-4474-808d-c4683bb6ca08","Type":"ContainerDied","Data":"c47fd8f33167f63f5f771f3ac64867433d1ab3b537c094a5d966f5f1c734eea4"}
Nov 04 01:18:17.617524 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:17.617442    5572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c47fd8f33167f63f5f771f3ac64867433d1ab3b537c094a5d966f5f1c734eea4"
Nov 04 01:18:17.617524 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:17.617501    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar47mq"
Nov 04 01:18:20.864799 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:20.864761    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:25.359331 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:25.359297    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:25.504894 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:25.504852    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:26.244791 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.244762    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:26.439847 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.439817    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"]
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440094    5572 cpu_manager.go:414] "containerMap: removing container" podUID="1e5088d8-9e23-4832-b16b-07276fda4f3c" containerName="extract"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440104    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e5088d8-9e23-4832-b16b-07276fda4f3c" containerName="extract"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440119    5572 cpu_manager.go:414] "containerMap: removing container" podUID="cb156515-96b5-4df1-a762-01b1b7d377c5" containerName="pull"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440124    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb156515-96b5-4df1-a762-01b1b7d377c5" containerName="pull"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440131    5572 cpu_manager.go:414] "containerMap: removing container" podUID="6f481365-a823-49b4-bd79-30b4ea7b9c29" containerName="util"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440136    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f481365-a823-49b4-bd79-30b4ea7b9c29" containerName="util"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440143    5572 cpu_manager.go:414] "containerMap: removing container" podUID="476cbc30-dc5f-42f2-9f05-cd4b2322d183" containerName="extract"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440148    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="476cbc30-dc5f-42f2-9f05-cd4b2322d183" containerName="extract"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440154    5572 cpu_manager.go:414] "containerMap: removing container" podUID="cb156515-96b5-4df1-a762-01b1b7d377c5" containerName="extract"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440159    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb156515-96b5-4df1-a762-01b1b7d377c5" containerName="extract"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440168    5572 cpu_manager.go:414] "containerMap: removing container" podUID="1e5088d8-9e23-4832-b16b-07276fda4f3c" containerName="util"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440172    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e5088d8-9e23-4832-b16b-07276fda4f3c" containerName="util"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440178    5572 cpu_manager.go:414] "containerMap: removing container" podUID="6f481365-a823-49b4-bd79-30b4ea7b9c29" containerName="pull"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440182    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f481365-a823-49b4-bd79-30b4ea7b9c29" containerName="pull"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440188    5572 cpu_manager.go:414] "containerMap: removing container" podUID="fa6973f2-f5a9-4d89-8685-e8dea8b370e1" containerName="extract"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440193    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa6973f2-f5a9-4d89-8685-e8dea8b370e1" containerName="extract"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440200    5572 cpu_manager.go:414] "containerMap: removing container" podUID="cb156515-96b5-4df1-a762-01b1b7d377c5" containerName="util"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440204    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb156515-96b5-4df1-a762-01b1b7d377c5" containerName="util"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440218    5572 cpu_manager.go:414] "containerMap: removing container" podUID="fa6973f2-f5a9-4d89-8685-e8dea8b370e1" containerName="util"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440224    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa6973f2-f5a9-4d89-8685-e8dea8b370e1" containerName="util"
Nov 04 01:18:26.440219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440229    5572 cpu_manager.go:414] "containerMap: removing container" podUID="1e5088d8-9e23-4832-b16b-07276fda4f3c" containerName="pull"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440234    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e5088d8-9e23-4832-b16b-07276fda4f3c" containerName="pull"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440240    5572 cpu_manager.go:414] "containerMap: removing container" podUID="ec6763ea-e759-4474-808d-c4683bb6ca08" containerName="extract"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440243    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ec6763ea-e759-4474-808d-c4683bb6ca08" containerName="extract"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440249    5572 cpu_manager.go:414] "containerMap: removing container" podUID="6f481365-a823-49b4-bd79-30b4ea7b9c29" containerName="extract"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440254    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f481365-a823-49b4-bd79-30b4ea7b9c29" containerName="extract"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440262    5572 cpu_manager.go:414] "containerMap: removing container" podUID="476cbc30-dc5f-42f2-9f05-cd4b2322d183" containerName="util"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440266    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="476cbc30-dc5f-42f2-9f05-cd4b2322d183" containerName="util"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440273    5572 cpu_manager.go:414] "containerMap: removing container" podUID="476cbc30-dc5f-42f2-9f05-cd4b2322d183" containerName="pull"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440277    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="476cbc30-dc5f-42f2-9f05-cd4b2322d183" containerName="pull"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440285    5572 cpu_manager.go:414] "containerMap: removing container" podUID="ec6763ea-e759-4474-808d-c4683bb6ca08" containerName="pull"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440289    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ec6763ea-e759-4474-808d-c4683bb6ca08" containerName="pull"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440297    5572 cpu_manager.go:414] "containerMap: removing container" podUID="fa6973f2-f5a9-4d89-8685-e8dea8b370e1" containerName="pull"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440301    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa6973f2-f5a9-4d89-8685-e8dea8b370e1" containerName="pull"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440308    5572 cpu_manager.go:414] "containerMap: removing container" podUID="ec6763ea-e759-4474-808d-c4683bb6ca08" containerName="util"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440311    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ec6763ea-e759-4474-808d-c4683bb6ca08" containerName="util"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440350    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="476cbc30-dc5f-42f2-9f05-cd4b2322d183" containerName="extract"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440357    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="cb156515-96b5-4df1-a762-01b1b7d377c5" containerName="extract"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440363    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa6973f2-f5a9-4d89-8685-e8dea8b370e1" containerName="extract"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440370    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="ec6763ea-e759-4474-808d-c4683bb6ca08" containerName="extract"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440375    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f481365-a823-49b4-bd79-30b4ea7b9c29" containerName="extract"
Nov 04 01:18:26.440890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.440382    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e5088d8-9e23-4832-b16b-07276fda4f3c" containerName="extract"
Nov 04 01:18:26.442615 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.442597    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.492326 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.492293    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 04 01:18:26.492508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.492367    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 04 01:18:26.492637 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.492617    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-7sbgk\""
Nov 04 01:18:26.492717 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.492703    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 04 01:18:26.492778 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.492727    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 04 01:18:26.492831 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.492792    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 04 01:18:26.498138 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.498088    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-tmp\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.498138 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.498126    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khwpx\" (UniqueName: \"kubernetes.io/projected/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-kube-api-access-khwpx\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.498287 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.498154    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-metrics-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.498287 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.498207    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.498372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.498296    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-manifests\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.498372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.498361    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.516012 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.515976    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:26.557020 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.556991    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"]
Nov 04 01:18:26.599103 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.599081    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-tmp\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.599262 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.599113    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khwpx\" (UniqueName: \"kubernetes.io/projected/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-kube-api-access-khwpx\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.599262 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.599138    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-metrics-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.599386 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.599264    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.599386 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.599310    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-manifests\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.599489 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.599389    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.599733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.599700    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-manifests\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.601756 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.601722    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-tmp\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.601856 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.601775    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.601911 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.601871    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.602016 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.601988    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-metrics-cert\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.656594 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.656561    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khwpx\" (UniqueName: \"kubernetes.io/projected/77df9b1b-2f85-4afd-84d2-eaf83e4b2fae-kube-api-access-khwpx\") pod \"opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2\" (UID: \"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.675473 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.675444    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:26.755351 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.755282    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:26.818269 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:26.818234    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:27.280086 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:27.280052    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"]
Nov 04 01:18:27.284546 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:18:27.284510    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77df9b1b_2f85_4afd_84d2_eaf83e4b2fae.slice/crio-76d84155692c4364c12f0273c890763e4b9d3d71df36d952b794470e07b15ab8 WatchSource:0}: Error finding container 76d84155692c4364c12f0273c890763e4b9d3d71df36d952b794470e07b15ab8: Status 404 returned error can't find the container with id 76d84155692c4364c12f0273c890763e4b9d3d71df36d952b794470e07b15ab8
Nov 04 01:18:27.657667 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:27.657586    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2" event={"ID":"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae","Type":"ContainerStarted","Data":"76d84155692c4364c12f0273c890763e4b9d3d71df36d952b794470e07b15ab8"}
Nov 04 01:18:27.813339 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:27.813297    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:27.961021 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:27.960994    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:29.160330 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:29.160294    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:29.306883 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:29.306837    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:31.019499 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:31.019438    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:31.676907 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:31.676879    5572 generic.go:356] "Generic (PLEG): container finished" podID="77df9b1b-2f85-4afd-84d2-eaf83e4b2fae" containerID="ddcae84202c2256fe3328526da0cc711311eccdcc8db4aae0e461bcba15228d9" exitCode=0
Nov 04 01:18:31.677044 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:31.676956    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2" event={"ID":"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae","Type":"ContainerDied","Data":"ddcae84202c2256fe3328526da0cc711311eccdcc8db4aae0e461bcba15228d9"}
Nov 04 01:18:31.943663 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:31.943624    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:33.170881 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:33.170848    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:33.687564 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:33.687520    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2" event={"ID":"77df9b1b-2f85-4afd-84d2-eaf83e4b2fae","Type":"ContainerStarted","Data":"766ed114b79a04dc0336534962e66afb4a1c08a136adf68bc2343ac14e51d6b2"}
Nov 04 01:18:33.687767 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:33.687652    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:33.957319 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:33.957271    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2" podStartSLOduration=2.666435609 podStartE2EDuration="7.957253324s" totalImagesPullingTime="4.80382028s" totalInitContainerRuntime="486.997435ms" isStatefulPod=false podCreationTimestamp="2026-11-04 01:18:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:18:33.911242921 +0000 UTC m=+445.061450680" watchObservedRunningTime="2026-11-04 01:18:33.957253324 +0000 UTC m=+445.107461084"
Nov 04 01:18:35.153898 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:35.153866    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:35.331584 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:35.331527    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:37.595447 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:37.595413    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-4sws9"]
Nov 04 01:18:37.600176 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:37.600152    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-4sws9"
Nov 04 01:18:37.649155 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:37.649130    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 04 01:18:37.695285 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:37.695250    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zt58p\""
Nov 04 01:18:37.695285 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:37.695255    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 04 01:18:37.696365 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:37.696345    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-4sws9"]
Nov 04 01:18:37.698745 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:37.698725    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff9qg\" (UniqueName: \"kubernetes.io/projected/0baa384c-8887-4f98-a48c-bbc5dcdbdd7b-kube-api-access-ff9qg\") pod \"authorino-operator-7b7bb4bc77-4sws9\" (UID: \"0baa384c-8887-4f98-a48c-bbc5dcdbdd7b\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-4sws9"
Nov 04 01:18:37.800172 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:37.800139    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff9qg\" (UniqueName: \"kubernetes.io/projected/0baa384c-8887-4f98-a48c-bbc5dcdbdd7b-kube-api-access-ff9qg\") pod \"authorino-operator-7b7bb4bc77-4sws9\" (UID: \"0baa384c-8887-4f98-a48c-bbc5dcdbdd7b\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-4sws9"
Nov 04 01:18:37.857298 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:37.857231    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff9qg\" (UniqueName: \"kubernetes.io/projected/0baa384c-8887-4f98-a48c-bbc5dcdbdd7b-kube-api-access-ff9qg\") pod \"authorino-operator-7b7bb4bc77-4sws9\" (UID: \"0baa384c-8887-4f98-a48c-bbc5dcdbdd7b\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-4sws9"
Nov 04 01:18:37.911794 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:37.911763    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-4sws9"
Nov 04 01:18:38.274490 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:38.274457    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-4sws9"]
Nov 04 01:18:38.277791 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:18:38.277760    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0baa384c_8887_4f98_a48c_bbc5dcdbdd7b.slice/crio-1914888d0a1d5596bd0eb1943fbda01d670683057b712d293d64b190abd2bd63 WatchSource:0}: Error finding container 1914888d0a1d5596bd0eb1943fbda01d670683057b712d293d64b190abd2bd63: Status 404 returned error can't find the container with id 1914888d0a1d5596bd0eb1943fbda01d670683057b712d293d64b190abd2bd63
Nov 04 01:18:38.707353 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:38.707320    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-4sws9" event={"ID":"0baa384c-8887-4f98-a48c-bbc5dcdbdd7b","Type":"ContainerStarted","Data":"1914888d0a1d5596bd0eb1943fbda01d670683057b712d293d64b190abd2bd63"}
Nov 04 01:18:38.737287 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:38.737255    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:39.178628 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:39.178520    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:39.409219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:39.409180    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:39.561162 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:39.561117    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:40.047109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.047073    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"]
Nov 04 01:18:40.050514 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.050494    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:40.099279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.099247    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 04 01:18:40.099279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.099259    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 04 01:18:40.099485 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.099357    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-4f2k8\""
Nov 04 01:18:40.118675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.118647    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:40.118800 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.118688    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkcdg\" (UniqueName: \"kubernetes.io/projected/492900ca-9e62-4ef4-95d5-d3ec1ec48529-kube-api-access-lkcdg\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:40.118800 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.118770    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:40.146289 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.146254    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"]
Nov 04 01:18:40.219576 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.219548    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkcdg\" (UniqueName: \"kubernetes.io/projected/492900ca-9e62-4ef4-95d5-d3ec1ec48529-kube-api-access-lkcdg\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:40.219716 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.219588    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:40.219716 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.219688    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:40.219998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.219974    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:40.220038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.220003    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:40.319865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.319788    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkcdg\" (UniqueName: \"kubernetes.io/projected/492900ca-9e62-4ef4-95d5-d3ec1ec48529-kube-api-access-lkcdg\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:40.364206 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.364177    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:40.581958 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.581871    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:40.769666 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:40.769635    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"]
Nov 04 01:18:40.773960 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:18:40.773927    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod492900ca_9e62_4ef4_95d5_d3ec1ec48529.slice/crio-0438c3741e3458fa98491d78fe825c39fe1e72f333a0bcdb7c3e60ef9d213dcf WatchSource:0}: Error finding container 0438c3741e3458fa98491d78fe825c39fe1e72f333a0bcdb7c3e60ef9d213dcf: Status 404 returned error can't find the container with id 0438c3741e3458fa98491d78fe825c39fe1e72f333a0bcdb7c3e60ef9d213dcf
Nov 04 01:18:41.721113 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:41.721072    5572 generic.go:356] "Generic (PLEG): container finished" podID="492900ca-9e62-4ef4-95d5-d3ec1ec48529" containerID="7cde6f51defed6e0ab49bc1f360d73f77f7f51c07f66abb04c23adcaab14893b" exitCode=0
Nov 04 01:18:41.721561 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:41.721132    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt" event={"ID":"492900ca-9e62-4ef4-95d5-d3ec1ec48529","Type":"ContainerDied","Data":"7cde6f51defed6e0ab49bc1f360d73f77f7f51c07f66abb04c23adcaab14893b"}
Nov 04 01:18:41.721561 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:41.721178    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt" event={"ID":"492900ca-9e62-4ef4-95d5-d3ec1ec48529","Type":"ContainerStarted","Data":"0438c3741e3458fa98491d78fe825c39fe1e72f333a0bcdb7c3e60ef9d213dcf"}
Nov 04 01:18:42.728771 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:42.728738    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-4sws9" event={"ID":"0baa384c-8887-4f98-a48c-bbc5dcdbdd7b","Type":"ContainerStarted","Data":"07998b9459ef38bd659f12d51729d94d35007472c3d7c812b12b0ba791fa84d0"}
Nov 04 01:18:42.729199 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:42.728833    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-4sws9"
Nov 04 01:18:42.730754 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:42.730720    5572 generic.go:356] "Generic (PLEG): container finished" podID="492900ca-9e62-4ef4-95d5-d3ec1ec48529" containerID="193badaecdf00d16a90f547273d2ad7cfa1d04d4ff437a2513449cde268c9aff" exitCode=0
Nov 04 01:18:42.730896 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:42.730774    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt" event={"ID":"492900ca-9e62-4ef4-95d5-d3ec1ec48529","Type":"ContainerDied","Data":"193badaecdf00d16a90f547273d2ad7cfa1d04d4ff437a2513449cde268c9aff"}
Nov 04 01:18:42.840215 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:42.840160    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-4sws9" podStartSLOduration=1.785717794 podStartE2EDuration="5.840144811s" totalImagesPullingTime="4.054427017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:18:42.839211825 +0000 UTC m=+453.989419595" watchObservedRunningTime="2026-11-04 01:18:42.840144811 +0000 UTC m=+453.990352569"
Nov 04 01:18:43.198592 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:18:43.198518    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:18:43.737027 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:43.736997    5572 generic.go:356] "Generic (PLEG): container finished" podID="492900ca-9e62-4ef4-95d5-d3ec1ec48529" containerID="8e0c867856c1bcb4117be3f5009ab8bded69231e421bc735336e815d59583e40" exitCode=0
Nov 04 01:18:43.737508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:43.737058    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt" event={"ID":"492900ca-9e62-4ef4-95d5-d3ec1ec48529","Type":"ContainerDied","Data":"8e0c867856c1bcb4117be3f5009ab8bded69231e421bc735336e815d59583e40"}
Nov 04 01:18:44.183865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:44.183777    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:44.340241 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:44.340206    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:44.694696 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:44.694666    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5bdd5c57b4-bl6n2"
Nov 04 01:18:44.860417 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:44.860388    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:44.961386 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:44.961301    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-util\" (UniqueName: \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-util\") pod \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") "
Nov 04 01:18:44.961386 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:44.961356    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/492900ca-9e62-4ef4-95d5-d3ec1ec48529-kube-api-access-lkcdg\" (UniqueName: \"kubernetes.io/projected/492900ca-9e62-4ef4-95d5-d3ec1ec48529-kube-api-access-lkcdg\") pod \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") "
Nov 04 01:18:44.961622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:44.961447    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-bundle\" (UniqueName: \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-bundle\") pod \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\" (UID: \"492900ca-9e62-4ef4-95d5-d3ec1ec48529\") "
Nov 04 01:18:44.961900 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:44.961854    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-bundle" pod "492900ca-9e62-4ef4-95d5-d3ec1ec48529" (UID: "492900ca-9e62-4ef4-95d5-d3ec1ec48529"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:44.963453 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:44.963424    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/492900ca-9e62-4ef4-95d5-d3ec1ec48529-kube-api-access-lkcdg" pod "492900ca-9e62-4ef4-95d5-d3ec1ec48529" (UID: "492900ca-9e62-4ef4-95d5-d3ec1ec48529"). InnerVolumeSpecName "kube-api-access-lkcdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:18:44.968753 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:44.968724    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-util" pod "492900ca-9e62-4ef4-95d5-d3ec1ec48529" (UID: "492900ca-9e62-4ef4-95d5-d3ec1ec48529"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:18:45.062777 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:45.062742    5572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-util\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:45.062777 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:45.062770    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkcdg\" (UniqueName: \"kubernetes.io/projected/492900ca-9e62-4ef4-95d5-d3ec1ec48529-kube-api-access-lkcdg\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:45.062777 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:45.062781    5572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/492900ca-9e62-4ef4-95d5-d3ec1ec48529-bundle\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:18:45.747422 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:45.747369    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt" event={"ID":"492900ca-9e62-4ef4-95d5-d3ec1ec48529","Type":"ContainerDied","Data":"0438c3741e3458fa98491d78fe825c39fe1e72f333a0bcdb7c3e60ef9d213dcf"}
Nov 04 01:18:45.747422 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:45.747403    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448l5zt"
Nov 04 01:18:45.747422 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:45.747430    5572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0438c3741e3458fa98491d78fe825c39fe1e72f333a0bcdb7c3e60ef9d213dcf"
Nov 04 01:18:46.969713 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:46.969659    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:49.108047 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.108014    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w"]
Nov 04 01:18:49.108427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.108314    5572 cpu_manager.go:414] "containerMap: removing container" podUID="492900ca-9e62-4ef4-95d5-d3ec1ec48529" containerName="util"
Nov 04 01:18:49.108427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.108325    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="492900ca-9e62-4ef4-95d5-d3ec1ec48529" containerName="util"
Nov 04 01:18:49.108427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.108338    5572 cpu_manager.go:414] "containerMap: removing container" podUID="492900ca-9e62-4ef4-95d5-d3ec1ec48529" containerName="pull"
Nov 04 01:18:49.108427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.108343    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="492900ca-9e62-4ef4-95d5-d3ec1ec48529" containerName="pull"
Nov 04 01:18:49.108427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.108349    5572 cpu_manager.go:414] "containerMap: removing container" podUID="492900ca-9e62-4ef4-95d5-d3ec1ec48529" containerName="extract"
Nov 04 01:18:49.108427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.108354    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="492900ca-9e62-4ef4-95d5-d3ec1ec48529" containerName="extract"
Nov 04 01:18:49.108427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.108403    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="492900ca-9e62-4ef4-95d5-d3ec1ec48529" containerName="extract"
Nov 04 01:18:49.110480 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.110463    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w"
Nov 04 01:18:49.207553 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.207517    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mm9gd\""
Nov 04 01:18:49.208803 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.208779    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w"]
Nov 04 01:18:49.297896 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.297865    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tbfr\" (UniqueName: \"kubernetes.io/projected/9462b966-29b4-41aa-bc08-6a28930960eb-kube-api-access-5tbfr\") pod \"limitador-operator-controller-manager-5778bb4449-n977w\" (UID: \"9462b966-29b4-41aa-bc08-6a28930960eb\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w"
Nov 04 01:18:49.399339 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.399257    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tbfr\" (UniqueName: \"kubernetes.io/projected/9462b966-29b4-41aa-bc08-6a28930960eb-kube-api-access-5tbfr\") pod \"limitador-operator-controller-manager-5778bb4449-n977w\" (UID: \"9462b966-29b4-41aa-bc08-6a28930960eb\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w"
Nov 04 01:18:49.461971 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.461940    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tbfr\" (UniqueName: \"kubernetes.io/projected/9462b966-29b4-41aa-bc08-6a28930960eb-kube-api-access-5tbfr\") pod \"limitador-operator-controller-manager-5778bb4449-n977w\" (UID: \"9462b966-29b4-41aa-bc08-6a28930960eb\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w"
Nov 04 01:18:49.722217 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:49.722187    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w"
Nov 04 01:18:50.005024 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.004944    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:50.100884 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.100850    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w"]
Nov 04 01:18:50.104895 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:18:50.104867    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9462b966_29b4_41aa_bc08_6a28930960eb.slice/crio-ec7ede1cc03ab0e4644635f019336d87e7b9d675f06b8ef6f5888ba4ae4b6ede WatchSource:0}: Error finding container ec7ede1cc03ab0e4644635f019336d87e7b9d675f06b8ef6f5888ba4ae4b6ede: Status 404 returned error can't find the container with id ec7ede1cc03ab0e4644635f019336d87e7b9d675f06b8ef6f5888ba4ae4b6ede
Nov 04 01:18:50.170928 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.170892    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:50.326199 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.326078    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:50.569521 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.569490    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"]
Nov 04 01:18:50.572657 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.572641    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"
Nov 04 01:18:50.621463 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.621434    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Nov 04 01:18:50.621625 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.621476    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Nov 04 01:18:50.668744 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.668708    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"]
Nov 04 01:18:50.709990 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.709959    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d872a901-92a2-47cb-9449-d678046ba735-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-5d2lj\" (UID: \"d872a901-92a2-47cb-9449-d678046ba735\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"
Nov 04 01:18:50.709990 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.709989    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfktx\" (UniqueName: \"kubernetes.io/projected/d872a901-92a2-47cb-9449-d678046ba735-kube-api-access-vfktx\") pod \"cert-manager-webhook-5dbbbf75cc-5d2lj\" (UID: \"d872a901-92a2-47cb-9449-d678046ba735\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"
Nov 04 01:18:50.770051 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.770019    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w" event={"ID":"9462b966-29b4-41aa-bc08-6a28930960eb","Type":"ContainerStarted","Data":"ec7ede1cc03ab0e4644635f019336d87e7b9d675f06b8ef6f5888ba4ae4b6ede"}
Nov 04 01:18:50.811076 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.811036    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d872a901-92a2-47cb-9449-d678046ba735-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-5d2lj\" (UID: \"d872a901-92a2-47cb-9449-d678046ba735\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"
Nov 04 01:18:50.811076 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.811078    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfktx\" (UniqueName: \"kubernetes.io/projected/d872a901-92a2-47cb-9449-d678046ba735-kube-api-access-vfktx\") pod \"cert-manager-webhook-5dbbbf75cc-5d2lj\" (UID: \"d872a901-92a2-47cb-9449-d678046ba735\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"
Nov 04 01:18:50.868247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.868179    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d872a901-92a2-47cb-9449-d678046ba735-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-5d2lj\" (UID: \"d872a901-92a2-47cb-9449-d678046ba735\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"
Nov 04 01:18:50.868386 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.868321    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfktx\" (UniqueName: \"kubernetes.io/projected/d872a901-92a2-47cb-9449-d678046ba735-kube-api-access-vfktx\") pod \"cert-manager-webhook-5dbbbf75cc-5d2lj\" (UID: \"d872a901-92a2-47cb-9449-d678046ba735\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"
Nov 04 01:18:50.894740 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:50.894717    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"
Nov 04 01:18:51.260780 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:51.260751    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"]
Nov 04 01:18:51.264275 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:18:51.264247    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd872a901_92a2_47cb_9449_d678046ba735.slice/crio-ef8d16dfaababa64c9fbb973be9739d09851e8d0c543383e12927eabf934864f WatchSource:0}: Error finding container ef8d16dfaababa64c9fbb973be9739d09851e8d0c543383e12927eabf934864f: Status 404 returned error can't find the container with id ef8d16dfaababa64c9fbb973be9739d09851e8d0c543383e12927eabf934864f
Nov 04 01:18:51.452726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:51.452697    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:51.598309 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:51.598215    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:51.775950 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:51.775917    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj" event={"ID":"d872a901-92a2-47cb-9449-d678046ba735","Type":"ContainerStarted","Data":"ef8d16dfaababa64c9fbb973be9739d09851e8d0c543383e12927eabf934864f"}
Nov 04 01:18:52.267098 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:52.267065    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:52.732805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:52.732769    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:53.742921 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:53.740045    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-4sws9"
Nov 04 01:18:53.787546 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:53.787493    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w" event={"ID":"9462b966-29b4-41aa-bc08-6a28930960eb","Type":"ContainerStarted","Data":"36e79ab0d91c8af4a8d8af1a6253b587f71c8c3159737a96aaaee9cf9c967f5c"}
Nov 04 01:18:53.787694 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:53.787573    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w"
Nov 04 01:18:53.952693 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:53.952657    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:53.960374 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:53.960314    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w" podStartSLOduration=1.9935167599999999 podStartE2EDuration="4.96029656s" totalImagesPullingTime="2.9667798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:18:53.959676501 +0000 UTC m=+465.109884260" watchObservedRunningTime="2026-11-04 01:18:53.96029656 +0000 UTC m=+465.110504320"
Nov 04 01:18:54.111070 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:54.110981    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:54.564326 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:54.564271    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:54.744522 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:54.744485    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:56.824727 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:56.824702    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:56.989880 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:56.989809    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:18:57.807602 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:57.807552    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj" event={"ID":"d872a901-92a2-47cb-9449-d678046ba735","Type":"ContainerStarted","Data":"ce2831b0fc2309db9394d2f6f47890d22d023b2390eb516e3a78b8d586116b4f"}
Nov 04 01:18:57.807793 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:57.807678    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"
Nov 04 01:18:57.916989 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:18:57.916943    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj" podStartSLOduration=2.409741587 podStartE2EDuration="7.91692998s" totalImagesPullingTime="5.507188393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:18:57.915404583 +0000 UTC m=+469.065612342" watchObservedRunningTime="2026-11-04 01:18:57.91692998 +0000 UTC m=+469.067137738"
Nov 04 01:19:00.142721 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.142685    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:00.286440 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.286405    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:00.427854 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.427763    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:00.473118 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.473085    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-97zxq"]
Nov 04 01:19:00.476598 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.476577    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-97zxq"
Nov 04 01:19:00.489903 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.489878    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59935fb0-b1a1-4af1-a8ea-f51d76798c3a-bound-sa-token\") pod \"cert-manager-597b95cb84-97zxq\" (UID: \"59935fb0-b1a1-4af1-a8ea-f51d76798c3a\") " pod="cert-manager/cert-manager-597b95cb84-97zxq"
Nov 04 01:19:00.490017 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.489918    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvp8n\" (UniqueName: \"kubernetes.io/projected/59935fb0-b1a1-4af1-a8ea-f51d76798c3a-kube-api-access-gvp8n\") pod \"cert-manager-597b95cb84-97zxq\" (UID: \"59935fb0-b1a1-4af1-a8ea-f51d76798c3a\") " pod="cert-manager/cert-manager-597b95cb84-97zxq"
Nov 04 01:19:00.571178 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.571141    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-d24gb\""
Nov 04 01:19:00.572553 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.572507    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-97zxq"]
Nov 04 01:19:00.590933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.590910    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59935fb0-b1a1-4af1-a8ea-f51d76798c3a-bound-sa-token\") pod \"cert-manager-597b95cb84-97zxq\" (UID: \"59935fb0-b1a1-4af1-a8ea-f51d76798c3a\") " pod="cert-manager/cert-manager-597b95cb84-97zxq"
Nov 04 01:19:00.591062 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.590951    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvp8n\" (UniqueName: \"kubernetes.io/projected/59935fb0-b1a1-4af1-a8ea-f51d76798c3a-kube-api-access-gvp8n\") pod \"cert-manager-597b95cb84-97zxq\" (UID: \"59935fb0-b1a1-4af1-a8ea-f51d76798c3a\") " pod="cert-manager/cert-manager-597b95cb84-97zxq"
Nov 04 01:19:00.648053 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.648017    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59935fb0-b1a1-4af1-a8ea-f51d76798c3a-bound-sa-token\") pod \"cert-manager-597b95cb84-97zxq\" (UID: \"59935fb0-b1a1-4af1-a8ea-f51d76798c3a\") " pod="cert-manager/cert-manager-597b95cb84-97zxq"
Nov 04 01:19:00.648196 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.648147    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvp8n\" (UniqueName: \"kubernetes.io/projected/59935fb0-b1a1-4af1-a8ea-f51d76798c3a-kube-api-access-gvp8n\") pod \"cert-manager-597b95cb84-97zxq\" (UID: \"59935fb0-b1a1-4af1-a8ea-f51d76798c3a\") " pod="cert-manager/cert-manager-597b95cb84-97zxq"
Nov 04 01:19:00.739177 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.739145    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:00.788758 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.788730    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-97zxq"
Nov 04 01:19:00.882473 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:00.882442    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:01.151264 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:01.151193    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-97zxq"]
Nov 04 01:19:01.154207 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:19:01.154182    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59935fb0_b1a1_4af1_a8ea_f51d76798c3a.slice/crio-ca3084fb7652a9ec69ddb5c8ffbb110990f23894dc181ba8e028f778a4dd49c6 WatchSource:0}: Error finding container ca3084fb7652a9ec69ddb5c8ffbb110990f23894dc181ba8e028f778a4dd49c6: Status 404 returned error can't find the container with id ca3084fb7652a9ec69ddb5c8ffbb110990f23894dc181ba8e028f778a4dd49c6
Nov 04 01:19:01.343611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:01.343512    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:01.491586 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:01.491550    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:01.653720 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:01.653684    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:01.827715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:01.827633    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-97zxq" event={"ID":"59935fb0-b1a1-4af1-a8ea-f51d76798c3a","Type":"ContainerStarted","Data":"c11d0fd282cba9317dd8325523a119224a22194cf63b46cd91048f3e110b8340"}
Nov 04 01:19:01.827715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:01.827672    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-97zxq" event={"ID":"59935fb0-b1a1-4af1-a8ea-f51d76798c3a","Type":"ContainerStarted","Data":"ca3084fb7652a9ec69ddb5c8ffbb110990f23894dc181ba8e028f778a4dd49c6"}
Nov 04 01:19:01.936433 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:01.936379    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-97zxq" podStartSLOduration=1.936368087 podStartE2EDuration="1.936368087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:19:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:19:01.936153664 +0000 UTC m=+473.086361424" watchObservedRunningTime="2026-11-04 01:19:01.936368087 +0000 UTC m=+473.086575845"
Nov 04 01:19:03.105679 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:03.105643    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:03.249302 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:03.249274    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:03.816033 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:03.816001    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-5d2lj"
Nov 04 01:19:04.794122 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:04.794090    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n977w"
Nov 04 01:19:05.047156 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:05.047072    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:05.250903 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:05.250858    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:05.460788 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:05.460756    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:08.177720 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:08.177687    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:09.663647 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:09.663611    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:09.823133 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:09.823096    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:13.198609 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:19:13.198564    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:19:13.950773 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:13.950734    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:14.094572 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:14.094523    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:19.345213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:19.345176    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:19.489508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:19.489470    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:19.937371 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:19.937337    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:20.081725 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:20.081695    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:21.222605 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:21.222565    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:23.980275 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:23.980241    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:24.122682 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:24.122630    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:24.652036 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:24.651997    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:25.550661 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:25.550630    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:25.697826 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:25.697783    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:25.940679 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:25.940650    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:26.084597 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:26.084555    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:26.348936 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:26.348835    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:26.576098 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:26.576058    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:26.736002 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:26.735967    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:26.875714 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:26.875680    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"]
Nov 04 01:19:26.880391 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:26.880365    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:26.948018 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:26.947985    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"]
Nov 04 01:19:27.001880 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.001799    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.001880 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.001847    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.002127 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.001880    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.002127 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.001970    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.002127 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.002006    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.002127 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.002059    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.002272 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.002167    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.002272 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.002196    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wcnx\" (UniqueName: \"kubernetes.io/projected/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-kube-api-access-5wcnx\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.002272 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.002215    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.006522 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.006491    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:27.009556 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.009540    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qt4vr\""
Nov 04 01:19:27.102946 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.102909    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103099 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.102950    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103099 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.102983    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103099 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.103015    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103099 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.103044    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103099 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.103095    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.103122    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.103152    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wcnx\" (UniqueName: \"kubernetes.io/projected/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-kube-api-access-5wcnx\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.103182    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.103351    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103600 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.103457    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103660 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.103603    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103829 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.103807    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.103938 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.103886    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.105581 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.105559    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.105719 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.105700    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.162974 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.162946    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.163334 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.163310    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wcnx\" (UniqueName: \"kubernetes.io/projected/4bdd25f7-153c-428e-b2ce-c5ae2457bb04-kube-api-access-5wcnx\") pod \"data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl\" (UID: \"4bdd25f7-153c-428e-b2ce-c5ae2457bb04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.192808 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.192777    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:27.280684 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.280616    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:27.610946 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.610874    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"]
Nov 04 01:19:27.614194 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:19:27.614164    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bdd25f7_153c_428e_b2ce_c5ae2457bb04.slice/crio-226fab33e88f0bdbecf13766c1eaade895b8906601ccfe52809758d217ea291b WatchSource:0}: Error finding container 226fab33e88f0bdbecf13766c1eaade895b8906601ccfe52809758d217ea291b: Status 404 returned error can't find the container with id 226fab33e88f0bdbecf13766c1eaade895b8906601ccfe52809758d217ea291b
Nov 04 01:19:27.616226 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.616196    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:19:27.616310 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.616264    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:19:27.616310 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.616291    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:19:27.947023 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.946982    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl" event={"ID":"4bdd25f7-153c-428e-b2ce-c5ae2457bb04","Type":"ContainerStarted","Data":"2a1ae2081ce2650a597675152797e0bed8f7abde1a93dc974497620d83764e40"}
Nov 04 01:19:27.947282 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:27.947054    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl" event={"ID":"4bdd25f7-153c-428e-b2ce-c5ae2457bb04","Type":"ContainerStarted","Data":"226fab33e88f0bdbecf13766c1eaade895b8906601ccfe52809758d217ea291b"}
Nov 04 01:19:28.061426 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:28.061369    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl" podStartSLOduration=2.061353702 podStartE2EDuration="2.061353702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:19:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:19:28.06073817 +0000 UTC m=+499.210945948" watchObservedRunningTime="2026-11-04 01:19:28.061353702 +0000 UTC m=+499.211561460"
Nov 04 01:19:28.193137 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:28.193104    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:28.197826 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:28.197771    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:28.777675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:28.777641    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:28.919347 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:28.919314    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-f6w52"]
Nov 04 01:19:28.922206 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:28.922173    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:28.951572 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:28.951528    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:28.952364 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:28.952337    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl"
Nov 04 01:19:28.975970 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:28.975938    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4v8rp\""
Nov 04 01:19:29.012008 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.011979    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-f6w52"]
Nov 04 01:19:29.021914 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.021883    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Nov 04 01:19:29.022244 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.022219    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a5af89c-f227-40ff-b3fe-7326cdc098ae-config-file\") pod \"limitador-limitador-74dfcfb894-f6w52\" (UID: \"9a5af89c-f227-40ff-b3fe-7326cdc098ae\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:29.022356 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.022282    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b62g\" (UniqueName: \"kubernetes.io/projected/9a5af89c-f227-40ff-b3fe-7326cdc098ae-kube-api-access-6b62g\") pod \"limitador-limitador-74dfcfb894-f6w52\" (UID: \"9a5af89c-f227-40ff-b3fe-7326cdc098ae\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:29.040648 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.040576    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:29.116435 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.116401    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-f6w52"]
Nov 04 01:19:29.123090 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.123062    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a5af89c-f227-40ff-b3fe-7326cdc098ae-config-file\") pod \"limitador-limitador-74dfcfb894-f6w52\" (UID: \"9a5af89c-f227-40ff-b3fe-7326cdc098ae\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:29.123226 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.123113    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b62g\" (UniqueName: \"kubernetes.io/projected/9a5af89c-f227-40ff-b3fe-7326cdc098ae-kube-api-access-6b62g\") pod \"limitador-limitador-74dfcfb894-f6w52\" (UID: \"9a5af89c-f227-40ff-b3fe-7326cdc098ae\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:29.123747 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.123725    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a5af89c-f227-40ff-b3fe-7326cdc098ae-config-file\") pod \"limitador-limitador-74dfcfb894-f6w52\" (UID: \"9a5af89c-f227-40ff-b3fe-7326cdc098ae\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:29.180288 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.180256    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b62g\" (UniqueName: \"kubernetes.io/projected/9a5af89c-f227-40ff-b3fe-7326cdc098ae-kube-api-access-6b62g\") pod \"limitador-limitador-74dfcfb894-f6w52\" (UID: \"9a5af89c-f227-40ff-b3fe-7326cdc098ae\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:29.187323 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.187296    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:29.239710 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.239678    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:29.333414 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.333322    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:29.481748 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.481711    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:29.608101 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.608016    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-f6w52"]
Nov 04 01:19:29.610644 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:19:29.610613    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5af89c_f227_40ff_b3fe_7326cdc098ae.slice/crio-0f3ea2e53b0f43277ab13329111343e4e9580708286635ead4e6473dce6a7721 WatchSource:0}: Error finding container 0f3ea2e53b0f43277ab13329111343e4e9580708286635ead4e6473dce6a7721: Status 404 returned error can't find the container with id 0f3ea2e53b0f43277ab13329111343e4e9580708286635ead4e6473dce6a7721
Nov 04 01:19:29.956785 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:29.956747    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52" event={"ID":"9a5af89c-f227-40ff-b3fe-7326cdc098ae","Type":"ContainerStarted","Data":"0f3ea2e53b0f43277ab13329111343e4e9580708286635ead4e6473dce6a7721"}
Nov 04 01:19:30.121093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.121059    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-89qwq"]
Nov 04 01:19:30.124486 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.124469    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-89qwq"
Nov 04 01:19:30.176578 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.176314    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nbnlf\""
Nov 04 01:19:30.177841 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.177812    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-89qwq"]
Nov 04 01:19:30.232031 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.231946    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7hjh\" (UniqueName: \"kubernetes.io/projected/5f3f88de-0361-432a-9742-69ccddcafa35-kube-api-access-r7hjh\") pod \"authorino-57f7f8659f-89qwq\" (UID: \"5f3f88de-0361-432a-9742-69ccddcafa35\") " pod="kuadrant-system/authorino-57f7f8659f-89qwq"
Nov 04 01:19:30.267026 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.266990    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:30.332464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.332435    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7hjh\" (UniqueName: \"kubernetes.io/projected/5f3f88de-0361-432a-9742-69ccddcafa35-kube-api-access-r7hjh\") pod \"authorino-57f7f8659f-89qwq\" (UID: \"5f3f88de-0361-432a-9742-69ccddcafa35\") " pod="kuadrant-system/authorino-57f7f8659f-89qwq"
Nov 04 01:19:30.391023 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.390985    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7hjh\" (UniqueName: \"kubernetes.io/projected/5f3f88de-0361-432a-9742-69ccddcafa35-kube-api-access-r7hjh\") pod \"authorino-57f7f8659f-89qwq\" (UID: \"5f3f88de-0361-432a-9742-69ccddcafa35\") " pod="kuadrant-system/authorino-57f7f8659f-89qwq"
Nov 04 01:19:30.412176 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.412141    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:30.436398 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.436374    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-89qwq"
Nov 04 01:19:30.801874 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.801789    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-89qwq"]
Nov 04 01:19:30.804637 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:19:30.804609    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f3f88de_0361_432a_9742_69ccddcafa35.slice/crio-43bf92cabba2feb5968a18e246176d164f8426e4dbe29d315d942dfd8b1bfa67 WatchSource:0}: Error finding container 43bf92cabba2feb5968a18e246176d164f8426e4dbe29d315d942dfd8b1bfa67: Status 404 returned error can't find the container with id 43bf92cabba2feb5968a18e246176d164f8426e4dbe29d315d942dfd8b1bfa67
Nov 04 01:19:30.962819 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:30.962782    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-89qwq" event={"ID":"5f3f88de-0361-432a-9742-69ccddcafa35","Type":"ContainerStarted","Data":"43bf92cabba2feb5968a18e246176d164f8426e4dbe29d315d942dfd8b1bfa67"}
Nov 04 01:19:31.414271 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:31.414235    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:31.974666 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:31.974630    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nq9z2"]
Nov 04 01:19:31.977568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:31.977543    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2"
Nov 04 01:19:32.022147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.022110    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:32.029444 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.029417    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nq9z2"]
Nov 04 01:19:32.049391 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.049356    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4rck\" (UniqueName: \"kubernetes.io/projected/e5f33fbb-b2fc-4366-a050-ed5938674555-kube-api-access-z4rck\") pod \"authorino-56c6c9ddd5-nq9z2\" (UID: \"e5f33fbb-b2fc-4366-a050-ed5938674555\") " pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2"
Nov 04 01:19:32.150585 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.150559    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4rck\" (UniqueName: \"kubernetes.io/projected/e5f33fbb-b2fc-4366-a050-ed5938674555-kube-api-access-z4rck\") pod \"authorino-56c6c9ddd5-nq9z2\" (UID: \"e5f33fbb-b2fc-4366-a050-ed5938674555\") " pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2"
Nov 04 01:19:32.167393 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.167366    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:32.207720 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.207688    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4rck\" (UniqueName: \"kubernetes.io/projected/e5f33fbb-b2fc-4366-a050-ed5938674555-kube-api-access-z4rck\") pod \"authorino-56c6c9ddd5-nq9z2\" (UID: \"e5f33fbb-b2fc-4366-a050-ed5938674555\") " pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2"
Nov 04 01:19:32.291729 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.291648    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2"
Nov 04 01:19:32.660082 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.659992    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nq9z2"]
Nov 04 01:19:32.663078 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:19:32.663051    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5f33fbb_b2fc_4366_a050_ed5938674555.slice/crio-09b7e678bad134e121f80ccccc964bfcf7db9c743c433145b712c0d47a948986 WatchSource:0}: Error finding container 09b7e678bad134e121f80ccccc964bfcf7db9c743c433145b712c0d47a948986: Status 404 returned error can't find the container with id 09b7e678bad134e121f80ccccc964bfcf7db9c743c433145b712c0d47a948986
Nov 04 01:19:32.811954 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.811893    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:32.955162 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.955122    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:32.973694 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.973664    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2" event={"ID":"e5f33fbb-b2fc-4366-a050-ed5938674555","Type":"ContainerStarted","Data":"09b7e678bad134e121f80ccccc964bfcf7db9c743c433145b712c0d47a948986"}
Nov 04 01:19:32.975117 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.975093    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52" event={"ID":"9a5af89c-f227-40ff-b3fe-7326cdc098ae","Type":"ContainerStarted","Data":"8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb"}
Nov 04 01:19:32.975483 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:32.975205    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:33.085038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:33.084981    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52" podStartSLOduration=2.583126766 podStartE2EDuration="5.084964712s" totalImagesPullingTime="2.501837946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:19:33.083942844 +0000 UTC m=+504.234150602" watchObservedRunningTime="2026-11-04 01:19:33.084964712 +0000 UTC m=+504.235172472"
Nov 04 01:19:34.475877 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:34.475839    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:34.620371 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:34.620338    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:34.761591 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:34.761496    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:34.985984 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:34.985950    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2" event={"ID":"e5f33fbb-b2fc-4366-a050-ed5938674555","Type":"ContainerStarted","Data":"17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345"}
Nov 04 01:19:34.987575 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:34.987547    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-89qwq" event={"ID":"5f3f88de-0361-432a-9742-69ccddcafa35","Type":"ContainerStarted","Data":"e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1"}
Nov 04 01:19:35.092485 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:35.092378    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2" podStartSLOduration=1.94141632 podStartE2EDuration="4.092359562s" totalImagesPullingTime="2.150943242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:19:35.092087364 +0000 UTC m=+506.242295123" watchObservedRunningTime="2026-11-04 01:19:35.092359562 +0000 UTC m=+506.242567318"
Nov 04 01:19:35.119407 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:35.119369    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-89qwq"]
Nov 04 01:19:35.199556 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:35.199478    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-89qwq" podStartSLOduration=1.932859644 podStartE2EDuration="5.199466345s" totalImagesPullingTime="3.266606701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:19:35.198192313 +0000 UTC m=+506.348400073" watchObservedRunningTime="2026-11-04 01:19:35.199466345 +0000 UTC m=+506.349674103"
Nov 04 01:19:36.996658 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:36.996608    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-89qwq" podUID="5f3f88de-0361-432a-9742-69ccddcafa35" containerName="authorino" containerID="cri-o://e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1" gracePeriod=30
Nov 04 01:19:37.232666 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:37.232637    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-89qwq"
Nov 04 01:19:37.298614 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:37.298501    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f3f88de-0361-432a-9742-69ccddcafa35-kube-api-access-r7hjh\" (UniqueName: \"kubernetes.io/projected/5f3f88de-0361-432a-9742-69ccddcafa35-kube-api-access-r7hjh\") pod \"5f3f88de-0361-432a-9742-69ccddcafa35\" (UID: \"5f3f88de-0361-432a-9742-69ccddcafa35\") "
Nov 04 01:19:37.300679 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:37.300648    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f3f88de-0361-432a-9742-69ccddcafa35-kube-api-access-r7hjh" pod "5f3f88de-0361-432a-9742-69ccddcafa35" (UID: "5f3f88de-0361-432a-9742-69ccddcafa35"). InnerVolumeSpecName "kube-api-access-r7hjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:19:37.399979 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:37.399939    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7hjh\" (UniqueName: \"kubernetes.io/projected/5f3f88de-0361-432a-9742-69ccddcafa35-kube-api-access-r7hjh\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:19:38.002791 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:38.002756    5572 generic.go:356] "Generic (PLEG): container finished" podID="5f3f88de-0361-432a-9742-69ccddcafa35" containerID="e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1" exitCode=0
Nov 04 01:19:38.003226 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:38.002798    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-89qwq"
Nov 04 01:19:38.003226 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:38.002841    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-89qwq" event={"ID":"5f3f88de-0361-432a-9742-69ccddcafa35","Type":"ContainerDied","Data":"e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1"}
Nov 04 01:19:38.003226 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:38.002879    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-89qwq" event={"ID":"5f3f88de-0361-432a-9742-69ccddcafa35","Type":"ContainerDied","Data":"43bf92cabba2feb5968a18e246176d164f8426e4dbe29d315d942dfd8b1bfa67"}
Nov 04 01:19:38.003226 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:38.002895    5572 scope.go:122] "RemoveContainer" containerID="e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1"
Nov 04 01:19:38.012037 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:38.012015    5572 scope.go:122] "RemoveContainer" containerID="e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1"
Nov 04 01:19:38.012329 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:19:38.012311    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1\": container with ID starting with e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1 not found: ID does not exist" containerID="e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1"
Nov 04 01:19:38.012381 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:38.012339    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1"} err="failed to get container status \"e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1\": rpc error: code = NotFound desc = could not find container \"e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1\": container with ID starting with e62a5e451176d285832ba55191c28e241bba7a4b09e5ffdc4d2501ed8596e9d1 not found: ID does not exist"
Nov 04 01:19:38.155509 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:38.155476    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-89qwq"]
Nov 04 01:19:38.159382 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:38.159346    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-89qwq"]
Nov 04 01:19:38.971985 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:38.971950    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f3f88de-0361-432a-9742-69ccddcafa35" path="/var/lib/kubelet/pods/5f3f88de-0361-432a-9742-69ccddcafa35/volumes"
Nov 04 01:19:39.192430 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:39.192396    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:39.336016 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:39.335932    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:43.199555 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:19:43.199492    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:19:43.981903 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:43.981871    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:44.621838 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:44.621800    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:44.762795 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:44.762760    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:45.026663 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:45.026634    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:45.169543 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:45.169495    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:45.425105 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:45.425034    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:45.569388 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:45.569354    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:46.741157 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:46.741122    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-f6w52"]
Nov 04 01:19:46.741675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:46.741306    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52" podUID="9a5af89c-f227-40ff-b3fe-7326cdc098ae" containerName="limitador" containerID="cri-o://8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb" gracePeriod=30
Nov 04 01:19:47.273447 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:47.273423    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:47.387671 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:47.387590    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a5af89c-f227-40ff-b3fe-7326cdc098ae-kube-api-access-6b62g\" (UniqueName: \"kubernetes.io/projected/9a5af89c-f227-40ff-b3fe-7326cdc098ae-kube-api-access-6b62g\") pod \"9a5af89c-f227-40ff-b3fe-7326cdc098ae\" (UID: \"9a5af89c-f227-40ff-b3fe-7326cdc098ae\") "
Nov 04 01:19:47.387877 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:47.387742    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9a5af89c-f227-40ff-b3fe-7326cdc098ae-config-file\" (UniqueName: \"kubernetes.io/configmap/9a5af89c-f227-40ff-b3fe-7326cdc098ae-config-file\") pod \"9a5af89c-f227-40ff-b3fe-7326cdc098ae\" (UID: \"9a5af89c-f227-40ff-b3fe-7326cdc098ae\") "
Nov 04 01:19:47.388114 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:47.388088    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a5af89c-f227-40ff-b3fe-7326cdc098ae-config-file" pod "9a5af89c-f227-40ff-b3fe-7326cdc098ae" (UID: "9a5af89c-f227-40ff-b3fe-7326cdc098ae"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:19:47.389849 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:47.389819    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a5af89c-f227-40ff-b3fe-7326cdc098ae-kube-api-access-6b62g" pod "9a5af89c-f227-40ff-b3fe-7326cdc098ae" (UID: "9a5af89c-f227-40ff-b3fe-7326cdc098ae"). InnerVolumeSpecName "kube-api-access-6b62g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:19:47.488916 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:47.488875    5572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a5af89c-f227-40ff-b3fe-7326cdc098ae-config-file\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:19:47.488916 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:47.488910    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b62g\" (UniqueName: \"kubernetes.io/projected/9a5af89c-f227-40ff-b3fe-7326cdc098ae-kube-api-access-6b62g\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:19:48.051644 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:48.051606    5572 generic.go:356] "Generic (PLEG): container finished" podID="9a5af89c-f227-40ff-b3fe-7326cdc098ae" containerID="8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb" exitCode=0
Nov 04 01:19:48.052100 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:48.051657    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52"
Nov 04 01:19:48.052100 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:48.051663    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52" event={"ID":"9a5af89c-f227-40ff-b3fe-7326cdc098ae","Type":"ContainerDied","Data":"8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb"}
Nov 04 01:19:48.052100 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:48.051717    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-f6w52" event={"ID":"9a5af89c-f227-40ff-b3fe-7326cdc098ae","Type":"ContainerDied","Data":"0f3ea2e53b0f43277ab13329111343e4e9580708286635ead4e6473dce6a7721"}
Nov 04 01:19:48.052100 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:48.051750    5572 scope.go:122] "RemoveContainer" containerID="8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb"
Nov 04 01:19:48.060650 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:48.060630    5572 scope.go:122] "RemoveContainer" containerID="8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb"
Nov 04 01:19:48.060913 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:19:48.060891    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb\": container with ID starting with 8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb not found: ID does not exist" containerID="8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb"
Nov 04 01:19:48.060962 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:48.060922    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb"} err="failed to get container status \"8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb\": rpc error: code = NotFound desc = could not find container \"8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb\": container with ID starting with 8c95c31a212de8b022f7ab86c1cf9e6342cf4ded090ce785db0b727d3cc5cabb not found: ID does not exist"
Nov 04 01:19:48.207103 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:48.207074    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-f6w52"]
Nov 04 01:19:48.253284 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:48.253249    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-f6w52"]
Nov 04 01:19:48.971419 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:48.971385    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a5af89c-f227-40ff-b3fe-7326cdc098ae" path="/var/lib/kubelet/pods/9a5af89c-f227-40ff-b3fe-7326cdc098ae/volumes"
Nov 04 01:19:51.426216 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:51.426178    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:51.573926 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:51.573892    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:51.730126 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:51.730090    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:51.874780 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:51.874750    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:52.398798 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.398764    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"]
Nov 04 01:19:52.399124 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.399112    5572 cpu_manager.go:414] "containerMap: removing container" podUID="5f3f88de-0361-432a-9742-69ccddcafa35" containerName="authorino"
Nov 04 01:19:52.399180 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.399125    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f3f88de-0361-432a-9742-69ccddcafa35" containerName="authorino"
Nov 04 01:19:52.399180 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.399141    5572 cpu_manager.go:414] "containerMap: removing container" podUID="9a5af89c-f227-40ff-b3fe-7326cdc098ae" containerName="limitador"
Nov 04 01:19:52.399180 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.399146    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a5af89c-f227-40ff-b3fe-7326cdc098ae" containerName="limitador"
Nov 04 01:19:52.399286 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.399197    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a5af89c-f227-40ff-b3fe-7326cdc098ae" containerName="limitador"
Nov 04 01:19:52.399286 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.399210    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f3f88de-0361-432a-9742-69ccddcafa35" containerName="authorino"
Nov 04 01:19:52.402189 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.402170    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"
Nov 04 01:19:52.453652 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.453624    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lsknm\""
Nov 04 01:19:52.473250 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.473221    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 01:19:52.473521 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.473504    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 01:19:52.473611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.473524    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Nov 04 01:19:52.474799 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.474778    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"]
Nov 04 01:19:52.480516 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.480487    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:52.527736 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.527701    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p8bc\" (UniqueName: \"kubernetes.io/projected/6cc63a3a-db58-4a8b-bed4-3d7007f21e89-kube-api-access-2p8bc\") pod \"postgres-7cdbf6dc44-786hw\" (UID: \"6cc63a3a-db58-4a8b-bed4-3d7007f21e89\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"
Nov 04 01:19:52.527883 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.527769    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6cc63a3a-db58-4a8b-bed4-3d7007f21e89-data\") pod \"postgres-7cdbf6dc44-786hw\" (UID: \"6cc63a3a-db58-4a8b-bed4-3d7007f21e89\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"
Nov 04 01:19:52.628708 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.628670    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6cc63a3a-db58-4a8b-bed4-3d7007f21e89-data\") pod \"postgres-7cdbf6dc44-786hw\" (UID: \"6cc63a3a-db58-4a8b-bed4-3d7007f21e89\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"
Nov 04 01:19:52.628886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.628743    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p8bc\" (UniqueName: \"kubernetes.io/projected/6cc63a3a-db58-4a8b-bed4-3d7007f21e89-kube-api-access-2p8bc\") pod \"postgres-7cdbf6dc44-786hw\" (UID: \"6cc63a3a-db58-4a8b-bed4-3d7007f21e89\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"
Nov 04 01:19:52.629060 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.629041    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6cc63a3a-db58-4a8b-bed4-3d7007f21e89-data\") pod \"postgres-7cdbf6dc44-786hw\" (UID: \"6cc63a3a-db58-4a8b-bed4-3d7007f21e89\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"
Nov 04 01:19:52.686075 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.686011    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p8bc\" (UniqueName: \"kubernetes.io/projected/6cc63a3a-db58-4a8b-bed4-3d7007f21e89-kube-api-access-2p8bc\") pod \"postgres-7cdbf6dc44-786hw\" (UID: \"6cc63a3a-db58-4a8b-bed4-3d7007f21e89\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"
Nov 04 01:19:52.713955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:52.713931    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"
Nov 04 01:19:53.076493 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.076462    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"]
Nov 04 01:19:53.079926 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:19:53.079898    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc63a3a_db58_4a8b_bed4_3d7007f21e89.slice/crio-0f35c856c77358e517bd54f67b0488395e8a586234caa530ab03f7def7ffb74b WatchSource:0}: Error finding container 0f35c856c77358e517bd54f67b0488395e8a586234caa530ab03f7def7ffb74b: Status 404 returned error can't find the container with id 0f35c856c77358e517bd54f67b0488395e8a586234caa530ab03f7def7ffb74b
Nov 04 01:19:53.732450 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.732414    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"]
Nov 04 01:19:53.736854 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.736837    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:53.842361 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.842326    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdf41f43-9778-4459-bc1f-642932346788-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:53.842361 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.842363    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdf41f43-9778-4459-bc1f-642932346788-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:53.842581 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.842385    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cdf41f43-9778-4459-bc1f-642932346788-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:53.842581 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.842458    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8n5q\" (UniqueName: \"kubernetes.io/projected/cdf41f43-9778-4459-bc1f-642932346788-kube-api-access-m8n5q\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:53.881465 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.881429    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:53.925381 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.925354    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-gdbgn\""
Nov 04 01:19:53.925636 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.925560    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 04 01:19:53.925636 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.925598    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Nov 04 01:19:53.925769 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.925635    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 04 01:19:53.927033 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.927017    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"]
Nov 04 01:19:53.943433 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.943411    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdf41f43-9778-4459-bc1f-642932346788-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:53.943573 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.943450    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdf41f43-9778-4459-bc1f-642932346788-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:53.943573 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.943472    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cdf41f43-9778-4459-bc1f-642932346788-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:53.943573 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.943488    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8n5q\" (UniqueName: \"kubernetes.io/projected/cdf41f43-9778-4459-bc1f-642932346788-kube-api-access-m8n5q\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:53.943839 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.943817    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdf41f43-9778-4459-bc1f-642932346788-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:53.943925 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.943906    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cdf41f43-9778-4459-bc1f-642932346788-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:53.944253 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:53.944233    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cdf41f43-9778-4459-bc1f-642932346788-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:54.000882 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:54.000816    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8n5q\" (UniqueName: \"kubernetes.io/projected/cdf41f43-9778-4459-bc1f-642932346788-kube-api-access-m8n5q\") pod \"kserve-module-controller-manager-7566cf5fc8-d5rzd\" (UID: \"cdf41f43-9778-4459-bc1f-642932346788\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:54.024825 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:54.024795    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:19:54.050014 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:54.049979    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:54.079954 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:54.079922    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw" event={"ID":"6cc63a3a-db58-4a8b-bed4-3d7007f21e89","Type":"ContainerStarted","Data":"0f35c856c77358e517bd54f67b0488395e8a586234caa530ab03f7def7ffb74b"}
Nov 04 01:19:54.466317 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:54.466284    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"]
Nov 04 01:19:54.469113 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:19:54.469083    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf41f43_9778_4459_bc1f_642932346788.slice/crio-4a9d21f0bb1c81549cc1181d51d568f0034c7e41da0a6b44e4814538611457ee WatchSource:0}: Error finding container 4a9d21f0bb1c81549cc1181d51d568f0034c7e41da0a6b44e4814538611457ee: Status 404 returned error can't find the container with id 4a9d21f0bb1c81549cc1181d51d568f0034c7e41da0a6b44e4814538611457ee
Nov 04 01:19:55.085516 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:55.085471    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd" event={"ID":"cdf41f43-9778-4459-bc1f-642932346788","Type":"ContainerStarted","Data":"4a9d21f0bb1c81549cc1181d51d568f0034c7e41da0a6b44e4814538611457ee"}
Nov 04 01:19:59.116470 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:59.116431    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd" event={"ID":"cdf41f43-9778-4459-bc1f-642932346788","Type":"ContainerStarted","Data":"f3178976378be2652402b99291147c194325ac3c8e324c61af9ed0ba2e8264ea"}
Nov 04 01:19:59.117029 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:59.116528    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:19:59.274502 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:19:59.274445    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd" podStartSLOduration=2.542422556 podStartE2EDuration="6.274428288s" totalImagesPullingTime="3.732005732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:19:59.273712575 +0000 UTC m=+530.423920353" watchObservedRunningTime="2026-11-04 01:19:59.274428288 +0000 UTC m=+530.424636049"
Nov 04 01:20:01.127023 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:01.126991    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw" event={"ID":"6cc63a3a-db58-4a8b-bed4-3d7007f21e89","Type":"ContainerStarted","Data":"cc79823eaf24bc35f0fcece99a3fb08c8188a26306208d7c1ae5655090a48793"}
Nov 04 01:20:01.127442 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:01.127077    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"
Nov 04 01:20:01.236362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:01.236291    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw" podStartSLOduration=1.948736171 podStartE2EDuration="9.236273731s" totalImagesPullingTime="7.28753756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:19:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:20:01.234804273 +0000 UTC m=+532.385012032" watchObservedRunningTime="2026-11-04 01:20:01.236273731 +0000 UTC m=+532.386481497"
Nov 04 01:20:07.160474 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:07.160446    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-786hw"
Nov 04 01:20:13.198423 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:20:13.198377    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:20:14.299631 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.299598    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:14.366840 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.366805    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84564f7548-5s5tr"]
Nov 04 01:20:14.370284 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.370264    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:14.408637 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.408613    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwnt\" (UniqueName: \"kubernetes.io/projected/ac740c88-f944-4ff0-9be4-8c0356a28843-kube-api-access-lgwnt\") pod \"maas-controller-84564f7548-5s5tr\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") " pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:14.408758 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.408669    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-metrics-certs\") pod \"maas-controller-84564f7548-5s5tr\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") " pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:14.408820 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.408789    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-webhook-cert\") pod \"maas-controller-84564f7548-5s5tr\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") " pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:14.465708 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.465675    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zlj4d\""
Nov 04 01:20:14.465708 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.465702    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 04 01:20:14.465958 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.465677    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 04 01:20:14.465958 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.465787    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 04 01:20:14.467211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.467188    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84564f7548-5s5tr"]
Nov 04 01:20:14.509830 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.509806    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-metrics-certs\") pod \"maas-controller-84564f7548-5s5tr\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") " pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:14.509977 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.509866    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-webhook-cert\") pod \"maas-controller-84564f7548-5s5tr\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") " pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:14.509977 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.509893    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwnt\" (UniqueName: \"kubernetes.io/projected/ac740c88-f944-4ff0-9be4-8c0356a28843-kube-api-access-lgwnt\") pod \"maas-controller-84564f7548-5s5tr\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") " pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:14.512423 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.512397    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-webhook-cert\") pod \"maas-controller-84564f7548-5s5tr\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") " pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:14.512513 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.512398    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-metrics-certs\") pod \"maas-controller-84564f7548-5s5tr\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") " pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:14.568742 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.568667    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwnt\" (UniqueName: \"kubernetes.io/projected/ac740c88-f944-4ff0-9be4-8c0356a28843-kube-api-access-lgwnt\") pod \"maas-controller-84564f7548-5s5tr\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") " pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:14.682362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.682318    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:14.981928 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.981898    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-557bcb748c-j5ss5"]
Nov 04 01:20:14.985224 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:14.985205    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:15.013170 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.013137    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d-webhook-cert\") pod \"maas-controller-557bcb748c-j5ss5\" (UID: \"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d\") " pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:15.013301 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.013181    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqvdz\" (UniqueName: \"kubernetes.io/projected/b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d-kube-api-access-pqvdz\") pod \"maas-controller-557bcb748c-j5ss5\" (UID: \"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d\") " pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:15.013301 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.013289    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d-metrics-certs\") pod \"maas-controller-557bcb748c-j5ss5\" (UID: \"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d\") " pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:15.048504 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.048469    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-557bcb748c-j5ss5"]
Nov 04 01:20:15.106736 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.106712    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84564f7548-5s5tr"]
Nov 04 01:20:15.109383 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:20:15.109354    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac740c88_f944_4ff0_9be4_8c0356a28843.slice/crio-18060c4023f3d7d939954b7d4e42bcf3f02c3ab99029c46ae3e82c82bbfc8c16 WatchSource:0}: Error finding container 18060c4023f3d7d939954b7d4e42bcf3f02c3ab99029c46ae3e82c82bbfc8c16: Status 404 returned error can't find the container with id 18060c4023f3d7d939954b7d4e42bcf3f02c3ab99029c46ae3e82c82bbfc8c16
Nov 04 01:20:15.114701 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.114675    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d-webhook-cert\") pod \"maas-controller-557bcb748c-j5ss5\" (UID: \"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d\") " pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:15.114813 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.114725    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqvdz\" (UniqueName: \"kubernetes.io/projected/b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d-kube-api-access-pqvdz\") pod \"maas-controller-557bcb748c-j5ss5\" (UID: \"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d\") " pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:15.114813 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.114802    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d-metrics-certs\") pod \"maas-controller-557bcb748c-j5ss5\" (UID: \"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d\") " pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:15.117260 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.117232    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d-metrics-certs\") pod \"maas-controller-557bcb748c-j5ss5\" (UID: \"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d\") " pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:15.117342 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.117232    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d-webhook-cert\") pod \"maas-controller-557bcb748c-j5ss5\" (UID: \"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d\") " pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:15.172154 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.172122    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqvdz\" (UniqueName: \"kubernetes.io/projected/b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d-kube-api-access-pqvdz\") pod \"maas-controller-557bcb748c-j5ss5\" (UID: \"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d\") " pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:15.192187 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.192150    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84564f7548-5s5tr" event={"ID":"ac740c88-f944-4ff0-9be4-8c0356a28843","Type":"ContainerStarted","Data":"18060c4023f3d7d939954b7d4e42bcf3f02c3ab99029c46ae3e82c82bbfc8c16"}
Nov 04 01:20:15.297620 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.297512    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:15.501136 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.501103    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:15.662462 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:15.662388    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-557bcb748c-j5ss5"]
Nov 04 01:20:15.665911 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:20:15.665885    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1980d6a_2a7c_4042_882f_3f5ee4e9ad8d.slice/crio-9d215c4afa1be007fa96aa3a852c70961a86f678ff5521bc06dbb45c2ac726da WatchSource:0}: Error finding container 9d215c4afa1be007fa96aa3a852c70961a86f678ff5521bc06dbb45c2ac726da: Status 404 returned error can't find the container with id 9d215c4afa1be007fa96aa3a852c70961a86f678ff5521bc06dbb45c2ac726da
Nov 04 01:20:16.198096 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:16.198060    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557bcb748c-j5ss5" event={"ID":"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d","Type":"ContainerStarted","Data":"9d215c4afa1be007fa96aa3a852c70961a86f678ff5521bc06dbb45c2ac726da"}
Nov 04 01:20:20.122487 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:20.122410    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-d5rzd"
Nov 04 01:20:21.569205 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:21.569168    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:22.867323 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:22.867242    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:23.014966 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:23.014932    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:23.243440 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:23.243399    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84564f7548-5s5tr" event={"ID":"ac740c88-f944-4ff0-9be4-8c0356a28843","Type":"ContainerStarted","Data":"d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46"}
Nov 04 01:20:23.243636 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:23.243594    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:23.244910 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:23.244888    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557bcb748c-j5ss5" event={"ID":"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d","Type":"ContainerStarted","Data":"051a096c9e9ea7c926c63da5295eac8d66585e663790716a8091f9af23127808"}
Nov 04 01:20:23.245046 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:23.245029    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:23.354708 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:23.354648    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-84564f7548-5s5tr" podStartSLOduration=1.992039858 podStartE2EDuration="9.354633858s" totalImagesPullingTime="7.362594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:20:23.353599574 +0000 UTC m=+554.503807333" watchObservedRunningTime="2026-11-04 01:20:23.354633858 +0000 UTC m=+554.504841616"
Nov 04 01:20:23.464578 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:23.464501    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-557bcb748c-j5ss5" podStartSLOduration=2.6677188750000003 podStartE2EDuration="9.464485439s" totalImagesPullingTime="6.796766564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:20:23.463024753 +0000 UTC m=+554.613232512" watchObservedRunningTime="2026-11-04 01:20:23.464485439 +0000 UTC m=+554.614693221"
Nov 04 01:20:25.961262 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:25.961227    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"]
Nov 04 01:20:25.965237 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:25.965215    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.008935 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.008898    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2656018a-6a83-4de6-89fe-1790533d3472-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.008935 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.008936    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prscl\" (UniqueName: \"kubernetes.io/projected/2656018a-6a83-4de6-89fe-1790533d3472-kube-api-access-prscl\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.009112 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.009092    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2656018a-6a83-4de6-89fe-1790533d3472-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.009159 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.009142    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/2656018a-6a83-4de6-89fe-1790533d3472-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.013636 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.013613    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Nov 04 01:20:26.013731 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.013641    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Nov 04 01:20:26.059940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.059911    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-6b28f\""
Nov 04 01:20:26.060111 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.059949    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Nov 04 01:20:26.062451 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.062425    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"]
Nov 04 01:20:26.109870 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.109835    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2656018a-6a83-4de6-89fe-1790533d3472-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.109870 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.109872    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prscl\" (UniqueName: \"kubernetes.io/projected/2656018a-6a83-4de6-89fe-1790533d3472-kube-api-access-prscl\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.110126 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.109939    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2656018a-6a83-4de6-89fe-1790533d3472-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.110126 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.110006    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/2656018a-6a83-4de6-89fe-1790533d3472-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.110126 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:20:26.110108    5572 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found
Nov 04 01:20:26.110256 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:20:26.110188    5572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2656018a-6a83-4de6-89fe-1790533d3472-proxy-source podName:2656018a-6a83-4de6-89fe-1790533d3472 nodeName:}" failed. No retries permitted until 2026-11-04 01:20:26.610167116 +0000 UTC m=+557.760374868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/2656018a-6a83-4de6-89fe-1790533d3472-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-lcrv9" (UID: "2656018a-6a83-4de6-89fe-1790533d3472") : configmap "usage-tenancy-proxy-source" not found
Nov 04 01:20:26.110524 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:20:26.110500    5572 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found
Nov 04 01:20:26.110701 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.110667    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2656018a-6a83-4de6-89fe-1790533d3472-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.110780 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:20:26.110767    5572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2656018a-6a83-4de6-89fe-1790533d3472-tls-cert podName:2656018a-6a83-4de6-89fe-1790533d3472 nodeName:}" failed. No retries permitted until 2026-11-04 01:20:26.610752364 +0000 UTC m=+557.760960116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/2656018a-6a83-4de6-89fe-1790533d3472-tls-cert") pod "usage-logs-tenancy-proxy-9c5d49bcd-lcrv9" (UID: "2656018a-6a83-4de6-89fe-1790533d3472") : secret "usage-logs-tenancy-proxy-tls" not found
Nov 04 01:20:26.117740 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.117695    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:26.170760 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.170726    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prscl\" (UniqueName: \"kubernetes.io/projected/2656018a-6a83-4de6-89fe-1790533d3472-kube-api-access-prscl\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.305045 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.304961    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:26.615221 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.615126    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2656018a-6a83-4de6-89fe-1790533d3472-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.615221 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.615200    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/2656018a-6a83-4de6-89fe-1790533d3472-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.615998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.615971    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/2656018a-6a83-4de6-89fe-1790533d3472-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.617586 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.617562    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2656018a-6a83-4de6-89fe-1790533d3472-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-lcrv9\" (UID: \"2656018a-6a83-4de6-89fe-1790533d3472\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:26.877767 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:26.877681    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:27.242226 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:27.242197    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"]
Nov 04 01:20:27.245481 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:20:27.245455    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2656018a_6a83_4de6_89fe_1790533d3472.slice/crio-011b795ecfcb5eeeb2c16b8828eeeffee1d3eb524f5e97cbcd94a3b27276295d WatchSource:0}: Error finding container 011b795ecfcb5eeeb2c16b8828eeeffee1d3eb524f5e97cbcd94a3b27276295d: Status 404 returned error can't find the container with id 011b795ecfcb5eeeb2c16b8828eeeffee1d3eb524f5e97cbcd94a3b27276295d
Nov 04 01:20:27.263990 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:27.263965    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9" event={"ID":"2656018a-6a83-4de6-89fe-1790533d3472","Type":"ContainerStarted","Data":"011b795ecfcb5eeeb2c16b8828eeeffee1d3eb524f5e97cbcd94a3b27276295d"}
Nov 04 01:20:31.551350 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:31.551268    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:34.253981 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:34.253945    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:20:34.254471 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:34.254043    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:34.414071 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:34.414037    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84564f7548-5s5tr"]
Nov 04 01:20:34.414304 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:34.414242    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-84564f7548-5s5tr" podUID="ac740c88-f944-4ff0-9be4-8c0356a28843" containerName="manager" containerID="cri-o://d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46" gracePeriod=30
Nov 04 01:20:35.211140 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.211108    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:35.293664 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.293576    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac740c88-f944-4ff0-9be4-8c0356a28843-kube-api-access-lgwnt\" (UniqueName: \"kubernetes.io/projected/ac740c88-f944-4ff0-9be4-8c0356a28843-kube-api-access-lgwnt\") pod \"ac740c88-f944-4ff0-9be4-8c0356a28843\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") "
Nov 04 01:20:35.293664 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.293644    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-webhook-cert\") pod \"ac740c88-f944-4ff0-9be4-8c0356a28843\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") "
Nov 04 01:20:35.294300 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.293681    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-metrics-certs\") pod \"ac740c88-f944-4ff0-9be4-8c0356a28843\" (UID: \"ac740c88-f944-4ff0-9be4-8c0356a28843\") "
Nov 04 01:20:35.296998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.296964    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac740c88-f944-4ff0-9be4-8c0356a28843-kube-api-access-lgwnt" pod "ac740c88-f944-4ff0-9be4-8c0356a28843" (UID: "ac740c88-f944-4ff0-9be4-8c0356a28843"). InnerVolumeSpecName "kube-api-access-lgwnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:20:35.297119 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.297017    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-metrics-certs" pod "ac740c88-f944-4ff0-9be4-8c0356a28843" (UID: "ac740c88-f944-4ff0-9be4-8c0356a28843"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:20:35.299356 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.299327    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-webhook-cert" pod "ac740c88-f944-4ff0-9be4-8c0356a28843" (UID: "ac740c88-f944-4ff0-9be4-8c0356a28843"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:20:35.316444 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.316410    5572 generic.go:356] "Generic (PLEG): container finished" podID="ac740c88-f944-4ff0-9be4-8c0356a28843" containerID="d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46" exitCode=0
Nov 04 01:20:35.316581 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.316475    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84564f7548-5s5tr" event={"ID":"ac740c88-f944-4ff0-9be4-8c0356a28843","Type":"ContainerDied","Data":"d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46"}
Nov 04 01:20:35.316581 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.316523    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84564f7548-5s5tr" event={"ID":"ac740c88-f944-4ff0-9be4-8c0356a28843","Type":"ContainerDied","Data":"18060c4023f3d7d939954b7d4e42bcf3f02c3ab99029c46ae3e82c82bbfc8c16"}
Nov 04 01:20:35.316581 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.316576    5572 scope.go:122] "RemoveContainer" containerID="d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46"
Nov 04 01:20:35.316764 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.316746    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84564f7548-5s5tr"
Nov 04 01:20:35.336313 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.336204    5572 scope.go:122] "RemoveContainer" containerID="d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46"
Nov 04 01:20:35.336592 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:20:35.336561    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46\": container with ID starting with d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46 not found: ID does not exist" containerID="d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46"
Nov 04 01:20:35.336715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.336603    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46"} err="failed to get container status \"d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46\": rpc error: code = NotFound desc = could not find container \"d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46\": container with ID starting with d884664328863a990b656839832e0f467cf63dd6fe1df6e41676b4ab3cabcc46 not found: ID does not exist"
Nov 04 01:20:35.394882 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.394843    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgwnt\" (UniqueName: \"kubernetes.io/projected/ac740c88-f944-4ff0-9be4-8c0356a28843-kube-api-access-lgwnt\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:20:35.394882 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.394882    5572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-webhook-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:20:35.395155 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.394898    5572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac740c88-f944-4ff0-9be4-8c0356a28843-metrics-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:20:35.476964 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.476924    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84564f7548-5s5tr"]
Nov 04 01:20:35.480805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:35.480777    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84564f7548-5s5tr"]
Nov 04 01:20:36.974109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:36.974065    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac740c88-f944-4ff0-9be4-8c0356a28843" path="/var/lib/kubelet/pods/ac740c88-f944-4ff0-9be4-8c0356a28843/volumes"
Nov 04 01:20:41.353449 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:41.353408    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9" event={"ID":"2656018a-6a83-4de6-89fe-1790533d3472","Type":"ContainerStarted","Data":"f356aa8a3223455163e6d2d91f50cd368e71fca796045e8953bdab61559a142c"}
Nov 04 01:20:41.353947 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:41.353632    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:41.463473 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:41.463415    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9" podStartSLOduration=2.545133542 podStartE2EDuration="16.463399237s" totalImagesPullingTime="13.918265695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:20:41.462459549 +0000 UTC m=+572.612667310" watchObservedRunningTime="2026-11-04 01:20:41.463399237 +0000 UTC m=+572.613607001"
Nov 04 01:20:43.198076 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:20:43.198042    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:20:52.367878 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:52.367845    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-lcrv9"
Nov 04 01:20:54.410632 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:54.410594    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:54.556799 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:54.556762    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:56.618980 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:56.618948    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:56.794593 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:56.794555    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:56.947464 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:56.947429    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:57.168193 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.168165    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:20:57.675633 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.675602    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"]
Nov 04 01:20:57.676030 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.675955    5572 cpu_manager.go:414] "containerMap: removing container" podUID="ac740c88-f944-4ff0-9be4-8c0356a28843" containerName="manager"
Nov 04 01:20:57.676030 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.675966    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac740c88-f944-4ff0-9be4-8c0356a28843" containerName="manager"
Nov 04 01:20:57.676100 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.676035    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac740c88-f944-4ff0-9be4-8c0356a28843" containerName="manager"
Nov 04 01:20:57.681468 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.681443    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.734548 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.734496    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"]
Nov 04 01:20:57.778886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.778835    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 04 01:20:57.779065 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.778919    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 04 01:20:57.779065 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.779007    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jfk6s\""
Nov 04 01:20:57.802218 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.802190    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5603bbf-4e59-4a87-b657-1fe3566072e3-openshift-service-ca\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.802218 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.802220    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-maas-api-tls\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.802398 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.802237    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tnfk\" (UniqueName: \"kubernetes.io/projected/b5603bbf-4e59-4a87-b657-1fe3566072e3-kube-api-access-9tnfk\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.802398 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.802312    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-metrics-certs\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.903766 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.903732    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5603bbf-4e59-4a87-b657-1fe3566072e3-openshift-service-ca\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.903952 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.903772    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-maas-api-tls\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.903952 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.903796    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tnfk\" (UniqueName: \"kubernetes.io/projected/b5603bbf-4e59-4a87-b657-1fe3566072e3-kube-api-access-9tnfk\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.903952 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.903835    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-metrics-certs\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.904523 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.904487    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5603bbf-4e59-4a87-b657-1fe3566072e3-openshift-service-ca\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.906418 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.906388    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-metrics-certs\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.906521 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.906474    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-maas-api-tls\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.965250 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.965213    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tnfk\" (UniqueName: \"kubernetes.io/projected/b5603bbf-4e59-4a87-b657-1fe3566072e3-kube-api-access-9tnfk\") pod \"maas-api-57889785b6-l9hqg\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") " pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:57.992933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:57.992909    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:20:58.369384 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:58.369298    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"]
Nov 04 01:20:58.372080 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:20:58.372054    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5603bbf_4e59_4a87_b657_1fe3566072e3.slice/crio-2fccbcfb1136977cc23319a0b913e381d9cb1307fdf7894552a139245b417688 WatchSource:0}: Error finding container 2fccbcfb1136977cc23319a0b913e381d9cb1307fdf7894552a139245b417688: Status 404 returned error can't find the container with id 2fccbcfb1136977cc23319a0b913e381d9cb1307fdf7894552a139245b417688
Nov 04 01:20:58.438993 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:20:58.438959    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg" event={"ID":"b5603bbf-4e59-4a87-b657-1fe3566072e3","Type":"ContainerStarted","Data":"2fccbcfb1136977cc23319a0b913e381d9cb1307fdf7894552a139245b417688"}
Nov 04 01:21:04.071234 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:04.071123    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:04.212960 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:04.212924    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:04.382122 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:04.382023    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:04.527806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:04.527761    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:04.671628 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:04.671494    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:04.814932 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:04.814890    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:04.972408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:04.972371    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:04.986061 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:04.986020    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-9vstw"]
Nov 04 01:21:04.990329 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:04.990303    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw"
Nov 04 01:21:05.087298 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.087260    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7hfgh\""
Nov 04 01:21:05.087801 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.087404    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Nov 04 01:21:05.088929 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.088891    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssxdb\" (UniqueName: \"kubernetes.io/projected/84f236fc-de75-4d71-b3a0-90edd2769871-kube-api-access-ssxdb\") pod \"kserve-controller-manager-776cc66d47-9vstw\" (UID: \"84f236fc-de75-4d71-b3a0-90edd2769871\") " pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw"
Nov 04 01:21:05.089139 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.089048    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84f236fc-de75-4d71-b3a0-90edd2769871-cert\") pod \"kserve-controller-manager-776cc66d47-9vstw\" (UID: \"84f236fc-de75-4d71-b3a0-90edd2769871\") " pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw"
Nov 04 01:21:05.089867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.089846    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-9vstw"]
Nov 04 01:21:05.106058 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.106034    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"]
Nov 04 01:21:05.109450 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.109430    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:21:05.118366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.118340    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:05.170987 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.170957    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zmhxc\""
Nov 04 01:21:05.171229 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.171206    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Nov 04 01:21:05.174188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.174145    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"]
Nov 04 01:21:05.190265 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.190225    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85vqb\" (UniqueName: \"kubernetes.io/projected/ebf9be32-40a9-4994-8afd-66db448b787d-kube-api-access-85vqb\") pod \"llmisvc-controller-manager-869d5dcc5d-dv8d8\" (UID: \"ebf9be32-40a9-4994-8afd-66db448b787d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:21:05.190427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.190289    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssxdb\" (UniqueName: \"kubernetes.io/projected/84f236fc-de75-4d71-b3a0-90edd2769871-kube-api-access-ssxdb\") pod \"kserve-controller-manager-776cc66d47-9vstw\" (UID: \"84f236fc-de75-4d71-b3a0-90edd2769871\") " pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw"
Nov 04 01:21:05.190427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.190353    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebf9be32-40a9-4994-8afd-66db448b787d-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-dv8d8\" (UID: \"ebf9be32-40a9-4994-8afd-66db448b787d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:21:05.190621 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.190594    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84f236fc-de75-4d71-b3a0-90edd2769871-cert\") pod \"kserve-controller-manager-776cc66d47-9vstw\" (UID: \"84f236fc-de75-4d71-b3a0-90edd2769871\") " pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw"
Nov 04 01:21:05.199013 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.198973    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84f236fc-de75-4d71-b3a0-90edd2769871-cert\") pod \"kserve-controller-manager-776cc66d47-9vstw\" (UID: \"84f236fc-de75-4d71-b3a0-90edd2769871\") " pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw"
Nov 04 01:21:05.225103 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.225039    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-znvc4"]
Nov 04 01:21:05.227845 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.227823    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-znvc4"
Nov 04 01:21:05.273259 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.273225    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssxdb\" (UniqueName: \"kubernetes.io/projected/84f236fc-de75-4d71-b3a0-90edd2769871-kube-api-access-ssxdb\") pod \"kserve-controller-manager-776cc66d47-9vstw\" (UID: \"84f236fc-de75-4d71-b3a0-90edd2769871\") " pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw"
Nov 04 01:21:05.276814 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.276782    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Nov 04 01:21:05.276938 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.276847    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-kpchv\""
Nov 04 01:21:05.288497 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.288464    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-znvc4"]
Nov 04 01:21:05.291305 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.291158    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebf9be32-40a9-4994-8afd-66db448b787d-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-dv8d8\" (UID: \"ebf9be32-40a9-4994-8afd-66db448b787d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:21:05.291305 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.291284    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2b46\" (UniqueName: \"kubernetes.io/projected/4821f02c-3b08-49a1-a920-a382799ea98c-kube-api-access-m2b46\") pod \"model-serving-api-75bd89fdfc-znvc4\" (UID: \"4821f02c-3b08-49a1-a920-a382799ea98c\") " pod="opendatahub/model-serving-api-75bd89fdfc-znvc4"
Nov 04 01:21:05.291520 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.291329    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85vqb\" (UniqueName: \"kubernetes.io/projected/ebf9be32-40a9-4994-8afd-66db448b787d-kube-api-access-85vqb\") pod \"llmisvc-controller-manager-869d5dcc5d-dv8d8\" (UID: \"ebf9be32-40a9-4994-8afd-66db448b787d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:21:05.291520 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.291387    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4821f02c-3b08-49a1-a920-a382799ea98c-tls-certs\") pod \"model-serving-api-75bd89fdfc-znvc4\" (UID: \"4821f02c-3b08-49a1-a920-a382799ea98c\") " pod="opendatahub/model-serving-api-75bd89fdfc-znvc4"
Nov 04 01:21:05.293741 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.293720    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebf9be32-40a9-4994-8afd-66db448b787d-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-dv8d8\" (UID: \"ebf9be32-40a9-4994-8afd-66db448b787d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:21:05.304802 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.304776    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw"
Nov 04 01:21:05.375207 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.375079    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85vqb\" (UniqueName: \"kubernetes.io/projected/ebf9be32-40a9-4994-8afd-66db448b787d-kube-api-access-85vqb\") pod \"llmisvc-controller-manager-869d5dcc5d-dv8d8\" (UID: \"ebf9be32-40a9-4994-8afd-66db448b787d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:21:05.376049 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.376022    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-pxmvp"]
Nov 04 01:21:05.378690 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.378671    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:05.392026 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.391918    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4821f02c-3b08-49a1-a920-a382799ea98c-tls-certs\") pod \"model-serving-api-75bd89fdfc-znvc4\" (UID: \"4821f02c-3b08-49a1-a920-a382799ea98c\") " pod="opendatahub/model-serving-api-75bd89fdfc-znvc4"
Nov 04 01:21:05.392026 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.391950    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc5s9\" (UniqueName: \"kubernetes.io/projected/549a02b6-e1d7-4149-a87d-e27e305e9371-kube-api-access-dc5s9\") pod \"odh-model-controller-769875db56-pxmvp\" (UID: \"549a02b6-e1d7-4149-a87d-e27e305e9371\") " pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:05.392026 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.391975    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/549a02b6-e1d7-4149-a87d-e27e305e9371-cert\") pod \"odh-model-controller-769875db56-pxmvp\" (UID: \"549a02b6-e1d7-4149-a87d-e27e305e9371\") " pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:05.392026 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.392016    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/549a02b6-e1d7-4149-a87d-e27e305e9371-metrics-certs\") pod \"odh-model-controller-769875db56-pxmvp\" (UID: \"549a02b6-e1d7-4149-a87d-e27e305e9371\") " pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:05.392319 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.392043    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2b46\" (UniqueName: \"kubernetes.io/projected/4821f02c-3b08-49a1-a920-a382799ea98c-kube-api-access-m2b46\") pod \"model-serving-api-75bd89fdfc-znvc4\" (UID: \"4821f02c-3b08-49a1-a920-a382799ea98c\") " pod="opendatahub/model-serving-api-75bd89fdfc-znvc4"
Nov 04 01:21:05.396287 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.396245    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4821f02c-3b08-49a1-a920-a382799ea98c-tls-certs\") pod \"model-serving-api-75bd89fdfc-znvc4\" (UID: \"4821f02c-3b08-49a1-a920-a382799ea98c\") " pod="opendatahub/model-serving-api-75bd89fdfc-znvc4"
Nov 04 01:21:05.411951 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.411869    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-pxmvp"]
Nov 04 01:21:05.422684 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.422639    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:21:05.428101 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.427967    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xwdvq\""
Nov 04 01:21:05.428101 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.428082    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Nov 04 01:21:05.428101 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.428087    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Nov 04 01:21:05.474073 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.474040    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2b46\" (UniqueName: \"kubernetes.io/projected/4821f02c-3b08-49a1-a920-a382799ea98c-kube-api-access-m2b46\") pod \"model-serving-api-75bd89fdfc-znvc4\" (UID: \"4821f02c-3b08-49a1-a920-a382799ea98c\") " pod="opendatahub/model-serving-api-75bd89fdfc-znvc4"
Nov 04 01:21:05.493387 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.493309    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc5s9\" (UniqueName: \"kubernetes.io/projected/549a02b6-e1d7-4149-a87d-e27e305e9371-kube-api-access-dc5s9\") pod \"odh-model-controller-769875db56-pxmvp\" (UID: \"549a02b6-e1d7-4149-a87d-e27e305e9371\") " pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:05.493387 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.493361    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/549a02b6-e1d7-4149-a87d-e27e305e9371-cert\") pod \"odh-model-controller-769875db56-pxmvp\" (UID: \"549a02b6-e1d7-4149-a87d-e27e305e9371\") " pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:05.493609 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.493419    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/549a02b6-e1d7-4149-a87d-e27e305e9371-metrics-certs\") pod \"odh-model-controller-769875db56-pxmvp\" (UID: \"549a02b6-e1d7-4149-a87d-e27e305e9371\") " pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:05.496300 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.496268    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/549a02b6-e1d7-4149-a87d-e27e305e9371-cert\") pod \"odh-model-controller-769875db56-pxmvp\" (UID: \"549a02b6-e1d7-4149-a87d-e27e305e9371\") " pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:05.496436 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.496419    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/549a02b6-e1d7-4149-a87d-e27e305e9371-metrics-certs\") pod \"odh-model-controller-769875db56-pxmvp\" (UID: \"549a02b6-e1d7-4149-a87d-e27e305e9371\") " pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:05.541417 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.541328    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-znvc4"
Nov 04 01:21:05.573431 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.573374    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc5s9\" (UniqueName: \"kubernetes.io/projected/549a02b6-e1d7-4149-a87d-e27e305e9371-kube-api-access-dc5s9\") pod \"odh-model-controller-769875db56-pxmvp\" (UID: \"549a02b6-e1d7-4149-a87d-e27e305e9371\") " pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:05.693645 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.693621    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:05.703432 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.703406    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-9vstw"]
Nov 04 01:21:05.706501 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:21:05.706478    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f236fc_de75_4d71_b3a0_90edd2769871.slice/crio-d5116e53975092b77ca2614c723dedd9d26666d21ef93694ddaacd55dcf0e913 WatchSource:0}: Error finding container d5116e53975092b77ca2614c723dedd9d26666d21ef93694ddaacd55dcf0e913: Status 404 returned error can't find the container with id d5116e53975092b77ca2614c723dedd9d26666d21ef93694ddaacd55dcf0e913
Nov 04 01:21:05.827787 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.827715    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"]
Nov 04 01:21:05.830203 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:21:05.830176    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podebf9be32_40a9_4994_8afd_66db448b787d.slice/crio-375986cf673b5fafada4a57c928bd86d5f674db3ceccb4d0d5715ba2911ebb79 WatchSource:0}: Error finding container 375986cf673b5fafada4a57c928bd86d5f674db3ceccb4d0d5715ba2911ebb79: Status 404 returned error can't find the container with id 375986cf673b5fafada4a57c928bd86d5f674db3ceccb4d0d5715ba2911ebb79
Nov 04 01:21:05.934870 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:05.934824    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-znvc4"]
Nov 04 01:21:05.939162 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:21:05.939126    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4821f02c_3b08_49a1_a920_a382799ea98c.slice/crio-f76aaac2c6832dd26ed034c48624c11197edb24e0ec9157f90edb9ddb99fcb07 WatchSource:0}: Error finding container f76aaac2c6832dd26ed034c48624c11197edb24e0ec9157f90edb9ddb99fcb07: Status 404 returned error can't find the container with id f76aaac2c6832dd26ed034c48624c11197edb24e0ec9157f90edb9ddb99fcb07
Nov 04 01:21:06.089793 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:06.089598    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-pxmvp"]
Nov 04 01:21:06.092444 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:21:06.092418    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549a02b6_e1d7_4149_a87d_e27e305e9371.slice/crio-9f088a6ff54e46930cc99a50978dd78a1ed6ca30260ca3a40fe87371057b5a6b WatchSource:0}: Error finding container 9f088a6ff54e46930cc99a50978dd78a1ed6ca30260ca3a40fe87371057b5a6b: Status 404 returned error can't find the container with id 9f088a6ff54e46930cc99a50978dd78a1ed6ca30260ca3a40fe87371057b5a6b
Nov 04 01:21:06.424391 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:06.424323    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:06.490180 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:06.490140    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8" event={"ID":"ebf9be32-40a9-4994-8afd-66db448b787d","Type":"ContainerStarted","Data":"375986cf673b5fafada4a57c928bd86d5f674db3ceccb4d0d5715ba2911ebb79"}
Nov 04 01:21:06.491414 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:06.491386    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-znvc4" event={"ID":"4821f02c-3b08-49a1-a920-a382799ea98c","Type":"ContainerStarted","Data":"f76aaac2c6832dd26ed034c48624c11197edb24e0ec9157f90edb9ddb99fcb07"}
Nov 04 01:21:06.492986 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:06.492959    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg" event={"ID":"b5603bbf-4e59-4a87-b657-1fe3566072e3","Type":"ContainerStarted","Data":"cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf"}
Nov 04 01:21:06.493111 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:06.493012    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:21:06.494156 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:06.494131    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-pxmvp" event={"ID":"549a02b6-e1d7-4149-a87d-e27e305e9371","Type":"ContainerStarted","Data":"9f088a6ff54e46930cc99a50978dd78a1ed6ca30260ca3a40fe87371057b5a6b"}
Nov 04 01:21:06.495176 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:06.495157    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw" event={"ID":"84f236fc-de75-4d71-b3a0-90edd2769871","Type":"ContainerStarted","Data":"d5116e53975092b77ca2614c723dedd9d26666d21ef93694ddaacd55dcf0e913"}
Nov 04 01:21:06.603995 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:06.603940    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg" podStartSLOduration=2.340504197 podStartE2EDuration="9.603924827s" totalImagesPullingTime="7.26342063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:21:06.603228269 +0000 UTC m=+597.753436028" watchObservedRunningTime="2026-11-04 01:21:06.603924827 +0000 UTC m=+597.754132587"
Nov 04 01:21:11.533595 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:11.533546    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw" event={"ID":"84f236fc-de75-4d71-b3a0-90edd2769871","Type":"ContainerStarted","Data":"5e4e380bdcf03212409d4727109c5b58900e0bc99129cee5ebadd3b3a704cf71"}
Nov 04 01:21:11.534206 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:11.533642    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw"
Nov 04 01:21:11.535339 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:11.535309    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8" event={"ID":"ebf9be32-40a9-4994-8afd-66db448b787d","Type":"ContainerStarted","Data":"019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4"}
Nov 04 01:21:11.535448 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:11.535376    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:21:11.536924 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:11.536902    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-znvc4" event={"ID":"4821f02c-3b08-49a1-a920-a382799ea98c","Type":"ContainerStarted","Data":"1457c9607851d195a39b95ef3c45b74398ec4910da16735884ad7865d513237b"}
Nov 04 01:21:11.537051 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:11.537038    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-znvc4"
Nov 04 01:21:11.644174 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:11.644124    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw" podStartSLOduration=2.322985748 podStartE2EDuration="7.644110185s" totalImagesPullingTime="5.321124437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:21:11.642520856 +0000 UTC m=+602.792728617" watchObservedRunningTime="2026-11-04 01:21:11.644110185 +0000 UTC m=+602.794317944"
Nov 04 01:21:11.752685 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:11.752632    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8" podStartSLOduration=1.550091822 podStartE2EDuration="6.752618588s" totalImagesPullingTime="5.202526766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:21:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:21:11.751018318 +0000 UTC m=+602.901226080" watchObservedRunningTime="2026-11-04 01:21:11.752618588 +0000 UTC m=+602.902826347"
Nov 04 01:21:11.826580 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:11.826491    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:11.863036 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:11.862957    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-znvc4" podStartSLOduration=1.7752852510000001 podStartE2EDuration="6.862942144s" totalImagesPullingTime="5.087656893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:21:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:21:11.862232203 +0000 UTC m=+603.012439963" watchObservedRunningTime="2026-11-04 01:21:11.862942144 +0000 UTC m=+603.013149902"
Nov 04 01:21:11.969487 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:11.969428    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:12.114504 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:12.114418    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:12.256434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:12.256395    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:12.397528 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:12.397446    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:12.508637 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:12.508608    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:21:12.597793 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:12.597763    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:12.740203 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:12.740179    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:12.882340 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:12.882308    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:13.027691 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.027660    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:13.177378 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.177342    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:13.198793 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:21:13.198752    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:21:13.321638 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.321551    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:13.549866 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.549782    5572 generic.go:356] "Generic (PLEG): container finished" podID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerID="7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595" exitCode=0
Nov 04 01:21:13.550035 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.549861    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" event={"ID":"7861fe1b-d946-4a30-bb32-53d82f3f969b","Type":"ContainerDied","Data":"7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595"}
Nov 04 01:21:13.550503 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.550326    5572 scope.go:122] "RemoveContainer" containerID="7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595"
Nov 04 01:21:13.551651 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.551622    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:21:13.551764 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.551710    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:21:13.551826 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.551759    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:21:13.552032 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.552004    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-pxmvp" event={"ID":"549a02b6-e1d7-4149-a87d-e27e305e9371","Type":"ContainerStarted","Data":"f29d2dc8156c66a27aa6e33db05a23eee1909bebafdfbad75ff1a8c47e420e7a"}
Nov 04 01:21:13.552168 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.552148    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:13.776344 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:13.776292    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-pxmvp" podStartSLOduration=2.201314221 podStartE2EDuration="8.776275958s" totalImagesPullingTime="6.574961737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:21:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:21:13.774868809 +0000 UTC m=+604.925076571" watchObservedRunningTime="2026-11-04 01:21:13.776275958 +0000 UTC m=+604.926483718"
Nov 04 01:21:14.460558 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:14.454629    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:21:14.574693 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:14.574660    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" event={"ID":"7861fe1b-d946-4a30-bb32-53d82f3f969b","Type":"ContainerStarted","Data":"bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749"}
Nov 04 01:21:14.723938 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:14.723850    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:21:14.724949 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:14.724923    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-wbbff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Nov 04 01:21:14.725030 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:14.724976    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Nov 04 01:21:15.723971 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:15.723929    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-wbbff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Nov 04 01:21:15.724449 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:15.723991    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Nov 04 01:21:16.723974 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:16.723944    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-wbbff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Nov 04 01:21:16.724356 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:16.723989    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Nov 04 01:21:17.724358 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:17.724322    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-wbbff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Nov 04 01:21:17.724773 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:17.724372    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Nov 04 01:21:18.724059 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:18.724025    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-wbbff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body=
Nov 04 01:21:18.724234 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:18.724076    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused"
Nov 04 01:21:19.727509 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:19.727478    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:21:19.727987 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:19.727764    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:21:19.728714 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:19.728696    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:21:19.947420 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:19.947382    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nq9z2"]
Nov 04 01:21:19.947658 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:19.947631    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2" podUID="e5f33fbb-b2fc-4366-a050-ed5938674555" containerName="authorino" containerID="cri-o://17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345" gracePeriod=30
Nov 04 01:21:20.200292 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.200267    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2"
Nov 04 01:21:20.238291 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.238228    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e5f33fbb-b2fc-4366-a050-ed5938674555-kube-api-access-z4rck\" (UniqueName: \"kubernetes.io/projected/e5f33fbb-b2fc-4366-a050-ed5938674555-kube-api-access-z4rck\") pod \"e5f33fbb-b2fc-4366-a050-ed5938674555\" (UID: \"e5f33fbb-b2fc-4366-a050-ed5938674555\") "
Nov 04 01:21:20.240263 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.240240    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5f33fbb-b2fc-4366-a050-ed5938674555-kube-api-access-z4rck" pod "e5f33fbb-b2fc-4366-a050-ed5938674555" (UID: "e5f33fbb-b2fc-4366-a050-ed5938674555"). InnerVolumeSpecName "kube-api-access-z4rck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:21:20.339285 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.339252    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4rck\" (UniqueName: \"kubernetes.io/projected/e5f33fbb-b2fc-4366-a050-ed5938674555-kube-api-access-z4rck\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:20.608942 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.608847    5572 generic.go:356] "Generic (PLEG): container finished" podID="e5f33fbb-b2fc-4366-a050-ed5938674555" containerID="17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345" exitCode=0
Nov 04 01:21:20.608942 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.608890    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2"
Nov 04 01:21:20.608942 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.608927    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2" event={"ID":"e5f33fbb-b2fc-4366-a050-ed5938674555","Type":"ContainerDied","Data":"17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345"}
Nov 04 01:21:20.609226 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.608965    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-nq9z2" event={"ID":"e5f33fbb-b2fc-4366-a050-ed5938674555","Type":"ContainerDied","Data":"09b7e678bad134e121f80ccccc964bfcf7db9c743c433145b712c0d47a948986"}
Nov 04 01:21:20.609226 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.608987    5572 scope.go:122] "RemoveContainer" containerID="17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345"
Nov 04 01:21:20.618049 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.618033    5572 scope.go:122] "RemoveContainer" containerID="17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345"
Nov 04 01:21:20.618346 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:21:20.618311    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345\": container with ID starting with 17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345 not found: ID does not exist" containerID="17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345"
Nov 04 01:21:20.618427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.618353    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345"} err="failed to get container status \"17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345\": rpc error: code = NotFound desc = could not find container \"17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345\": container with ID starting with 17c8f7f610155bfa49abb489926c6e77b510e405c36b2e9b18ace0eab0e2f345 not found: ID does not exist"
Nov 04 01:21:20.761666 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.761629    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nq9z2"]
Nov 04 01:21:20.766105 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.766075    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-nq9z2"]
Nov 04 01:21:20.971290 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:20.971248    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e5f33fbb-b2fc-4366-a050-ed5938674555" path="/var/lib/kubelet/pods/e5f33fbb-b2fc-4366-a050-ed5938674555/volumes"
Nov 04 01:21:21.958392 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:21.958359    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:22.549060 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:22.549030    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-znvc4"
Nov 04 01:21:24.576468 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:24.576436    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-pxmvp"
Nov 04 01:21:25.963242 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:25.963206    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"]
Nov 04 01:21:25.963739 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:25.963459    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg" podUID="b5603bbf-4e59-4a87-b657-1fe3566072e3" containerName="maas-api" containerID="cri-o://cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf" gracePeriod=30
Nov 04 01:21:26.210976 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.210944    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:21:26.293612 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.293520    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-maas-api-tls\") pod \"b5603bbf-4e59-4a87-b657-1fe3566072e3\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") "
Nov 04 01:21:26.293612 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.293574    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-metrics-certs\") pod \"b5603bbf-4e59-4a87-b657-1fe3566072e3\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") "
Nov 04 01:21:26.293795 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.293665    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b5603bbf-4e59-4a87-b657-1fe3566072e3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5603bbf-4e59-4a87-b657-1fe3566072e3-openshift-service-ca\") pod \"b5603bbf-4e59-4a87-b657-1fe3566072e3\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") "
Nov 04 01:21:26.293795 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.293706    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5603bbf-4e59-4a87-b657-1fe3566072e3-kube-api-access-9tnfk\" (UniqueName: \"kubernetes.io/projected/b5603bbf-4e59-4a87-b657-1fe3566072e3-kube-api-access-9tnfk\") pod \"b5603bbf-4e59-4a87-b657-1fe3566072e3\" (UID: \"b5603bbf-4e59-4a87-b657-1fe3566072e3\") "
Nov 04 01:21:26.294031 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.294007    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5603bbf-4e59-4a87-b657-1fe3566072e3-openshift-service-ca" pod "b5603bbf-4e59-4a87-b657-1fe3566072e3" (UID: "b5603bbf-4e59-4a87-b657-1fe3566072e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:21:26.295882 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.295855    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5603bbf-4e59-4a87-b657-1fe3566072e3-kube-api-access-9tnfk" pod "b5603bbf-4e59-4a87-b657-1fe3566072e3" (UID: "b5603bbf-4e59-4a87-b657-1fe3566072e3"). InnerVolumeSpecName "kube-api-access-9tnfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:21:26.295955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.295908    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-metrics-certs" pod "b5603bbf-4e59-4a87-b657-1fe3566072e3" (UID: "b5603bbf-4e59-4a87-b657-1fe3566072e3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:21:26.295955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.295932    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-maas-api-tls" pod "b5603bbf-4e59-4a87-b657-1fe3566072e3" (UID: "b5603bbf-4e59-4a87-b657-1fe3566072e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:21:26.395201 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.395164    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-maas-api-tls\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:26.395201 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.395201    5572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5603bbf-4e59-4a87-b657-1fe3566072e3-metrics-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:26.395201 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.395219    5572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5603bbf-4e59-4a87-b657-1fe3566072e3-openshift-service-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:26.395499 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.395234    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tnfk\" (UniqueName: \"kubernetes.io/projected/b5603bbf-4e59-4a87-b657-1fe3566072e3-kube-api-access-9tnfk\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:21:26.638513 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.638431    5572 generic.go:356] "Generic (PLEG): container finished" podID="b5603bbf-4e59-4a87-b657-1fe3566072e3" containerID="cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf" exitCode=0
Nov 04 01:21:26.638513 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.638495    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"
Nov 04 01:21:26.638721 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.638513    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg" event={"ID":"b5603bbf-4e59-4a87-b657-1fe3566072e3","Type":"ContainerDied","Data":"cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf"}
Nov 04 01:21:26.638721 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.638621    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57889785b6-l9hqg" event={"ID":"b5603bbf-4e59-4a87-b657-1fe3566072e3","Type":"ContainerDied","Data":"2fccbcfb1136977cc23319a0b913e381d9cb1307fdf7894552a139245b417688"}
Nov 04 01:21:26.638721 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.638655    5572 scope.go:122] "RemoveContainer" containerID="cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf"
Nov 04 01:21:26.648252 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.648230    5572 scope.go:122] "RemoveContainer" containerID="cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf"
Nov 04 01:21:26.648582 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:21:26.648563    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf\": container with ID starting with cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf not found: ID does not exist" containerID="cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf"
Nov 04 01:21:26.648637 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.648592    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf"} err="failed to get container status \"cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf\": rpc error: code = NotFound desc = could not find container \"cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf\": container with ID starting with cadabeeb4d551a1956927487b7ef345c0670b8d02a6c064dee6de5d7c7c37abf not found: ID does not exist"
Nov 04 01:21:26.792107 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.792075    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"]
Nov 04 01:21:26.838260 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.838230    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-57889785b6-l9hqg"]
Nov 04 01:21:26.972126 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:26.972095    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b5603bbf-4e59-4a87-b657-1fe3566072e3" path="/var/lib/kubelet/pods/b5603bbf-4e59-4a87-b657-1fe3566072e3/volumes"
Nov 04 01:21:27.401847 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:27.401737    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:31.912095 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:31.912043    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:21:42.544231 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:42.544202    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:21:42.547909 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:21:42.547881    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-9vstw"
Nov 04 01:21:43.198337 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:21:43.198302    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:22:13.199395 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:22:13.199357    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:22:21.479457 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.479422    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"]
Nov 04 01:22:21.480015 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.479993    5572 cpu_manager.go:414] "containerMap: removing container" podUID="b5603bbf-4e59-4a87-b657-1fe3566072e3" containerName="maas-api"
Nov 04 01:22:21.480092 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.480016    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5603bbf-4e59-4a87-b657-1fe3566072e3" containerName="maas-api"
Nov 04 01:22:21.480092 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.480038    5572 cpu_manager.go:414] "containerMap: removing container" podUID="e5f33fbb-b2fc-4366-a050-ed5938674555" containerName="authorino"
Nov 04 01:22:21.480092 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.480046    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e5f33fbb-b2fc-4366-a050-ed5938674555" containerName="authorino"
Nov 04 01:22:21.480198 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.480137    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="e5f33fbb-b2fc-4366-a050-ed5938674555" containerName="authorino"
Nov 04 01:22:21.480198 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.480157    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5603bbf-4e59-4a87-b657-1fe3566072e3" containerName="maas-api"
Nov 04 01:22:21.482516 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.482495    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"
Nov 04 01:22:21.537831 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.537775    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"]
Nov 04 01:22:21.585066 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.585038    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba3793ec-759f-4c7b-8720-38062921a84c-cert\") pod \"llmisvc-controller-manager-6466c554d8-jhr6j\" (UID: \"ba3793ec-759f-4c7b-8720-38062921a84c\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"
Nov 04 01:22:21.585229 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.585091    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjzn2\" (UniqueName: \"kubernetes.io/projected/ba3793ec-759f-4c7b-8720-38062921a84c-kube-api-access-qjzn2\") pod \"llmisvc-controller-manager-6466c554d8-jhr6j\" (UID: \"ba3793ec-759f-4c7b-8720-38062921a84c\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"
Nov 04 01:22:21.685944 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.685911    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjzn2\" (UniqueName: \"kubernetes.io/projected/ba3793ec-759f-4c7b-8720-38062921a84c-kube-api-access-qjzn2\") pod \"llmisvc-controller-manager-6466c554d8-jhr6j\" (UID: \"ba3793ec-759f-4c7b-8720-38062921a84c\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"
Nov 04 01:22:21.686110 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.686002    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba3793ec-759f-4c7b-8720-38062921a84c-cert\") pod \"llmisvc-controller-manager-6466c554d8-jhr6j\" (UID: \"ba3793ec-759f-4c7b-8720-38062921a84c\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"
Nov 04 01:22:21.688295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.688267    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba3793ec-759f-4c7b-8720-38062921a84c-cert\") pod \"llmisvc-controller-manager-6466c554d8-jhr6j\" (UID: \"ba3793ec-759f-4c7b-8720-38062921a84c\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"
Nov 04 01:22:21.743866 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.743804    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjzn2\" (UniqueName: \"kubernetes.io/projected/ba3793ec-759f-4c7b-8720-38062921a84c-kube-api-access-qjzn2\") pod \"llmisvc-controller-manager-6466c554d8-jhr6j\" (UID: \"ba3793ec-759f-4c7b-8720-38062921a84c\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"
Nov 04 01:22:21.793777 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:21.793745    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"
Nov 04 01:22:22.160386 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:22.160313    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"]
Nov 04 01:22:22.163956 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:22:22.163913    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3793ec_759f_4c7b_8720_38062921a84c.slice/crio-4c98dd0298fd5ce21747ea837798766a24140f60a83dd994dc2a021f90db2c14 WatchSource:0}: Error finding container 4c98dd0298fd5ce21747ea837798766a24140f60a83dd994dc2a021f90db2c14: Status 404 returned error can't find the container with id 4c98dd0298fd5ce21747ea837798766a24140f60a83dd994dc2a021f90db2c14
Nov 04 01:22:22.917578 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:22.917544    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j" event={"ID":"ba3793ec-759f-4c7b-8720-38062921a84c","Type":"ContainerStarted","Data":"4c98dd0298fd5ce21747ea837798766a24140f60a83dd994dc2a021f90db2c14"}
Nov 04 01:22:23.924420 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:23.924381    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j" event={"ID":"ba3793ec-759f-4c7b-8720-38062921a84c","Type":"ContainerStarted","Data":"9f79ed6af72bc0c2ef5aa0f4886c8055fd513b54a2139a44faf58aa751beb4b8"}
Nov 04 01:22:23.924884 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:23.924452    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"
Nov 04 01:22:24.035134 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:24.035075    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j" podStartSLOduration=2.197674322 podStartE2EDuration="3.035062385s" totalImagesPullingTime="837.388063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:22:24.033473819 +0000 UTC m=+675.183681578" watchObservedRunningTime="2026-11-04 01:22:24.035062385 +0000 UTC m=+675.185270143"
Nov 04 01:22:32.293195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:32.293137    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:22:32.435767 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:32.435729    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:22:43.198526 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:22:43.198483    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:22:52.068367 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:52.068341    5572 generic.go:356] "Generic (PLEG): container finished" podID="b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d" containerID="051a096c9e9ea7c926c63da5295eac8d66585e663790716a8091f9af23127808" exitCode=1
Nov 04 01:22:52.068798 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:52.068412    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557bcb748c-j5ss5" event={"ID":"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d","Type":"ContainerDied","Data":"051a096c9e9ea7c926c63da5295eac8d66585e663790716a8091f9af23127808"}
Nov 04 01:22:52.068798 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:52.068764    5572 scope.go:122] "RemoveContainer" containerID="051a096c9e9ea7c926c63da5295eac8d66585e663790716a8091f9af23127808"
Nov 04 01:22:52.069122 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:52.069109    5572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 01:22:54.081847 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:54.081806    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-557bcb748c-j5ss5" event={"ID":"b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d","Type":"ContainerStarted","Data":"290f6e2dea7be6fa3fd37e674a57f0bf8444b22780ee4606b47c905c26dc5901"}
Nov 04 01:22:54.082285 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:54.082041    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:22:54.932063 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:54.932035    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-jhr6j"
Nov 04 01:22:55.088582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:55.088550    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"]
Nov 04 01:22:55.089028 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:55.088767    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8" podUID="ebf9be32-40a9-4994-8afd-66db448b787d" containerName="manager" containerID="cri-o://019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4" gracePeriod=30
Nov 04 01:22:55.333461 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:55.333436    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:22:55.385297 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:55.385264    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebf9be32-40a9-4994-8afd-66db448b787d-kube-api-access-85vqb\" (UniqueName: \"kubernetes.io/projected/ebf9be32-40a9-4994-8afd-66db448b787d-kube-api-access-85vqb\") pod \"ebf9be32-40a9-4994-8afd-66db448b787d\" (UID: \"ebf9be32-40a9-4994-8afd-66db448b787d\") "
Nov 04 01:22:55.385461 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:55.385382    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ebf9be32-40a9-4994-8afd-66db448b787d-cert\" (UniqueName: \"kubernetes.io/secret/ebf9be32-40a9-4994-8afd-66db448b787d-cert\") pod \"ebf9be32-40a9-4994-8afd-66db448b787d\" (UID: \"ebf9be32-40a9-4994-8afd-66db448b787d\") "
Nov 04 01:22:55.387264 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:55.387229    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebf9be32-40a9-4994-8afd-66db448b787d-kube-api-access-85vqb" pod "ebf9be32-40a9-4994-8afd-66db448b787d" (UID: "ebf9be32-40a9-4994-8afd-66db448b787d"). InnerVolumeSpecName "kube-api-access-85vqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:22:55.387370 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:55.387299    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebf9be32-40a9-4994-8afd-66db448b787d-cert" pod "ebf9be32-40a9-4994-8afd-66db448b787d" (UID: "ebf9be32-40a9-4994-8afd-66db448b787d"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:22:55.486089 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:55.486008    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85vqb\" (UniqueName: \"kubernetes.io/projected/ebf9be32-40a9-4994-8afd-66db448b787d-kube-api-access-85vqb\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:22:55.486089 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:55.486039    5572 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebf9be32-40a9-4994-8afd-66db448b787d-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:22:56.093641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:56.093608    5572 generic.go:356] "Generic (PLEG): container finished" podID="ebf9be32-40a9-4994-8afd-66db448b787d" containerID="019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4" exitCode=0
Nov 04 01:22:56.094069 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:56.093653    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"
Nov 04 01:22:56.094069 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:56.093698    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8" event={"ID":"ebf9be32-40a9-4994-8afd-66db448b787d","Type":"ContainerDied","Data":"019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4"}
Nov 04 01:22:56.094069 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:56.093749    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8" event={"ID":"ebf9be32-40a9-4994-8afd-66db448b787d","Type":"ContainerDied","Data":"375986cf673b5fafada4a57c928bd86d5f674db3ceccb4d0d5715ba2911ebb79"}
Nov 04 01:22:56.094069 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:56.093773    5572 scope.go:122] "RemoveContainer" containerID="019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4"
Nov 04 01:22:56.103333 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:56.103316    5572 scope.go:122] "RemoveContainer" containerID="019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4"
Nov 04 01:22:56.103612 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:22:56.103593    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4\": container with ID starting with 019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4 not found: ID does not exist" containerID="019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4"
Nov 04 01:22:56.103676 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:56.103622    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4"} err="failed to get container status \"019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4\": rpc error: code = NotFound desc = could not find container \"019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4\": container with ID starting with 019eadc67c6463b6e1e63bc77bccfbb824caa07824f1725105f903d2b3cfd8f4 not found: ID does not exist"
Nov 04 01:22:56.247718 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:56.247678    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"]
Nov 04 01:22:56.251551 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:56.251514    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-dv8d8"]
Nov 04 01:22:56.971456 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:22:56.971426    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ebf9be32-40a9-4994-8afd-66db448b787d" path="/var/lib/kubelet/pods/ebf9be32-40a9-4994-8afd-66db448b787d/volumes"
Nov 04 01:23:05.089909 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:05.089878    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-557bcb748c-j5ss5"
Nov 04 01:23:06.259411 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:06.259373    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:06.470257 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:06.470226    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:13.200268 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:23:13.200233    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:23:13.309680 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:13.309645    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:13.476367 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:13.476280    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:32.745690 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:32.745607    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:35.359233 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:35.359197    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:36.163036 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:36.163005    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:36.687786 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:36.687751    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:37.268632 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:37.268594    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:38.017296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:38.017265    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:38.162135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:38.162098    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:42.639815 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:42.639783    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:43.198182 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:23:43.198146    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:23:44.639469 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:44.639434    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:44.784470 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:44.784431    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:23:55.007907 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:23:55.007865    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:03.924304 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:24:03.924269    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:07.552720 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:24:07.552681    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:10.859199 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:24:10.859159    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:13.199083 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:24:13.199049    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:24:14.295487 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:24:14.295456    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:17.791379 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:24:17.791344    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:18.076647 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:24:18.076564    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:21.701791 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:24:21.701758    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:25.557458 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:24:25.557404    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:33.092401 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:24:33.092368    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:37.623403 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:24:37.623367    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:42.966943 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:24:42.966901    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:24:43.198867 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:24:43.198826    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:25:08.600984 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:08.600949    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:25:08.786882 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:08.786847    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:25:08.894216 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:08.894133    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"]
Nov 04 01:25:08.894572 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:08.894525    5572 cpu_manager.go:414] "containerMap: removing container" podUID="ebf9be32-40a9-4994-8afd-66db448b787d" containerName="manager"
Nov 04 01:25:08.894572 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:08.894554    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ebf9be32-40a9-4994-8afd-66db448b787d" containerName="manager"
Nov 04 01:25:08.894673 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:08.894637    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="ebf9be32-40a9-4994-8afd-66db448b787d" containerName="manager"
Nov 04 01:25:08.897755 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:08.897738    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.006503 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.006454    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"]
Nov 04 01:25:09.083185 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.083153    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/809c9398-9db6-4f27-831f-282e3e7d4616-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.083185 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.083190    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7nx5\" (UniqueName: \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-kube-api-access-l7nx5\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.083383 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.083303    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.083383 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.083334    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/809c9398-9db6-4f27-831f-282e3e7d4616-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.083450 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.083388    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.083450 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.083427    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.083450 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.083446    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.083608 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.083503    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.083608 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.083520    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.184177 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184101    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.184177 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184138    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.184177 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184161    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.184488 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184291    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.184488 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184335    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.184488 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184412    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/809c9398-9db6-4f27-831f-282e3e7d4616-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.184488 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184446    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7nx5\" (UniqueName: \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-kube-api-access-l7nx5\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.184784 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184564    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.184784 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184592    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.184784 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184600    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/809c9398-9db6-4f27-831f-282e3e7d4616-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.184784 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184639    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.185039 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.184969    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.185143 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.185113    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.185830 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.185799    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/809c9398-9db6-4f27-831f-282e3e7d4616-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.186971 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.186946    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.187107 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.187091    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/809c9398-9db6-4f27-831f-282e3e7d4616-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.243449 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.243415    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.243895 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.243869    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7nx5\" (UniqueName: \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-kube-api-access-l7nx5\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-m7jld\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.510554 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.510494    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:09.937462 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.937386    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"]
Nov 04 01:25:09.964048 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:25:09.964023    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809c9398_9db6_4f27_831f_282e3e7d4616.slice/crio-77e21c4df8834d06b811b8514aa6b492972b2f1b452a7792ba73231c31fea314 WatchSource:0}: Error finding container 77e21c4df8834d06b811b8514aa6b492972b2f1b452a7792ba73231c31fea314: Status 404 returned error can't find the container with id 77e21c4df8834d06b811b8514aa6b492972b2f1b452a7792ba73231c31fea314
Nov 04 01:25:09.966231 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.966195    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:25:09.966301 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.966266    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:25:09.966301 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:09.966295    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:25:10.284172 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:10.284124    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:25:10.469449 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:10.469399    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:25:10.772281 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:10.772237    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" event={"ID":"809c9398-9db6-4f27-831f-282e3e7d4616","Type":"ContainerStarted","Data":"7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa"}
Nov 04 01:25:10.772465 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:10.772303    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" event={"ID":"809c9398-9db6-4f27-831f-282e3e7d4616","Type":"ContainerStarted","Data":"77e21c4df8834d06b811b8514aa6b492972b2f1b452a7792ba73231c31fea314"}
Nov 04 01:25:10.937922 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:10.937875    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" podStartSLOduration=2.9378619969999997 podStartE2EDuration="2.937861997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:25:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:25:10.936883136 +0000 UTC m=+842.087090895" watchObservedRunningTime="2026-11-04 01:25:10.937861997 +0000 UTC m=+842.088069734"
Nov 04 01:25:11.510835 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:11.510800    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:11.512202 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:11.512180    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-m7jld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:25:11.512264 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:11.512227    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Nov 04 01:25:12.511850 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:12.511816    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-m7jld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:25:12.512248 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:12.511866    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Nov 04 01:25:13.199360 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:25:13.199316    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:25:13.511242 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:13.511159    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-m7jld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:25:13.511242 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:13.511218    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Nov 04 01:25:14.511631 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:14.511595    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-m7jld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:25:14.512139 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:14.511663    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Nov 04 01:25:15.511057 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:15.511024    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-m7jld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:25:15.511234 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:15.511088    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Nov 04 01:25:16.511719 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:16.511684    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-m7jld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:25:16.512112 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:16.511755    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Nov 04 01:25:17.511698 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:17.511653    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-m7jld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Nov 04 01:25:17.511887 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:17.511724    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Nov 04 01:25:18.515872 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:18.515844    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:18.516260 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:18.516089    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:18.516841 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:18.516825    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:25:27.195639 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:27.195609    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:25:28.415214 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:28.415153    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:25:30.153047 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:30.153012    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:25:33.439414 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:33.439378    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:25:37.960395 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:37.960354    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:25:40.874645 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:25:40.874602    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:25:43.199120 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:25:43.199074    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:26:09.413340 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:09.413297    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:09.601093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:09.601062    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:09.759110 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:09.759075    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:10.313327 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:10.313289    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:10.467624 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:10.467590    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:10.627647 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:10.627571    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:10.795999 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:10.795965    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:10.945433 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:10.945391    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:13.198583 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:26:13.198527    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:26:14.634333 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:14.634299    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:14.811575 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:14.811516    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:14.966502 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:14.966467    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:16.220908 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:16.220870    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:16.368507 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:16.368475    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:16.708644 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:16.708614    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:17.430047 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:17.430004    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:17.756406 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:17.756373    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:17.932653 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:17.932615    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:18.105849 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.105758    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:18.501972 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.501935    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"]
Nov 04 01:26:18.505767 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.505742    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:26:18.508401 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.508372    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2htgn\" (UniqueName: \"kubernetes.io/projected/82b10dc5-1cdd-4442-9b25-f379e6a16b07-kube-api-access-2htgn\") pod \"payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v\" (UID: \"82b10dc5-1cdd-4442-9b25-f379e6a16b07\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:26:18.508566 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.508481    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82b10dc5-1cdd-4442-9b25-f379e6a16b07-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v\" (UID: \"82b10dc5-1cdd-4442-9b25-f379e6a16b07\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:26:18.559980 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.559943    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"]
Nov 04 01:26:18.600546 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.600505    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-9f7183\""
Nov 04 01:26:18.609104 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.609077    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2htgn\" (UniqueName: \"kubernetes.io/projected/82b10dc5-1cdd-4442-9b25-f379e6a16b07-kube-api-access-2htgn\") pod \"payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v\" (UID: \"82b10dc5-1cdd-4442-9b25-f379e6a16b07\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:26:18.609236 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.609190    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82b10dc5-1cdd-4442-9b25-f379e6a16b07-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v\" (UID: \"82b10dc5-1cdd-4442-9b25-f379e6a16b07\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:26:18.609901 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.609879    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82b10dc5-1cdd-4442-9b25-f379e6a16b07-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v\" (UID: \"82b10dc5-1cdd-4442-9b25-f379e6a16b07\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:26:18.646711 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.646679    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-9f7183-dockercfg-9gdcm\""
Nov 04 01:26:18.666131 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.666103    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2htgn\" (UniqueName: \"kubernetes.io/projected/82b10dc5-1cdd-4442-9b25-f379e6a16b07-kube-api-access-2htgn\") pod \"payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v\" (UID: \"82b10dc5-1cdd-4442-9b25-f379e6a16b07\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:26:18.820720 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:18.820643    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:26:19.185055 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:19.185005    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"]
Nov 04 01:26:19.187419 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:26:19.187387    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b10dc5_1cdd_4442_9b25_f379e6a16b07.slice/crio-4ccf4c7d458cc166e22f686bf677a92fe1b7af41ad1452cba1ce4cad3fb72c27 WatchSource:0}: Error finding container 4ccf4c7d458cc166e22f686bf677a92fe1b7af41ad1452cba1ce4cad3fb72c27: Status 404 returned error can't find the container with id 4ccf4c7d458cc166e22f686bf677a92fe1b7af41ad1452cba1ce4cad3fb72c27
Nov 04 01:26:20.047733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:20.047695    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:20.121585 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:20.121552    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v" event={"ID":"82b10dc5-1cdd-4442-9b25-f379e6a16b07","Type":"ContainerStarted","Data":"4ccf4c7d458cc166e22f686bf677a92fe1b7af41ad1452cba1ce4cad3fb72c27"}
Nov 04 01:26:20.245082 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:20.245048    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:21.123765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:21.123731    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:21.291832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:21.291795    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:21.441908 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:21.441874    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:21.682986 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:21.682955    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:22.358677 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:22.358578    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:22.503644 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:22.503616    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:23.146189 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:23.146143    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v" event={"ID":"82b10dc5-1cdd-4442-9b25-f379e6a16b07","Type":"ContainerStarted","Data":"7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220"}
Nov 04 01:26:23.146399 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:23.146245    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:26:23.254903 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:23.254849    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v" podStartSLOduration=2.357066579 podStartE2EDuration="5.254834821s" totalImagesPullingTime="2.897768242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:23.253971793 +0000 UTC m=+914.404179553" watchObservedRunningTime="2026-11-04 01:26:23.254834821 +0000 UTC m=+914.405042579"
Nov 04 01:26:24.159807 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:24.159746    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:24.340348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:24.340317    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:24.492062 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:24.492024    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:26.820257 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:26.820229    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:28.482719 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:28.482684    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:28.662727 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:28.662697    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:28.806930 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:28.806842    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:29.702323 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:29.702290    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:29.880842 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:29.880812    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:30.114808 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.114734    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"]
Nov 04 01:26:30.118276 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.118252    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:26:30.171753 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.171721    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"]
Nov 04 01:26:30.214910 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.214861    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg\" (UID: \"62ae3dce-4771-4dc6-8db5-9c4266e8b49b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:26:30.215120 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.214988    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpcvr\" (UniqueName: \"kubernetes.io/projected/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-kube-api-access-jpcvr\") pod \"payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg\" (UID: \"62ae3dce-4771-4dc6-8db5-9c4266e8b49b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:26:30.215756 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.215738    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-00cfe6-dockercfg-rjtmq\""
Nov 04 01:26:30.215909 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.215870    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-00cfe6\""
Nov 04 01:26:30.315805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.315767    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg\" (UID: \"62ae3dce-4771-4dc6-8db5-9c4266e8b49b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:26:30.315805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.315818    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpcvr\" (UniqueName: \"kubernetes.io/projected/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-kube-api-access-jpcvr\") pod \"payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg\" (UID: \"62ae3dce-4771-4dc6-8db5-9c4266e8b49b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:26:30.316517 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.316492    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg\" (UID: \"62ae3dce-4771-4dc6-8db5-9c4266e8b49b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:26:30.373479 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.373397    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpcvr\" (UniqueName: \"kubernetes.io/projected/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-kube-api-access-jpcvr\") pod \"payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg\" (UID: \"62ae3dce-4771-4dc6-8db5-9c4266e8b49b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:26:30.431698 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.431652    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:26:30.798463 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:30.798430    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"]
Nov 04 01:26:30.801849 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:26:30.801815    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ae3dce_4771_4dc6_8db5_9c4266e8b49b.slice/crio-e99702dd7c81791b1e1e99f911b1c90a853c780ef96f160449b6066f4bb9ee8c WatchSource:0}: Error finding container e99702dd7c81791b1e1e99f911b1c90a853c780ef96f160449b6066f4bb9ee8c: Status 404 returned error can't find the container with id e99702dd7c81791b1e1e99f911b1c90a853c780ef96f160449b6066f4bb9ee8c
Nov 04 01:26:31.192102 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:31.192070    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg" event={"ID":"62ae3dce-4771-4dc6-8db5-9c4266e8b49b","Type":"ContainerStarted","Data":"bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73"}
Nov 04 01:26:31.192280 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:31.192121    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg" event={"ID":"62ae3dce-4771-4dc6-8db5-9c4266e8b49b","Type":"ContainerStarted","Data":"e99702dd7c81791b1e1e99f911b1c90a853c780ef96f160449b6066f4bb9ee8c"}
Nov 04 01:26:31.192280 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:31.192143    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:26:31.300872 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:31.300806    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg" podStartSLOduration=1.300787541 podStartE2EDuration="1.300787541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:31.299522116 +0000 UTC m=+922.449729874" watchObservedRunningTime="2026-11-04 01:26:31.300787541 +0000 UTC m=+922.450995301"
Nov 04 01:26:32.271211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.271171    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:32.423510 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.423478    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:32.774906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.774870    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"]
Nov 04 01:26:32.778355 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.778334    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:26:32.826895 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.826859    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-a96a99\""
Nov 04 01:26:32.839416 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.839383    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d26x4\" (UniqueName: \"kubernetes.io/projected/903a47a6-57b7-43f4-b347-a13ec55e8ba1-kube-api-access-d26x4\") pod \"payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94\" (UID: \"903a47a6-57b7-43f4-b347-a13ec55e8ba1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:26:32.839571 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.839497    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/903a47a6-57b7-43f4-b347-a13ec55e8ba1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94\" (UID: \"903a47a6-57b7-43f4-b347-a13ec55e8ba1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:26:32.873145 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.873116    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-a96a99-dockercfg-76xbk\""
Nov 04 01:26:32.874905 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.874882    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"]
Nov 04 01:26:32.939994 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.939957    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d26x4\" (UniqueName: \"kubernetes.io/projected/903a47a6-57b7-43f4-b347-a13ec55e8ba1-kube-api-access-d26x4\") pod \"payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94\" (UID: \"903a47a6-57b7-43f4-b347-a13ec55e8ba1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:26:32.940142 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.940039    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/903a47a6-57b7-43f4-b347-a13ec55e8ba1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94\" (UID: \"903a47a6-57b7-43f4-b347-a13ec55e8ba1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:26:32.940769 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.940751    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/903a47a6-57b7-43f4-b347-a13ec55e8ba1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94\" (UID: \"903a47a6-57b7-43f4-b347-a13ec55e8ba1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:26:32.997859 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:32.997821    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d26x4\" (UniqueName: \"kubernetes.io/projected/903a47a6-57b7-43f4-b347-a13ec55e8ba1-kube-api-access-d26x4\") pod \"payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94\" (UID: \"903a47a6-57b7-43f4-b347-a13ec55e8ba1\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:26:33.091217 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:33.091139    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:26:33.455512 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:33.455487    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"]
Nov 04 01:26:33.458138 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:26:33.458103    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903a47a6_57b7_43f4_b347_a13ec55e8ba1.slice/crio-ef1a545ec2e001b599b86daa92724be7809247d42f020419281fb05fc77d1454 WatchSource:0}: Error finding container ef1a545ec2e001b599b86daa92724be7809247d42f020419281fb05fc77d1454: Status 404 returned error can't find the container with id ef1a545ec2e001b599b86daa92724be7809247d42f020419281fb05fc77d1454
Nov 04 01:26:33.823805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:33.823721    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:34.154015 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:34.153944    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:26:34.208844 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:34.208814    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94" event={"ID":"903a47a6-57b7-43f4-b347-a13ec55e8ba1","Type":"ContainerStarted","Data":"e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f"}
Nov 04 01:26:34.209011 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:34.208862    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94" event={"ID":"903a47a6-57b7-43f4-b347-a13ec55e8ba1","Type":"ContainerStarted","Data":"ef1a545ec2e001b599b86daa92724be7809247d42f020419281fb05fc77d1454"}
Nov 04 01:26:34.209011 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:34.208908    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:26:34.370444 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:34.370390    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94" podStartSLOduration=2.370375996 podStartE2EDuration="2.370375996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:34.369774807 +0000 UTC m=+925.519982567" watchObservedRunningTime="2026-11-04 01:26:34.370375996 +0000 UTC m=+925.520583754"
Nov 04 01:26:37.032832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.032799    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"]
Nov 04 01:26:37.036389 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.036373    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.078694 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.078656    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-metrics-certs\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.078863 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.078706    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szt8m\" (UniqueName: \"kubernetes.io/projected/d15eec1d-2ec7-474d-a077-71869a0ea48d-kube-api-access-szt8m\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.078863 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.078753    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.078863 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.078825    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d15eec1d-2ec7-474d-a077-71869a0ea48d-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.084831 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.084802    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-00cfe6-serving-cert\""
Nov 04 01:26:37.131185 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.131159    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 04 01:26:37.131338 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.131262    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jfk6s\""
Nov 04 01:26:37.133812 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.133787    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"]
Nov 04 01:26:37.179546 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.179510    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-metrics-certs\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.179751 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.179566    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szt8m\" (UniqueName: \"kubernetes.io/projected/d15eec1d-2ec7-474d-a077-71869a0ea48d-kube-api-access-szt8m\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.179751 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.179593    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.179751 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.179636    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d15eec1d-2ec7-474d-a077-71869a0ea48d-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.179979 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:26:37.179952    5572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-serving-cert: secret "maas-api-e2e-worker-w2-00cfe6-serving-cert" not found
Nov 04 01:26:37.180120 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:26:37.180022    5572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-maas-api-tls podName:d15eec1d-2ec7-474d-a077-71869a0ea48d nodeName:}" failed. No retries permitted until 2026-11-04 01:26:37.680004635 +0000 UTC m=+928.830212390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-maas-api-tls") pod "maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g" (UID: "d15eec1d-2ec7-474d-a077-71869a0ea48d") : secret "maas-api-e2e-worker-w2-00cfe6-serving-cert" not found
Nov 04 01:26:37.180416 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.180392    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d15eec1d-2ec7-474d-a077-71869a0ea48d-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.182819 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.182796    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-metrics-certs\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.237579 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.237526    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szt8m\" (UniqueName: \"kubernetes.io/projected/d15eec1d-2ec7-474d-a077-71869a0ea48d-kube-api-access-szt8m\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.249349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.249317    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:37.426510 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.426421    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:37.634278 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.634238    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:37.685451 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.685371    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.687761 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.687744    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-maas-api-tls\") pod \"maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:37.948692 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:37.948657    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:38.317326 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:38.317229    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"]
Nov 04 01:26:38.320580 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:26:38.320552    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15eec1d_2ec7_474d_a077_71869a0ea48d.slice/crio-e4613a83a604a18cc582c781c2196eb9b1c2fa2e94527efd4b0ab0acd0dea2d2 WatchSource:0}: Error finding container e4613a83a604a18cc582c781c2196eb9b1c2fa2e94527efd4b0ab0acd0dea2d2: Status 404 returned error can't find the container with id e4613a83a604a18cc582c781c2196eb9b1c2fa2e94527efd4b0ab0acd0dea2d2
Nov 04 01:26:38.321357 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:38.321331    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:39.234188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:39.234159    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g" event={"ID":"d15eec1d-2ec7-474d-a077-71869a0ea48d","Type":"ContainerStarted","Data":"e4613a83a604a18cc582c781c2196eb9b1c2fa2e94527efd4b0ab0acd0dea2d2"}
Nov 04 01:26:39.455935 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:39.455900    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:40.081830 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:40.081794    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:40.229375 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:40.229345    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:40.239965 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:40.239936    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g" event={"ID":"d15eec1d-2ec7-474d-a077-71869a0ea48d","Type":"ContainerStarted","Data":"f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa"}
Nov 04 01:26:40.240114 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:40.240027    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:40.352614 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:40.352502    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g" podStartSLOduration=3.462572759 podStartE2EDuration="4.352486904s" totalImagesPullingTime="889.914145ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:40.351804171 +0000 UTC m=+931.502011931" watchObservedRunningTime="2026-11-04 01:26:40.352486904 +0000 UTC m=+931.502694662"
Nov 04 01:26:40.377577 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:40.377523    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:42.130764 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:42.130726    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:42.201573 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:42.201489    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:26:42.308198 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:42.308162    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:42.507731 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:42.507698    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:42.866174 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:42.866084    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:42.954838 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:42.954805    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"]
Nov 04 01:26:42.958772 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:42.958725    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.024670 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.024634    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-9f7183\"/\"default-dockercfg-5lbgl\""
Nov 04 01:26:43.040159 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.040119    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tls-certs\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.040337 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.040178    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-home\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.040337 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.040243    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tmp-dir\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.040337 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.040303    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-model-cache\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.040517 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.040442    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsv86\" (UniqueName: \"kubernetes.io/projected/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-kube-api-access-qsv86\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.040517 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.040484    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-dshm\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.047984 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.047956    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:43.053460 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.053441    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-9f7183\"/\"kube-root-ca.crt\""
Nov 04 01:26:43.053633 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.053444    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-9f7183\"/\"simulator-w3-9f7183-kserve-self-signed-certs\""
Nov 04 01:26:43.053633 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.053528    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-9f7183\"/\"openshift-service-ca.crt\""
Nov 04 01:26:43.055428 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.055405    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"]
Nov 04 01:26:43.142011 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.141922    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-model-cache\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.142011 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.141960    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsv86\" (UniqueName: \"kubernetes.io/projected/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-kube-api-access-qsv86\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.142011 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.141989    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-dshm\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.142620 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.142087    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tls-certs\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.142620 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.142114    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-home\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.142620 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.142141    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tmp-dir\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.142620 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.142412    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-model-cache\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.142620 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.142498    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tmp-dir\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.142620 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.142563    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-home\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.144657 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.144635    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-dshm\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.144769 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.144718    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tls-certs\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.200209 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.200181    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsv86\" (UniqueName: \"kubernetes.io/projected/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-kube-api-access-qsv86\") pod \"simulator-w3-9f7183-kserve-dfdf75856-5v8hj\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") " pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.202624 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:26:43.202587    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:26:43.231943 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.231913    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:43.272611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.272581    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:43.645719 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:43.645683    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"]
Nov 04 01:26:43.648257 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:26:43.648228    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e6d5295_bee1_4c67_8e1b_2ae1b8c90e32.slice/crio-be94333df13c78674e54fd8e82793a994606ed8ae243c91e087b92f6bfa79c9f WatchSource:0}: Error finding container be94333df13c78674e54fd8e82793a994606ed8ae243c91e087b92f6bfa79c9f: Status 404 returned error can't find the container with id be94333df13c78674e54fd8e82793a994606ed8ae243c91e087b92f6bfa79c9f
Nov 04 01:26:44.263472 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:44.263438    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj" event={"ID":"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32","Type":"ContainerStarted","Data":"be94333df13c78674e54fd8e82793a994606ed8ae243c91e087b92f6bfa79c9f"}
Nov 04 01:26:45.217472 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:45.217443    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:26:46.252194 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:46.252168    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:26:46.478022 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:46.477975    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:46.630277 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:46.630247    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:46.796847 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:46.796770    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:47.283201 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:47.283165    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj" event={"ID":"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32","Type":"ContainerStarted","Data":"a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e"}
Nov 04 01:26:47.393094 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:47.393040    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj" podStartSLOduration=2.535599891 podStartE2EDuration="5.393026679s" totalImagesPullingTime="2.857426788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:26:47.391667843 +0000 UTC m=+938.541875601" watchObservedRunningTime="2026-11-04 01:26:47.393026679 +0000 UTC m=+938.543234438"
Nov 04 01:26:48.272951 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:48.272912    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:48.743181 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:48.743145    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:53.273239 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:53.273201    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:53.286084 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:53.286057    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:53.326520 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:53.326485    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:26:54.039078 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:54.039047    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:56.147974 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:56.147944    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:56.324414 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:56.324380    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:58.324696 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:58.324661    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:26:59.298976 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:26:59.298940    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:04.328688 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:04.328654    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:04.499102 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:04.499055    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:04.641042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:04.640961    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:08.855545 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:08.855496    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:09.510232 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.510201    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"]
Nov 04 01:27:09.517668 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.517647    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.564889 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.564860    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:09.566474 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.566449    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-b2eadb-serving-cert\""
Nov 04 01:27:09.573954 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.573929    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqml9\" (UniqueName: \"kubernetes.io/projected/edd40302-6462-4d1c-b949-addf9cb235d6-kube-api-access-lqml9\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.574053 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.573992    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.574116 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.574099    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd40302-6462-4d1c-b949-addf9cb235d6-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.574162 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.574145    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-metrics-certs\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.614549 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.614499    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"]
Nov 04 01:27:09.674633 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.674602    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.674824 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.674664    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd40302-6462-4d1c-b949-addf9cb235d6-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.674824 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.674718    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-metrics-certs\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.674824 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.674763    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqml9\" (UniqueName: \"kubernetes.io/projected/edd40302-6462-4d1c-b949-addf9cb235d6-kube-api-access-lqml9\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.674824 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:27:09.674776    5572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-serving-cert: secret "maas-api-e2e-worker-w4-b2eadb-serving-cert" not found
Nov 04 01:27:09.675036 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:27:09.674844    5572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-maas-api-tls podName:edd40302-6462-4d1c-b949-addf9cb235d6 nodeName:}" failed. No retries permitted until 2026-11-04 01:27:10.174823792 +0000 UTC m=+961.325031542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-maas-api-tls") pod "maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9" (UID: "edd40302-6462-4d1c-b949-addf9cb235d6") : secret "maas-api-e2e-worker-w4-b2eadb-serving-cert" not found
Nov 04 01:27:09.675446 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.675419    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd40302-6462-4d1c-b949-addf9cb235d6-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.677205 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.677182    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-metrics-certs\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.716332 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.716301    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:09.732679 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.732652    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqml9\" (UniqueName: \"kubernetes.io/projected/edd40302-6462-4d1c-b949-addf9cb235d6-kube-api-access-lqml9\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:09.884448 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:09.884369    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:10.028836 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:10.028795    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:10.178986 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:10.178895    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:10.181227 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:10.181200    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:10.181356 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:10.181312    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:10.332562 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:10.332508    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:10.431445 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:10.431364    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:10.796434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:10.796365    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"]
Nov 04 01:27:10.798677 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:27:10.798652    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd40302_6462_4d1c_b949_addf9cb235d6.slice/crio-7315c115a24fb49006023cdeedcbdd0db78b771bb28f02b0ab8198c9cc4f9d33 WatchSource:0}: Error finding container 7315c115a24fb49006023cdeedcbdd0db78b771bb28f02b0ab8198c9cc4f9d33: Status 404 returned error can't find the container with id 7315c115a24fb49006023cdeedcbdd0db78b771bb28f02b0ab8198c9cc4f9d33
Nov 04 01:27:11.410444 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:11.410409    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9" event={"ID":"edd40302-6462-4d1c-b949-addf9cb235d6","Type":"ContainerStarted","Data":"7315c115a24fb49006023cdeedcbdd0db78b771bb28f02b0ab8198c9cc4f9d33"}
Nov 04 01:27:12.417278 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.417240    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9" event={"ID":"edd40302-6462-4d1c-b949-addf9cb235d6","Type":"ContainerStarted","Data":"44af674a1e75473c0c40da81a90661b47edd4694c5e1001b21bf81d18c143159"}
Nov 04 01:27:12.417707 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.417385    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:12.531651 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.531596    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9" podStartSLOduration=2.641865493 podStartE2EDuration="3.531582845s" totalImagesPullingTime="889.717352ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:27:12.529460222 +0000 UTC m=+963.679667980" watchObservedRunningTime="2026-11-04 01:27:12.531582845 +0000 UTC m=+963.681790604"
Nov 04 01:27:12.695391 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.695357    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"]
Nov 04 01:27:12.699878 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.699846    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.752381 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.752326    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-00cfe6\"/\"kube-root-ca.crt\""
Nov 04 01:27:12.752964 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.752925    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-00cfe6\"/\"openshift-service-ca.crt\""
Nov 04 01:27:12.753092 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.753032    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-00cfe6\"/\"simulator-w2-00cfe6-kserve-self-signed-certs\""
Nov 04 01:27:12.753092 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.753083    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-00cfe6\"/\"default-dockercfg-x7gmb\""
Nov 04 01:27:12.755044 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.755021    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"]
Nov 04 01:27:12.788628 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.788596    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:12.804893 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.804870    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tmp-dir\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.804996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.804925    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-model-cache\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.804996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.804985    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-home\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.805074 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.805008    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tls-certs\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.805074 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.805037    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-dshm\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.805176 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.805155    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr7wb\" (UniqueName: \"kubernetes.io/projected/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-kube-api-access-wr7wb\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.906745 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.906644    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-model-cache\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.906885 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.906790    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-home\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.906885 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.906825    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tls-certs\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.906885 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.906874    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-dshm\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.907013 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.906983    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-model-cache\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.907068 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.907038    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr7wb\" (UniqueName: \"kubernetes.io/projected/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-kube-api-access-wr7wb\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.907121 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.907097    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tmp-dir\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.907206 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.907179    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-home\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.907452 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.907430    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tmp-dir\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.909152 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.909130    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-dshm\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.909408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.909387    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tls-certs\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:12.964876 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:12.964810    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr7wb\" (UniqueName: \"kubernetes.io/projected/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-kube-api-access-wr7wb\") pod \"simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") " pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:13.014852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:13.014822    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:13.200512 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:27:13.200472    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:27:13.388395 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:13.388370    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"]
Nov 04 01:27:13.391083 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:27:13.391048    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d3eb4a9_fa39_40f5_b7a6_769a6b7eb75f.slice/crio-7d261f1f89f78818f6dc722c8ffa97e07aafe271755bcc3cf5aa38901561fae2 WatchSource:0}: Error finding container 7d261f1f89f78818f6dc722c8ffa97e07aafe271755bcc3cf5aa38901561fae2: Status 404 returned error can't find the container with id 7d261f1f89f78818f6dc722c8ffa97e07aafe271755bcc3cf5aa38901561fae2
Nov 04 01:27:13.424321 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:13.424292    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz" event={"ID":"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f","Type":"ContainerStarted","Data":"7d261f1f89f78818f6dc722c8ffa97e07aafe271755bcc3cf5aa38901561fae2"}
Nov 04 01:27:14.432584 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:14.432548    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz" event={"ID":"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f","Type":"ContainerStarted","Data":"66ddb4bd9328f72719bc1934fac6a8e51fc1e2699fb10bbd1aed1992228e9114"}
Nov 04 01:27:14.542407 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:14.542357    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz" podStartSLOduration=2.542342521 podStartE2EDuration="2.542342521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:27:14.540957865 +0000 UTC m=+965.691165624" watchObservedRunningTime="2026-11-04 01:27:14.542342521 +0000 UTC m=+965.692550280"
Nov 04 01:27:14.991376 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:14.991339    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:15.015584 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:15.015555    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:18.430033 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:18.430002    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:27:20.007723 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:20.007690    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:23.015200 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:23.015164    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:23.028055 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:23.028030    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:23.490362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:23.490329    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:27:25.397821 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:25.397790    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:30.488327 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:30.488295    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:32.363116 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:32.363081    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:35.497088 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:35.497058    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:37.348684 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:37.348647    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:38.680829 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:38.680776    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:40.578165 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:40.578128    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:43.058161 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:43.058110    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:43.199803 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:27:43.199764    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:27:43.211966 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:43.211942    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:43.676267 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:43.676207    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:43.822611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:43.822583    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:43.966038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:43.966000    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:45.914140 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:45.914102    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:50.335064 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:50.334992    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:50.924916 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:50.924882    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:51.080141 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:51.080108    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:51.224376 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:51.224347    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:51.404296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:51.404267    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:52.829983 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:52.829870    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:56.514671 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:56.514635    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:57.024926 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:57.024890    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:27:58.687850 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:27:58.687819    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:01.601797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:01.601760    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:06.692956 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:06.692917    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:11.622586 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.622524    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"]
Nov 04 01:28:11.625936 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.625920    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.682696 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.682663    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-envoy\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.682878 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.682714    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c296b226-17b6-47a1-82cc-03dacd75da0d-istiod-ca-cert\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.682878 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.682826    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-socket\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.682961 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.682899    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-podinfo\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.682961 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.682944    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7xsp\" (UniqueName: \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-kube-api-access-m7xsp\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.683031 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.682985    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-data\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.683071 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.683038    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-credential-socket\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.683107 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.683069    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-token\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.683107 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.683092    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-certs\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.687449 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.687400    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-9f7183-openshift-default-dockercfg-4jw5f\""
Nov 04 01:28:11.724713 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.724680    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"]
Nov 04 01:28:11.784308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784277    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-data\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.784495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784314    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-credential-socket\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.784495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784334    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-token\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.784495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784362    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-certs\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.784495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784427    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-envoy\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.784495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784464    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c296b226-17b6-47a1-82cc-03dacd75da0d-istiod-ca-cert\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.784495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784493    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-socket\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.784844 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784566    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-podinfo\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.784844 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784613    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7xsp\" (UniqueName: \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-kube-api-access-m7xsp\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.784844 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784742    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-data\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.784844 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784793    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-credential-socket\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.785065 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.784863    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-socket\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.785147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.785125    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-certs\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.785233 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.785215    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c296b226-17b6-47a1-82cc-03dacd75da0d-istiod-ca-cert\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.786686 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.786663    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-envoy\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.787088 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.787067    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-podinfo\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.842631 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.842594    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-token\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.842765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.842717    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7xsp\" (UniqueName: \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-kube-api-access-m7xsp\") pod \"e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") " pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:11.889990 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.889907    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:11.939780 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:11.939729    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:12.361890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:12.361827    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"]
Nov 04 01:28:12.364196 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:28:12.364162    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc296b226_17b6_47a1_82cc_03dacd75da0d.slice/crio-00db7ca219cff458538264241a9a8b2f4590d6d2178f745ff318e2ea6d9aa36e WatchSource:0}: Error finding container 00db7ca219cff458538264241a9a8b2f4590d6d2178f745ff318e2ea6d9aa36e: Status 404 returned error can't find the container with id 00db7ca219cff458538264241a9a8b2f4590d6d2178f745ff318e2ea6d9aa36e
Nov 04 01:28:12.367051 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:12.367024    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:28:12.367126 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:12.367090    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:28:12.367171 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:12.367136    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:28:12.748096 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:12.748060    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f" event={"ID":"c296b226-17b6-47a1-82cc-03dacd75da0d","Type":"ContainerStarted","Data":"93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422"}
Nov 04 01:28:12.748496 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:12.748123    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f" event={"ID":"c296b226-17b6-47a1-82cc-03dacd75da0d","Type":"ContainerStarted","Data":"00db7ca219cff458538264241a9a8b2f4590d6d2178f745ff318e2ea6d9aa36e"}
Nov 04 01:28:12.940427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:12.940396    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:12.966556 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:12.965813    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f" podStartSLOduration=1.965794484 podStartE2EDuration="1.965794484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:28:12.913949436 +0000 UTC m=+1024.064157205" watchObservedRunningTime="2026-11-04 01:28:12.965794484 +0000 UTC m=+1024.116002244"
Nov 04 01:28:13.200054 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:28:13.200020    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:28:13.941922 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:13.941883    5572 patch_prober.go:29] interesting pod/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Nov 04 01:28:13.942337 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:13.941938    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f" podUID="c296b226-17b6-47a1-82cc-03dacd75da0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Nov 04 01:28:14.940709 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:14.940677    5572 patch_prober.go:29] interesting pod/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Nov 04 01:28:14.940883 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:14.940725    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f" podUID="c296b226-17b6-47a1-82cc-03dacd75da0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Nov 04 01:28:15.940483 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:15.940445    5572 patch_prober.go:29] interesting pod/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Nov 04 01:28:15.940920 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:15.940499    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f" podUID="c296b226-17b6-47a1-82cc-03dacd75da0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Nov 04 01:28:16.940854 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:16.940815    5572 patch_prober.go:29] interesting pod/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Nov 04 01:28:16.941335 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:16.940890    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f" podUID="c296b226-17b6-47a1-82cc-03dacd75da0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Nov 04 01:28:17.026123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:17.026088    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:17.182356 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:17.182268    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:17.940175 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:17.940145    5572 patch_prober.go:29] interesting pod/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Nov 04 01:28:17.940354 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:17.940191    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f" podUID="c296b226-17b6-47a1-82cc-03dacd75da0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Nov 04 01:28:19.044427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:19.044393    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:19.044941 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:19.044867    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:19.046169 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:19.046139    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:28:22.051869 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:22.051818    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:24.897597 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:24.897559    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"]
Nov 04 01:28:24.901457 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:24.901431    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:24.990805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:24.990776    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:24.996639 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:24.996610    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-b2eadb\"/\"kube-root-ca.crt\""
Nov 04 01:28:24.996639 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:24.996627    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b2eadb\"/\"simulator-w4-b2eadb-kserve-self-signed-certs\""
Nov 04 01:28:24.996639 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:24.996629    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-b2eadb\"/\"default-dockercfg-hzvpz\""
Nov 04 01:28:24.996907 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:24.996661    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-b2eadb\"/\"openshift-service-ca.crt\""
Nov 04 01:28:24.998688 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:24.998665    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"]
Nov 04 01:28:25.006827 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.006801    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-model-cache\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.006944 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.006853    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-675tr\" (UniqueName: \"kubernetes.io/projected/995275c6-2b01-461d-8828-520738a32839-kube-api-access-675tr\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.006944 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.006878    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995275c6-2b01-461d-8828-520738a32839-tls-certs\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.007069 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.006994    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-tmp-dir\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.007069 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.007045    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-dshm\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.007157 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.007142    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-home\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.108042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.108002    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-model-cache\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.108238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.108084    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-675tr\" (UniqueName: \"kubernetes.io/projected/995275c6-2b01-461d-8828-520738a32839-kube-api-access-675tr\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.108238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.108113    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995275c6-2b01-461d-8828-520738a32839-tls-certs\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.108238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.108141    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-tmp-dir\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.108238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.108191    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-dshm\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.108456 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.108283    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-home\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.109061 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.109026    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-model-cache\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.109225 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.109112    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-home\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.109307 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.109296    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-tmp-dir\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.119511 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.119473    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-dshm\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.122198 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.122165    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995275c6-2b01-461d-8828-520738a32839-tls-certs\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.171689 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.171610    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-675tr\" (UniqueName: \"kubernetes.io/projected/995275c6-2b01-461d-8828-520738a32839-kube-api-access-675tr\") pod \"simulator-w4-b2eadb-kserve-865bcd8687-9pdfr\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") " pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.214641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.214600    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:25.585418 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.585392    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"]
Nov 04 01:28:25.587383 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:28:25.587358    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod995275c6_2b01_461d_8828_520738a32839.slice/crio-095d010e765290b0bdb8cfee57323d08b3c8e8e92a2f744f207025443072cbdd WatchSource:0}: Error finding container 095d010e765290b0bdb8cfee57323d08b3c8e8e92a2f744f207025443072cbdd: Status 404 returned error can't find the container with id 095d010e765290b0bdb8cfee57323d08b3c8e8e92a2f744f207025443072cbdd
Nov 04 01:28:25.846805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.846721    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr" event={"ID":"995275c6-2b01-461d-8828-520738a32839","Type":"ContainerStarted","Data":"9511af3ac1dbefa8ede83c036c51b2309424238d2692c4087bc01a7fb8110ca6"}
Nov 04 01:28:25.846805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.846767    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr" event={"ID":"995275c6-2b01-461d-8828-520738a32839","Type":"ContainerStarted","Data":"095d010e765290b0bdb8cfee57323d08b3c8e8e92a2f744f207025443072cbdd"}
Nov 04 01:28:25.957183 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:25.957126    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr" podStartSLOduration=1.957112065 podStartE2EDuration="1.957112065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:28:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:28:25.955468868 +0000 UTC m=+1037.105676629" watchObservedRunningTime="2026-11-04 01:28:25.957112065 +0000 UTC m=+1037.107319825"
Nov 04 01:28:26.215550 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:26.215500    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:27.198544 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:27.198502    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:32.281059 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:32.281024    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:35.214971 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:35.214931    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:35.227958 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:35.227929    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:35.912777 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:35.912749    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:28:37.304441 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:37.304406    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:39.195143 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:39.195105    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:42.407957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:42.407906    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:43.200271 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:28:43.200231    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:28:47.482199 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:47.482158    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:50.618496 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:50.618454    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:51.319420 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:51.319382    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:52.490426 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:52.490388    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:57.587812 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:57.587776    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:28:59.041074 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:28:59.041041    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:02.619911 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:02.619877    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:07.679776 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:07.679737    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:12.770361 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:12.770327    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:13.199155 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:29:13.199117    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:29:17.810870 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:17.810832    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:18.634700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:18.634625    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:22.905380 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:22.905344    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:23.703955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.703918    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"]
Nov 04 01:29:23.707946 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.707929    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.757124 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.757092    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-a96a99-openshift-default-dockercfg-hbmfv\""
Nov 04 01:29:23.810688 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.810660    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"]
Nov 04 01:29:23.886352 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.886309    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.886526 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.886365    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprk7\" (UniqueName: \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-kube-api-access-hprk7\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.886526 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.886509    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.886526 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.886552    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.886715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.886577    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.886715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.886692    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.886799 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.886727    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.886799 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.886755    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.886900 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.886811    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.988032 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.987937    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.988032 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.987997    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprk7\" (UniqueName: \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-kube-api-access-hprk7\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.988641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988084    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.988641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988111    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.988641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988237    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.988641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988336    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.988641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988343    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.988641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988376    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.988641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988402    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.988641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988410    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.988641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988458    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.989101 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988715    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.989101 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988816    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.989101 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.988923    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.990681 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.990655    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:23.991562 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:23.991522    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:24.046077 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:24.046052    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:24.046235 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:24.046174    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprk7\" (UniqueName: \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-kube-api-access-hprk7\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:24.320849 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:24.320767    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:24.741714 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:24.741686    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"]
Nov 04 01:29:24.743814 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:29:24.743784    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8c5f71_e3b2_4ee8_8bae_4749bf27dc48.slice/crio-19421961fdb34f6ac1cf45c2926a979ee3129ff08bb1ddfce375cc534b7f9db6 WatchSource:0}: Error finding container 19421961fdb34f6ac1cf45c2926a979ee3129ff08bb1ddfce375cc534b7f9db6: Status 404 returned error can't find the container with id 19421961fdb34f6ac1cf45c2926a979ee3129ff08bb1ddfce375cc534b7f9db6
Nov 04 01:29:24.746297 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:24.746269    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:29:24.746375 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:24.746329    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:29:24.746375 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:24.746359    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:29:25.168352 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:25.168251    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" event={"ID":"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48","Type":"ContainerStarted","Data":"87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3"}
Nov 04 01:29:25.168352 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:25.168307    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" event={"ID":"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48","Type":"ContainerStarted","Data":"19421961fdb34f6ac1cf45c2926a979ee3129ff08bb1ddfce375cc534b7f9db6"}
Nov 04 01:29:25.321382 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:25.321350    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:25.322680 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:25.322653    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 01:29:25.322795 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:25.322705    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 01:29:25.332472 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:25.332428    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" podStartSLOduration=2.332415435 podStartE2EDuration="2.332415435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:29:25.331889066 +0000 UTC m=+1096.482096826" watchObservedRunningTime="2026-11-04 01:29:25.332415435 +0000 UTC m=+1096.482623193"
Nov 04 01:29:26.321225 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:26.321189    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 01:29:26.321660 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:26.321254    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 01:29:27.321547 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:27.321512    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 01:29:27.321945 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:27.321580    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 01:29:27.516755 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:27.516723    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:28.058997 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:28.058962    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:28.321858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:28.321781    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 01:29:28.321858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:28.321844    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 01:29:29.321902 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:29.321864    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 01:29:29.322388 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:29.321926    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 01:29:30.322118 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:30.322076    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 01:29:30.322635 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:30.322149    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 01:29:31.503148 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:31.503116    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:31.504317 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:31.504289    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:31.505160 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:31.505135    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:29:33.100580 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:33.100518    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:38.197246 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:38.197184    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:43.199757 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:29:43.199722    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:29:43.292480 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:43.292449    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:44.049272 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:44.049239    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:48.381709 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:48.381673    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:53.501310 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:53.501272    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:58.558409 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:58.558374    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:29:59.378973 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:29:59.378938    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:00.171332 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.171297    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"]
Nov 04 01:30:00.175010 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.174994    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"
Nov 04 01:30:00.190381 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.190356    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"]
Nov 04 01:30:00.194004 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.193987    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"
Nov 04 01:30:00.234490 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.234463    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w799x\""
Nov 04 01:30:00.310157 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.310120    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"]
Nov 04 01:30:00.346123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.346084    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqfg6\" (UniqueName: \"kubernetes.io/projected/517377dd-3e7f-4e06-8de5-cb3debf32e85-kube-api-access-nqfg6\") pod \"maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg\" (UID: \"517377dd-3e7f-4e06-8de5-cb3debf32e85\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"
Nov 04 01:30:00.346300 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.346277    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7b3441-6847-46e2-947e-7b8680925c63-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc\" (UID: \"bc7b3441-6847-46e2-947e-7b8680925c63\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"
Nov 04 01:30:00.346345 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.346320    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhhtp\" (UniqueName: \"kubernetes.io/projected/bc7b3441-6847-46e2-947e-7b8680925c63-kube-api-access-bhhtp\") pod \"maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc\" (UID: \"bc7b3441-6847-46e2-947e-7b8680925c63\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"
Nov 04 01:30:00.346380 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.346369    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/517377dd-3e7f-4e06-8de5-cb3debf32e85-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg\" (UID: \"517377dd-3e7f-4e06-8de5-cb3debf32e85\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"
Nov 04 01:30:00.372644 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.372599    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"]
Nov 04 01:30:00.447472 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.447440    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7b3441-6847-46e2-947e-7b8680925c63-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc\" (UID: \"bc7b3441-6847-46e2-947e-7b8680925c63\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"
Nov 04 01:30:00.447642 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.447477    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhhtp\" (UniqueName: \"kubernetes.io/projected/bc7b3441-6847-46e2-947e-7b8680925c63-kube-api-access-bhhtp\") pod \"maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc\" (UID: \"bc7b3441-6847-46e2-947e-7b8680925c63\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"
Nov 04 01:30:00.447642 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.447575    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/517377dd-3e7f-4e06-8de5-cb3debf32e85-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg\" (UID: \"517377dd-3e7f-4e06-8de5-cb3debf32e85\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"
Nov 04 01:30:00.447642 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.447601    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqfg6\" (UniqueName: \"kubernetes.io/projected/517377dd-3e7f-4e06-8de5-cb3debf32e85-kube-api-access-nqfg6\") pod \"maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg\" (UID: \"517377dd-3e7f-4e06-8de5-cb3debf32e85\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"
Nov 04 01:30:00.448308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.448283    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7b3441-6847-46e2-947e-7b8680925c63-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc\" (UID: \"bc7b3441-6847-46e2-947e-7b8680925c63\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"
Nov 04 01:30:00.448345 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.448283    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/517377dd-3e7f-4e06-8de5-cb3debf32e85-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg\" (UID: \"517377dd-3e7f-4e06-8de5-cb3debf32e85\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"
Nov 04 01:30:00.505244 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.505211    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhhtp\" (UniqueName: \"kubernetes.io/projected/bc7b3441-6847-46e2-947e-7b8680925c63-kube-api-access-bhhtp\") pod \"maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc\" (UID: \"bc7b3441-6847-46e2-947e-7b8680925c63\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"
Nov 04 01:30:00.505383 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.505225    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqfg6\" (UniqueName: \"kubernetes.io/projected/517377dd-3e7f-4e06-8de5-cb3debf32e85-kube-api-access-nqfg6\") pod \"maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg\" (UID: \"517377dd-3e7f-4e06-8de5-cb3debf32e85\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"
Nov 04 01:30:00.506930 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.506907    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"
Nov 04 01:30:00.788460 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.788388    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"
Nov 04 01:30:00.872382 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.872350    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"]
Nov 04 01:30:00.877169 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:30:00.877137    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517377dd_3e7f_4e06_8de5_cb3debf32e85.slice/crio-d321ca86ffa2c10ecec148e367037f972dd6650ad47b2eaf705402a9b09a013f WatchSource:0}: Error finding container d321ca86ffa2c10ecec148e367037f972dd6650ad47b2eaf705402a9b09a013f: Status 404 returned error can't find the container with id d321ca86ffa2c10ecec148e367037f972dd6650ad47b2eaf705402a9b09a013f
Nov 04 01:30:00.879293 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:00.879272    5572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 01:30:01.155283 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:01.155257    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"]
Nov 04 01:30:01.157297 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:30:01.157268    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7b3441_6847_46e2_947e_7b8680925c63.slice/crio-6ac3f5fcbd0c409c68734b5c385d3ca83988d784f9baf54bcc90556ea64ad814 WatchSource:0}: Error finding container 6ac3f5fcbd0c409c68734b5c385d3ca83988d784f9baf54bcc90556ea64ad814: Status 404 returned error can't find the container with id 6ac3f5fcbd0c409c68734b5c385d3ca83988d784f9baf54bcc90556ea64ad814
Nov 04 01:30:01.374804 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:01.374765    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc" event={"ID":"bc7b3441-6847-46e2-947e-7b8680925c63","Type":"ContainerStarted","Data":"6ac3f5fcbd0c409c68734b5c385d3ca83988d784f9baf54bcc90556ea64ad814"}
Nov 04 01:30:01.376027 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:01.375997    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg" event={"ID":"517377dd-3e7f-4e06-8de5-cb3debf32e85","Type":"ContainerStarted","Data":"d321ca86ffa2c10ecec148e367037f972dd6650ad47b2eaf705402a9b09a013f"}
Nov 04 01:30:01.526817 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:01.526782    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:03.599020 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:03.598985    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:07.418006 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:07.417952    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc" event={"ID":"bc7b3441-6847-46e2-947e-7b8680925c63","Type":"ContainerStarted","Data":"82e1ae316753912616483affe9eb696c4edd947338d9c27e3a974647f54f249b"}
Nov 04 01:30:07.419815 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:07.419785    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg" event={"ID":"517377dd-3e7f-4e06-8de5-cb3debf32e85","Type":"ContainerStarted","Data":"4ff0b0174633a95da3e08b2e480a066e38c19b92318e47e1fb8565be0e5ba565"}
Nov 04 01:30:07.533595 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:07.527821    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc" podStartSLOduration=2.181917807 podStartE2EDuration="7.527802398s" totalImagesPullingTime="5.345884591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:30:07.524829044 +0000 UTC m=+1138.675036802" watchObservedRunningTime="2026-11-04 01:30:07.527802398 +0000 UTC m=+1138.678010158"
Nov 04 01:30:07.633526 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:07.633468    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg" podStartSLOduration=2.004002998 podStartE2EDuration="7.633454004s" totalImagesPullingTime="5.629451006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:30:07.632638418 +0000 UTC m=+1138.782846188" watchObservedRunningTime="2026-11-04 01:30:07.633454004 +0000 UTC m=+1138.783661777"
Nov 04 01:30:08.428488 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:08.428448    5572 generic.go:356] "Generic (PLEG): container finished" podID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerID="4ff0b0174633a95da3e08b2e480a066e38c19b92318e47e1fb8565be0e5ba565" exitCode=60
Nov 04 01:30:08.429037 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:08.428563    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg" event={"ID":"517377dd-3e7f-4e06-8de5-cb3debf32e85","Type":"ContainerDied","Data":"4ff0b0174633a95da3e08b2e480a066e38c19b92318e47e1fb8565be0e5ba565"}
Nov 04 01:30:08.429037 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:08.428960    5572 scope.go:122] "RemoveContainer" containerID="4ff0b0174633a95da3e08b2e480a066e38c19b92318e47e1fb8565be0e5ba565"
Nov 04 01:30:08.430478 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:08.430454    5572 generic.go:356] "Generic (PLEG): container finished" podID="bc7b3441-6847-46e2-947e-7b8680925c63" containerID="82e1ae316753912616483affe9eb696c4edd947338d9c27e3a974647f54f249b" exitCode=60
Nov 04 01:30:08.430597 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:08.430505    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc" event={"ID":"bc7b3441-6847-46e2-947e-7b8680925c63","Type":"ContainerDied","Data":"82e1ae316753912616483affe9eb696c4edd947338d9c27e3a974647f54f249b"}
Nov 04 01:30:08.430762 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:08.430744    5572 scope.go:122] "RemoveContainer" containerID="82e1ae316753912616483affe9eb696c4edd947338d9c27e3a974647f54f249b"
Nov 04 01:30:08.799462 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:08.799417    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:09.437456 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:09.437426    5572 generic.go:356] "Generic (PLEG): container finished" podID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerID="a4058decca8cef5759dfc69e603cd4de7601bdc67bccf5f4b6f91b81040e2b8a" exitCode=60
Nov 04 01:30:09.437933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:09.437485    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg" event={"ID":"517377dd-3e7f-4e06-8de5-cb3debf32e85","Type":"ContainerDied","Data":"a4058decca8cef5759dfc69e603cd4de7601bdc67bccf5f4b6f91b81040e2b8a"}
Nov 04 01:30:09.437933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:09.437572    5572 scope.go:122] "RemoveContainer" containerID="4ff0b0174633a95da3e08b2e480a066e38c19b92318e47e1fb8565be0e5ba565"
Nov 04 01:30:09.437933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:09.437819    5572 scope.go:122] "RemoveContainer" containerID="a4058decca8cef5759dfc69e603cd4de7601bdc67bccf5f4b6f91b81040e2b8a"
Nov 04 01:30:09.438109 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:30:09.438084    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg_odh-ai-gateway-infra(517377dd-3e7f-4e06-8de5-cb3debf32e85)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85"
Nov 04 01:30:09.439690 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:09.439671    5572 generic.go:356] "Generic (PLEG): container finished" podID="bc7b3441-6847-46e2-947e-7b8680925c63" containerID="93cfb3b8cdd346a87b22b6e63703edc5dca0ec3c881422112dac98bae867e8e4" exitCode=60
Nov 04 01:30:09.439777 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:09.439715    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc" event={"ID":"bc7b3441-6847-46e2-947e-7b8680925c63","Type":"ContainerDied","Data":"93cfb3b8cdd346a87b22b6e63703edc5dca0ec3c881422112dac98bae867e8e4"}
Nov 04 01:30:09.439947 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:09.439933    5572 scope.go:122] "RemoveContainer" containerID="93cfb3b8cdd346a87b22b6e63703edc5dca0ec3c881422112dac98bae867e8e4"
Nov 04 01:30:09.440151 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:30:09.440134    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc_odh-ai-gateway-infra(bc7b3441-6847-46e2-947e-7b8680925c63)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc" podUID="bc7b3441-6847-46e2-947e-7b8680925c63"
Nov 04 01:30:09.449233 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:09.449212    5572 scope.go:122] "RemoveContainer" containerID="82e1ae316753912616483affe9eb696c4edd947338d9c27e3a974647f54f249b"
Nov 04 01:30:10.446628 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:10.446601    5572 scope.go:122] "RemoveContainer" containerID="a4058decca8cef5759dfc69e603cd4de7601bdc67bccf5f4b6f91b81040e2b8a"
Nov 04 01:30:10.447112 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:30:10.446858    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg_odh-ai-gateway-infra(517377dd-3e7f-4e06-8de5-cb3debf32e85)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85"
Nov 04 01:30:10.448292 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:10.448275    5572 scope.go:122] "RemoveContainer" containerID="93cfb3b8cdd346a87b22b6e63703edc5dca0ec3c881422112dac98bae867e8e4"
Nov 04 01:30:10.448466 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:30:10.448448    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc_odh-ai-gateway-infra(bc7b3441-6847-46e2-947e-7b8680925c63)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc" podUID="bc7b3441-6847-46e2-947e-7b8680925c63"
Nov 04 01:30:10.545037 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:10.545004    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"]
Nov 04 01:30:10.545195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:10.545159    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy" containerID="cri-o://bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749" gracePeriod=30
Nov 04 01:30:13.200470 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:30:13.200429    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:30:13.890328 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:13.890294    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:15.795203 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.795176    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:30:15.901182 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901098    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-certs\") pod \"7861fe1b-d946-4a30-bb32-53d82f3f969b\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") "
Nov 04 01:30:15.901182 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901136    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7861fe1b-d946-4a30-bb32-53d82f3f969b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7861fe1b-d946-4a30-bb32-53d82f3f969b-istiod-ca-cert\") pod \"7861fe1b-d946-4a30-bb32-53d82f3f969b\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") "
Nov 04 01:30:15.901182 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901155    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-socket\") pod \"7861fe1b-d946-4a30-bb32-53d82f3f969b\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") "
Nov 04 01:30:15.901182 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901201    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-kube-api-access-tpgdj\" (UniqueName: \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-kube-api-access-tpgdj\") pod \"7861fe1b-d946-4a30-bb32-53d82f3f969b\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") "
Nov 04 01:30:15.901182 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901251    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-token\" (UniqueName: \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-token\") pod \"7861fe1b-d946-4a30-bb32-53d82f3f969b\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") "
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901302    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-envoy\") pod \"7861fe1b-d946-4a30-bb32-53d82f3f969b\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") "
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901381    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-data\") pod \"7861fe1b-d946-4a30-bb32-53d82f3f969b\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") "
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901447    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-podinfo\") pod \"7861fe1b-d946-4a30-bb32-53d82f3f969b\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") "
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901461    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-certs" pod "7861fe1b-d946-4a30-bb32-53d82f3f969b" (UID: "7861fe1b-d946-4a30-bb32-53d82f3f969b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901476    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-socket" pod "7861fe1b-d946-4a30-bb32-53d82f3f969b" (UID: "7861fe1b-d946-4a30-bb32-53d82f3f969b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901633    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7861fe1b-d946-4a30-bb32-53d82f3f969b-istiod-ca-cert" pod "7861fe1b-d946-4a30-bb32-53d82f3f969b" (UID: "7861fe1b-d946-4a30-bb32-53d82f3f969b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901489    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-credential-socket\") pod \"7861fe1b-d946-4a30-bb32-53d82f3f969b\" (UID: \"7861fe1b-d946-4a30-bb32-53d82f3f969b\") "
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901735    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-data" pod "7861fe1b-d946-4a30-bb32-53d82f3f969b" (UID: "7861fe1b-d946-4a30-bb32-53d82f3f969b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.901750    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-credential-socket" pod "7861fe1b-d946-4a30-bb32-53d82f3f969b" (UID: "7861fe1b-d946-4a30-bb32-53d82f3f969b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.902149    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.902177    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.902193    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.902207    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7861fe1b-d946-4a30-bb32-53d82f3f969b-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:15.902247 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.902222    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:15.904015 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.903982    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-kube-api-access-tpgdj" pod "7861fe1b-d946-4a30-bb32-53d82f3f969b" (UID: "7861fe1b-d946-4a30-bb32-53d82f3f969b"). InnerVolumeSpecName "kube-api-access-tpgdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:30:15.904126 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.904051    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-envoy" pod "7861fe1b-d946-4a30-bb32-53d82f3f969b" (UID: "7861fe1b-d946-4a30-bb32-53d82f3f969b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:30:15.904126 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.904091    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-token" pod "7861fe1b-d946-4a30-bb32-53d82f3f969b" (UID: "7861fe1b-d946-4a30-bb32-53d82f3f969b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:30:15.904240 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:15.904133    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-podinfo" pod "7861fe1b-d946-4a30-bb32-53d82f3f969b" (UID: "7861fe1b-d946-4a30-bb32-53d82f3f969b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:30:16.002883 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.002853    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:16.002883 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.002879    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpgdj\" (UniqueName: \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-kube-api-access-tpgdj\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:16.002883 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.002891    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:16.003119 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.002900    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7861fe1b-d946-4a30-bb32-53d82f3f969b-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:16.486009 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.485975    5572 generic.go:356] "Generic (PLEG): container finished" podID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerID="bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749" exitCode=0
Nov 04 01:30:16.486178 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.486023    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"
Nov 04 01:30:16.486178 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.486059    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" event={"ID":"7861fe1b-d946-4a30-bb32-53d82f3f969b","Type":"ContainerDied","Data":"bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749"}
Nov 04 01:30:16.486178 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.486117    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff" event={"ID":"7861fe1b-d946-4a30-bb32-53d82f3f969b","Type":"ContainerDied","Data":"3c206fce77aec75fb613ffbaf0c4ceaf0eafe93f79a7733b67c8e1469e991fa7"}
Nov 04 01:30:16.486178 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.486149    5572 scope.go:122] "RemoveContainer" containerID="bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749"
Nov 04 01:30:16.496216 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.496194    5572 scope.go:122] "RemoveContainer" containerID="7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595"
Nov 04 01:30:16.504788 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.504770    5572 scope.go:122] "RemoveContainer" containerID="bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749"
Nov 04 01:30:16.505095 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:30:16.505074    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749\": container with ID starting with bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749 not found: ID does not exist" containerID="bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749"
Nov 04 01:30:16.505176 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.505109    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749"} err="failed to get container status \"bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749\": rpc error: code = NotFound desc = could not find container \"bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749\": container with ID starting with bfe971887212ac587a8c1b82f8b892138763e7f70f7a82f9646e988583e79749 not found: ID does not exist"
Nov 04 01:30:16.505176 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.505131    5572 scope.go:122] "RemoveContainer" containerID="7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595"
Nov 04 01:30:16.505391 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:30:16.505368    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595\": container with ID starting with 7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595 not found: ID does not exist" containerID="7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595"
Nov 04 01:30:16.505429 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.505398    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595"} err="failed to get container status \"7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595\": rpc error: code = NotFound desc = could not find container \"7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595\": container with ID starting with 7eb9964f212c7a85c3fd12ffd0bd20873a8c0d56dea9990f824ecfe47b730595 not found: ID does not exist"
Nov 04 01:30:16.704280 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.704240    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"]
Nov 04 01:30:16.750181 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.750095    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-wbbff"]
Nov 04 01:30:16.972382 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:16.972349    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" path="/var/lib/kubelet/pods/7861fe1b-d946-4a30-bb32-53d82f3f969b/volumes"
Nov 04 01:30:19.003646 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:19.003607    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:20.966383 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:20.966352    5572 scope.go:122] "RemoveContainer" containerID="a4058decca8cef5759dfc69e603cd4de7601bdc67bccf5f4b6f91b81040e2b8a"
Nov 04 01:30:21.516336 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:21.516258    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg" event={"ID":"517377dd-3e7f-4e06-8de5-cb3debf32e85","Type":"ContainerStarted","Data":"90d6583df5484318317739b94f04248199e5717fcb66205cc8a818f59a0692a5"}
Nov 04 01:30:21.966456 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:21.966428    5572 scope.go:122] "RemoveContainer" containerID="93cfb3b8cdd346a87b22b6e63703edc5dca0ec3c881422112dac98bae867e8e4"
Nov 04 01:30:22.523411 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:22.523374    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc" event={"ID":"bc7b3441-6847-46e2-947e-7b8680925c63","Type":"ContainerStarted","Data":"fca6d7fe2d80e8e385cd4dc1ccf6427100625957bc2e44ec35e07a391bb90256"}
Nov 04 01:30:22.525262 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:22.525238    5572 generic.go:356] "Generic (PLEG): container finished" podID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerID="90d6583df5484318317739b94f04248199e5717fcb66205cc8a818f59a0692a5" exitCode=60
Nov 04 01:30:22.525380 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:22.525306    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg" event={"ID":"517377dd-3e7f-4e06-8de5-cb3debf32e85","Type":"ContainerDied","Data":"90d6583df5484318317739b94f04248199e5717fcb66205cc8a818f59a0692a5"}
Nov 04 01:30:22.525380 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:22.525365    5572 scope.go:122] "RemoveContainer" containerID="a4058decca8cef5759dfc69e603cd4de7601bdc67bccf5f4b6f91b81040e2b8a"
Nov 04 01:30:22.525626 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:22.525610    5572 scope.go:122] "RemoveContainer" containerID="90d6583df5484318317739b94f04248199e5717fcb66205cc8a818f59a0692a5"
Nov 04 01:30:22.525858 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:30:22.525838    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg_odh-ai-gateway-infra(517377dd-3e7f-4e06-8de5-cb3debf32e85)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85"
Nov 04 01:30:22.635791 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:22.635754    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"]
Nov 04 01:30:23.534101 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.534074    5572 generic.go:356] "Generic (PLEG): container finished" podID="bc7b3441-6847-46e2-947e-7b8680925c63" containerID="fca6d7fe2d80e8e385cd4dc1ccf6427100625957bc2e44ec35e07a391bb90256" exitCode=60
Nov 04 01:30:23.534517 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.534116    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc" event={"ID":"bc7b3441-6847-46e2-947e-7b8680925c63","Type":"ContainerDied","Data":"fca6d7fe2d80e8e385cd4dc1ccf6427100625957bc2e44ec35e07a391bb90256"}
Nov 04 01:30:23.534517 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.534172    5572 scope.go:122] "RemoveContainer" containerID="93cfb3b8cdd346a87b22b6e63703edc5dca0ec3c881422112dac98bae867e8e4"
Nov 04 01:30:23.534672 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.534564    5572 scope.go:122] "RemoveContainer" containerID="fca6d7fe2d80e8e385cd4dc1ccf6427100625957bc2e44ec35e07a391bb90256"
Nov 04 01:30:23.534876 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:30:23.534838    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc_odh-ai-gateway-infra(bc7b3441-6847-46e2-947e-7b8680925c63)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc" podUID="bc7b3441-6847-46e2-947e-7b8680925c63"
Nov 04 01:30:23.643009 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.642977    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"]
Nov 04 01:30:23.673835 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.673811    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"
Nov 04 01:30:23.781624 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.781588    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/517377dd-3e7f-4e06-8de5-cb3debf32e85-kube-api-access-nqfg6\" (UniqueName: \"kubernetes.io/projected/517377dd-3e7f-4e06-8de5-cb3debf32e85-kube-api-access-nqfg6\") pod \"517377dd-3e7f-4e06-8de5-cb3debf32e85\" (UID: \"517377dd-3e7f-4e06-8de5-cb3debf32e85\") "
Nov 04 01:30:23.781624 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.781624    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/517377dd-3e7f-4e06-8de5-cb3debf32e85-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/517377dd-3e7f-4e06-8de5-cb3debf32e85-maas-api-service-ca\") pod \"517377dd-3e7f-4e06-8de5-cb3debf32e85\" (UID: \"517377dd-3e7f-4e06-8de5-cb3debf32e85\") "
Nov 04 01:30:23.782019 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.781993    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/517377dd-3e7f-4e06-8de5-cb3debf32e85-maas-api-service-ca" pod "517377dd-3e7f-4e06-8de5-cb3debf32e85" (UID: "517377dd-3e7f-4e06-8de5-cb3debf32e85"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:30:23.783705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.783647    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/517377dd-3e7f-4e06-8de5-cb3debf32e85-kube-api-access-nqfg6" pod "517377dd-3e7f-4e06-8de5-cb3debf32e85" (UID: "517377dd-3e7f-4e06-8de5-cb3debf32e85"). InnerVolumeSpecName "kube-api-access-nqfg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:30:23.883136 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.883097    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqfg6\" (UniqueName: \"kubernetes.io/projected/517377dd-3e7f-4e06-8de5-cb3debf32e85-kube-api-access-nqfg6\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:23.883136 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:23.883138    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/517377dd-3e7f-4e06-8de5-cb3debf32e85-maas-api-service-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:24.095360 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.095260    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:24.542590 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.542565    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"
Nov 04 01:30:24.542941 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.542569    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg" event={"ID":"517377dd-3e7f-4e06-8de5-cb3debf32e85","Type":"ContainerDied","Data":"d321ca86ffa2c10ecec148e367037f972dd6650ad47b2eaf705402a9b09a013f"}
Nov 04 01:30:24.542941 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.542693    5572 scope.go:122] "RemoveContainer" containerID="90d6583df5484318317739b94f04248199e5717fcb66205cc8a818f59a0692a5"
Nov 04 01:30:24.682753 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.682729    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"
Nov 04 01:30:24.753625 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.753593    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"]
Nov 04 01:30:24.757680 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.757655    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-a96a99-29895930-7z7bg"]
Nov 04 01:30:24.791944 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.791878    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc7b3441-6847-46e2-947e-7b8680925c63-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7b3441-6847-46e2-947e-7b8680925c63-maas-api-service-ca\") pod \"bc7b3441-6847-46e2-947e-7b8680925c63\" (UID: \"bc7b3441-6847-46e2-947e-7b8680925c63\") "
Nov 04 01:30:24.792087 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.791943    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc7b3441-6847-46e2-947e-7b8680925c63-kube-api-access-bhhtp\" (UniqueName: \"kubernetes.io/projected/bc7b3441-6847-46e2-947e-7b8680925c63-kube-api-access-bhhtp\") pod \"bc7b3441-6847-46e2-947e-7b8680925c63\" (UID: \"bc7b3441-6847-46e2-947e-7b8680925c63\") "
Nov 04 01:30:24.792221 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.792200    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7b3441-6847-46e2-947e-7b8680925c63-maas-api-service-ca" pod "bc7b3441-6847-46e2-947e-7b8680925c63" (UID: "bc7b3441-6847-46e2-947e-7b8680925c63"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:30:24.794011 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.793984    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7b3441-6847-46e2-947e-7b8680925c63-kube-api-access-bhhtp" pod "bc7b3441-6847-46e2-947e-7b8680925c63" (UID: "bc7b3441-6847-46e2-947e-7b8680925c63"). InnerVolumeSpecName "kube-api-access-bhhtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:30:24.893363 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.893325    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7b3441-6847-46e2-947e-7b8680925c63-maas-api-service-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:24.893363 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.893356    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhhtp\" (UniqueName: \"kubernetes.io/projected/bc7b3441-6847-46e2-947e-7b8680925c63-kube-api-access-bhhtp\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:30:24.972582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:24.972552    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85" path="/var/lib/kubelet/pods/517377dd-3e7f-4e06-8de5-cb3debf32e85/volumes"
Nov 04 01:30:25.557599 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:25.557563    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc" event={"ID":"bc7b3441-6847-46e2-947e-7b8680925c63","Type":"ContainerDied","Data":"6ac3f5fcbd0c409c68734b5c385d3ca83988d784f9baf54bcc90556ea64ad814"}
Nov 04 01:30:25.557599 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:25.557583    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"
Nov 04 01:30:25.558129 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:25.557645    5572 scope.go:122] "RemoveContainer" containerID="fca6d7fe2d80e8e385cd4dc1ccf6427100625957bc2e44ec35e07a391bb90256"
Nov 04 01:30:25.709967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:25.709931    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"]
Nov 04 01:30:25.714337 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:25.714313    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-b2eadb-29895930-q7djc"]
Nov 04 01:30:26.972092 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:26.972058    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc7b3441-6847-46e2-947e-7b8680925c63" path="/var/lib/kubelet/pods/bc7b3441-6847-46e2-947e-7b8680925c63/volumes"
Nov 04 01:30:27.221298 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221266    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"]
Nov 04 01:30:27.221759 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221728    5572 cpu_manager.go:414] "containerMap: removing container" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy"
Nov 04 01:30:27.221759 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221744    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221766    5572 cpu_manager.go:414] "containerMap: removing container" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerName="cleanup"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221771    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerName="cleanup"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221781    5572 cpu_manager.go:414] "containerMap: removing container" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerName="cleanup"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221787    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerName="cleanup"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221797    5572 cpu_manager.go:414] "containerMap: removing container" podUID="bc7b3441-6847-46e2-947e-7b8680925c63" containerName="cleanup"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221801    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc7b3441-6847-46e2-947e-7b8680925c63" containerName="cleanup"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221811    5572 cpu_manager.go:414] "containerMap: removing container" podUID="bc7b3441-6847-46e2-947e-7b8680925c63" containerName="cleanup"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221815    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc7b3441-6847-46e2-947e-7b8680925c63" containerName="cleanup"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221824    5572 cpu_manager.go:414] "containerMap: removing container" podUID="bc7b3441-6847-46e2-947e-7b8680925c63" containerName="cleanup"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221828    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc7b3441-6847-46e2-947e-7b8680925c63" containerName="cleanup"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221834    5572 cpu_manager.go:414] "containerMap: removing container" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerName="cleanup"
Nov 04 01:30:27.221858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221838    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerName="cleanup"
Nov 04 01:30:27.222261 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221898    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy"
Nov 04 01:30:27.222261 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221906    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerName="cleanup"
Nov 04 01:30:27.222261 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221912    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerName="cleanup"
Nov 04 01:30:27.222261 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221918    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc7b3441-6847-46e2-947e-7b8680925c63" containerName="cleanup"
Nov 04 01:30:27.222261 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221925    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc7b3441-6847-46e2-947e-7b8680925c63" containerName="cleanup"
Nov 04 01:30:27.222261 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221930    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="517377dd-3e7f-4e06-8de5-cb3debf32e85" containerName="cleanup"
Nov 04 01:30:27.222261 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.221937    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy"
Nov 04 01:30:27.226462 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.226441    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.313902 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.313863    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:27.316149 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.316121    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-dshm\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.316266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.316189    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfpjt\" (UniqueName: \"kubernetes.io/projected/64a889d9-1a4b-4230-8110-b2c9a09af77c-kube-api-access-xfpjt\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.316325 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.316264    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-model-cache\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.316325 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.316313    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-home\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.316429 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.316343    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64a889d9-1a4b-4230-8110-b2c9a09af77c-tls-certs\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.316511 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.316489    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-tmp-dir\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.323437 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.323418    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-00cfe6\"/\"distinct-w2-00cfe6-kserve-self-signed-certs\""
Nov 04 01:30:27.325694 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.325676    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"]
Nov 04 01:30:27.417986 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.417951    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-tmp-dir\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.418195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.418033    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-dshm\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.418195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.418085    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfpjt\" (UniqueName: \"kubernetes.io/projected/64a889d9-1a4b-4230-8110-b2c9a09af77c-kube-api-access-xfpjt\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.418195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.418120    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-model-cache\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.418195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.418170    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-home\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.418384 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.418209    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64a889d9-1a4b-4230-8110-b2c9a09af77c-tls-certs\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.418431 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.418414    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-tmp-dir\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.418553 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.418509    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-model-cache\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.418611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.418577    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-home\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.420407 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.420391    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-dshm\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.420611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.420594    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64a889d9-1a4b-4230-8110-b2c9a09af77c-tls-certs\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.475483 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.475407    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfpjt\" (UniqueName: \"kubernetes.io/projected/64a889d9-1a4b-4230-8110-b2c9a09af77c-kube-api-access-xfpjt\") pod \"distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.539296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.539260    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:27.913897 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:27.913871    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"]
Nov 04 01:30:27.916707 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:30:27.916678    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64a889d9_1a4b_4230_8110_b2c9a09af77c.slice/crio-2c3abfa09cb9421b53961724997435f8b73a1fac704cef65ea0ec13e99c83dac WatchSource:0}: Error finding container 2c3abfa09cb9421b53961724997435f8b73a1fac704cef65ea0ec13e99c83dac: Status 404 returned error can't find the container with id 2c3abfa09cb9421b53961724997435f8b73a1fac704cef65ea0ec13e99c83dac
Nov 04 01:30:28.579219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:28.579179    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7" event={"ID":"64a889d9-1a4b-4230-8110-b2c9a09af77c","Type":"ContainerStarted","Data":"f563ea2bdc419f40ba4d1046aae6746f0136a95a30b2f44606aa70f7bba67a05"}
Nov 04 01:30:28.579746 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:28.579228    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7" event={"ID":"64a889d9-1a4b-4230-8110-b2c9a09af77c","Type":"ContainerStarted","Data":"2c3abfa09cb9421b53961724997435f8b73a1fac704cef65ea0ec13e99c83dac"}
Nov 04 01:30:28.689491 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:28.689431    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7" podStartSLOduration=1.689418477 podStartE2EDuration="1.689418477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:30:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:30:28.688737855 +0000 UTC m=+1159.838945595" watchObservedRunningTime="2026-11-04 01:30:28.689418477 +0000 UTC m=+1159.839626214"
Nov 04 01:30:29.192569 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:29.192517    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:29.540332 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:29.540246    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:34.285620 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:34.285584    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:37.540326 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:37.540270    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:37.553400 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:37.553372    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:37.644473 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:37.644448    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:30:39.488156 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:39.488120    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:43.202996 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:30:43.202957    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:30:44.408075 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:44.408041    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:44.554817 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:44.554783    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:49.633895 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:49.633863    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:54.687717 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:54.687672    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:59.714933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:59.714901    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:30:59.861113 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:30:59.861079    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:04.888096 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:04.888058    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:09.985521 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:09.985479    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:10.186104 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:10.186073    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:12.079921 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:12.079890    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:13.199624 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:31:13.199591    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:31:15.108290 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:15.108254    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:20.206360 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:20.206325    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:20.823245 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:20.823211    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:21.041149 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.041105    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:21.752456 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.752421    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"]
Nov 04 01:31:21.752921 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.752906    5572 cpu_manager.go:414] "containerMap: removing container" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy"
Nov 04 01:31:21.752965 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.752923    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7861fe1b-d946-4a30-bb32-53d82f3f969b" containerName="istio-proxy"
Nov 04 01:31:21.753043 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.753031    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc7b3441-6847-46e2-947e-7b8680925c63" containerName="cleanup"
Nov 04 01:31:21.756392 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.756372    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.778547 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.778504    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1f9e7c3-e9e5-45fa-9674-24a429878844-tls-certs\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.778676 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.778625    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-tmp-dir\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.778718 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.778686    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-dshm\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.778718 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.778706    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8npk2\" (UniqueName: \"kubernetes.io/projected/c1f9e7c3-e9e5-45fa-9674-24a429878844-kube-api-access-8npk2\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.778786 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.778726    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-home\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.778900 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.778880    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-model-cache\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.805334 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.805293    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a96a99\"/\"openshift-service-ca.crt\""
Nov 04 01:31:21.851118 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.851088    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-a96a99\"/\"kube-root-ca.crt\""
Nov 04 01:31:21.851343 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.851315    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a96a99\"/\"default-dockercfg-gkd6n\""
Nov 04 01:31:21.851421 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.851353    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-a96a99\"/\"distinct-w0-a96a99-kserve-self-signed-certs\""
Nov 04 01:31:21.852119 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.852095    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:21.880478 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.880448    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-dshm\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.880624 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.880485    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8npk2\" (UniqueName: \"kubernetes.io/projected/c1f9e7c3-e9e5-45fa-9674-24a429878844-kube-api-access-8npk2\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.880624 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.880516    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-home\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.880624 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.880620    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-model-cache\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.880784 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.880704    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1f9e7c3-e9e5-45fa-9674-24a429878844-tls-certs\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.880784 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.880762    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-tmp-dir\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.881417 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.880974    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-home\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.881417 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.881084    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-model-cache\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.881417 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.881135    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-tmp-dir\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.883019 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.882989    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-dshm\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.883319 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.883304    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1f9e7c3-e9e5-45fa-9674-24a429878844-tls-certs\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.937837 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.937802    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8npk2\" (UniqueName: \"kubernetes.io/projected/c1f9e7c3-e9e5-45fa-9674-24a429878844-kube-api-access-8npk2\") pod \"distinct-w0-a96a99-kserve-775d96bf9b-ls9qb\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") " pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:21.941831 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:21.941800    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"]
Nov 04 01:31:22.069221 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:22.069129    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:22.441195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:22.441169    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"]
Nov 04 01:31:22.443404 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:31:22.443377    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1f9e7c3_e9e5_45fa_9674_24a429878844.slice/crio-9b8f1c27e3980bce8d7d94f29b016f3d771987e99d116be099042fe97eb41185 WatchSource:0}: Error finding container 9b8f1c27e3980bce8d7d94f29b016f3d771987e99d116be099042fe97eb41185: Status 404 returned error can't find the container with id 9b8f1c27e3980bce8d7d94f29b016f3d771987e99d116be099042fe97eb41185
Nov 04 01:31:22.877771 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:22.877676    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb" event={"ID":"c1f9e7c3-e9e5-45fa-9674-24a429878844","Type":"ContainerStarted","Data":"8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9"}
Nov 04 01:31:22.877771 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:22.877729    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb" event={"ID":"c1f9e7c3-e9e5-45fa-9674-24a429878844","Type":"ContainerStarted","Data":"9b8f1c27e3980bce8d7d94f29b016f3d771987e99d116be099042fe97eb41185"}
Nov 04 01:31:22.988740 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:22.988686    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb" podStartSLOduration=1.98867171 podStartE2EDuration="1.98867171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:31:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:31:22.986226814 +0000 UTC m=+1214.136434572" watchObservedRunningTime="2026-11-04 01:31:22.98867171 +0000 UTC m=+1214.138879505"
Nov 04 01:31:23.070086 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:23.070051    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:24.795248 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:24.795206    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:24.955203 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:24.955165    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:25.101621 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:25.101515    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:25.559167 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:25.559131    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:28.015447 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:28.015419    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:28.197902 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:28.197875    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:28.345345 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:28.345261    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:30.797198 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:30.797169    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:32.069991 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:32.069952    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:32.083883 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:32.083855    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:32.946394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:32.946365    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:31:35.816546 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:35.816509    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:40.929663 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:40.929621    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:43.200245 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:31:43.200207    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:31:44.924370 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:44.924332    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:46.002858 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:46.002819    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:51.102392 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:51.102359    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:55.825603 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:55.825567    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"]
Nov 04 01:31:55.829362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:55.829339    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:55.878111 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:55.878079    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-a-5520b3-serving-cert\""
Nov 04 01:31:55.926474 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:55.926441    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"]
Nov 04 01:31:55.928955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:55.928937    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-metrics-certs\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:55.929067 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:55.929047    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbdwk\" (UniqueName: \"kubernetes.io/projected/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-kube-api-access-cbdwk\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:55.929115 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:55.929101    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-maas-api-tls\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:55.929156 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:55.929128    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:56.024401 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.024371    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:56.030703 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.030679    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbdwk\" (UniqueName: \"kubernetes.io/projected/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-kube-api-access-cbdwk\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:56.030806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.030730    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-maas-api-tls\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:56.030806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.030758    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:56.030891 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.030823    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-metrics-certs\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:56.030994 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:31:56.030974    5572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-serving-cert: secret "maas-api-e2e-extmod-a-5520b3-serving-cert" not found
Nov 04 01:31:56.031076 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:31:56.031063    5572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-maas-api-tls podName:60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f nodeName:}" failed. No retries permitted until 2026-11-04 01:31:56.531043564 +0000 UTC m=+1247.681251315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-maas-api-tls") pod "maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2" (UID: "60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f") : secret "maas-api-e2e-extmod-a-5520b3-serving-cert" not found
Nov 04 01:31:56.031429 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.031407    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:56.033174 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.033158    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-metrics-certs\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:56.088986 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.088910    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbdwk\" (UniqueName: \"kubernetes.io/projected/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-kube-api-access-cbdwk\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:56.200415 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.200384    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:56.345518 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.345448    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:31:56.535730 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.535688    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-maas-api-tls\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:56.538170 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.538144    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-maas-api-tls\") pod \"maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:56.742718 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:56.742686    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:57.112098 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:57.112071    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"]
Nov 04 01:31:57.114225 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:31:57.114200    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e6bc1c_0a76_4c01_b3d1_8da4c4a4214f.slice/crio-180b7bfbda2080f28b93cd838586ea8771f43d5fa5f1006966cb7f0b2bb22f0b WatchSource:0}: Error finding container 180b7bfbda2080f28b93cd838586ea8771f43d5fa5f1006966cb7f0b2bb22f0b: Status 404 returned error can't find the container with id 180b7bfbda2080f28b93cd838586ea8771f43d5fa5f1006966cb7f0b2bb22f0b
Nov 04 01:31:58.072265 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:58.072232    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2" event={"ID":"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f","Type":"ContainerStarted","Data":"180b7bfbda2080f28b93cd838586ea8771f43d5fa5f1006966cb7f0b2bb22f0b"}
Nov 04 01:31:59.079608 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:59.079572    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2" event={"ID":"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f","Type":"ContainerStarted","Data":"96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968"}
Nov 04 01:31:59.080028 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:59.079657    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:31:59.191864 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:31:59.191812    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2" podStartSLOduration=3.060549679 podStartE2EDuration="4.191798965s" totalImagesPullingTime="1.131249286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:31:59.190913726 +0000 UTC m=+1250.341121486" watchObservedRunningTime="2026-11-04 01:31:59.191798965 +0000 UTC m=+1250.342006720"
Nov 04 01:32:00.070480 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:00.070418    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:01.297471 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:01.297425    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:04.883568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:04.883498    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"]
Nov 04 01:32:04.887624 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:04.887598    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:04.921728 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:04.921694    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-model-cache\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:04.921883 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:04.921803    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-home\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:04.921883 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:04.921843    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66385f48-67a4-4a7b-8f65-b780eb1711f7-tls-certs\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:04.921971 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:04.921943    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-tmp-dir\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:04.922018 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:04.921974    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-dshm\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:04.922057 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:04.922046    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wlrw\" (UniqueName: \"kubernetes.io/projected/66385f48-67a4-4a7b-8f65-b780eb1711f7-kube-api-access-8wlrw\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:04.975069 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:04.975039    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:04.982604 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:04.982581    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-00cfe6\"/\"distinct-2-w2-00cfe6-kserve-self-signed-certs\""
Nov 04 01:32:04.984788 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:04.984769    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"]
Nov 04 01:32:05.023575 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.023525    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-tmp-dir\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.023732 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.023583    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-dshm\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.023732 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.023691    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wlrw\" (UniqueName: \"kubernetes.io/projected/66385f48-67a4-4a7b-8f65-b780eb1711f7-kube-api-access-8wlrw\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.023865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.023736    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-model-cache\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.023865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.023839    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-home\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.023979 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.023920    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66385f48-67a4-4a7b-8f65-b780eb1711f7-tls-certs\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.024055 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.024025    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-tmp-dir\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.024761 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.024391    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-model-cache\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.024954 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.024907    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-home\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.027439 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.027389    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66385f48-67a4-4a7b-8f65-b780eb1711f7-tls-certs\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.027643 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.027497    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-dshm\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.085105 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.085064    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wlrw\" (UniqueName: \"kubernetes.io/projected/66385f48-67a4-4a7b-8f65-b780eb1711f7-kube-api-access-8wlrw\") pod \"distinct-2-w2-00cfe6-kserve-58fb495886-t266d\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") " pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.091291 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.091267    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:32:05.200431 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.200388    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:05.596918 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:05.596804    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"]
Nov 04 01:32:05.599940 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:32:05.599885    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66385f48_67a4_4a7b_8f65_b780eb1711f7.slice/crio-0e20339baf2946b39dafae90bd11f317e13a1f31afc585b84336fb97a364c56a WatchSource:0}: Error finding container 0e20339baf2946b39dafae90bd11f317e13a1f31afc585b84336fb97a364c56a: Status 404 returned error can't find the container with id 0e20339baf2946b39dafae90bd11f317e13a1f31afc585b84336fb97a364c56a
Nov 04 01:32:06.120898 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:06.120853    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d" event={"ID":"66385f48-67a4-4a7b-8f65-b780eb1711f7","Type":"ContainerStarted","Data":"e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4"}
Nov 04 01:32:06.121272 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:06.120913    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d" event={"ID":"66385f48-67a4-4a7b-8f65-b780eb1711f7","Type":"ContainerStarted","Data":"0e20339baf2946b39dafae90bd11f317e13a1f31afc585b84336fb97a364c56a"}
Nov 04 01:32:06.200766 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:06.200730    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:06.230266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:06.230175    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d" podStartSLOduration=2.230156976 podStartE2EDuration="2.230156976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:32:06.229837531 +0000 UTC m=+1257.380045290" watchObservedRunningTime="2026-11-04 01:32:06.230156976 +0000 UTC m=+1257.380364734"
Nov 04 01:32:06.406756 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:06.406675    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:07.553634 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.553594    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:07.741073 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.741037    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"]
Nov 04 01:32:07.744774 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.744752    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.794922 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.794894    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-b2eadb-openshift-default-dockercfg-b9qd7\""
Nov 04 01:32:07.851955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.851882    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"]
Nov 04 01:32:07.854816 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.854780    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqcbz\" (UniqueName: \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-kube-api-access-xqcbz\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.854983 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.854892    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.854983 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.854949    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2327580-e346-4424-bb30-156c284120de-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.855080 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.854998    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.855123 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.855099    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.855163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.855148    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.855202 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.855168    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.855299 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.855277    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2327580-e346-4424-bb30-156c284120de-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.855425 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.855409    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.956382 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.956348    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.956569 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.956393    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqcbz\" (UniqueName: \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-kube-api-access-xqcbz\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.956569 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.956419    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.956569 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.956439    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2327580-e346-4424-bb30-156c284120de-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.956569 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.956465    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.956569 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.956491    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.956569 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.956562    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.956893 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.956585    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.956893 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.956631    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2327580-e346-4424-bb30-156c284120de-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.956893 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.956819    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.957045 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.956969    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.957045 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.957017    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.957133 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.957050    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.957358 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.957331    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2327580-e346-4424-bb30-156c284120de-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.958849 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.958827    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:07.959156 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:07.959137    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2327580-e346-4424-bb30-156c284120de-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:08.014980 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:08.014950    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:08.015437 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:08.015413    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqcbz\" (UniqueName: \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-kube-api-access-xqcbz\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:08.062048 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:08.062010    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:08.480766 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:08.480696    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"]
Nov 04 01:32:08.483680 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:32:08.483649    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2327580_e346_4424_bb30_156c284120de.slice/crio-5274ed4e49f8ba3a1109bec0186f61173f929450b914105f3964635eb28090ce WatchSource:0}: Error finding container 5274ed4e49f8ba3a1109bec0186f61173f929450b914105f3964635eb28090ce: Status 404 returned error can't find the container with id 5274ed4e49f8ba3a1109bec0186f61173f929450b914105f3964635eb28090ce
Nov 04 01:32:08.486189 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:08.486158    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:32:08.486269 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:08.486222    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:32:08.486269 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:08.486251    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:32:08.508148 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:08.508124    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:09.139748 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:09.139711    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" event={"ID":"e2327580-e346-4424-bb30-156c284120de","Type":"ContainerStarted","Data":"970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b"}
Nov 04 01:32:09.140131 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:09.139782    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" event={"ID":"e2327580-e346-4424-bb30-156c284120de","Type":"ContainerStarted","Data":"5274ed4e49f8ba3a1109bec0186f61173f929450b914105f3964635eb28090ce"}
Nov 04 01:32:09.300280 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:09.300227    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" podStartSLOduration=2.300211142 podStartE2EDuration="2.300211142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:32:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:32:09.299151092 +0000 UTC m=+1260.449358854" watchObservedRunningTime="2026-11-04 01:32:09.300211142 +0000 UTC m=+1260.450418901"
Nov 04 01:32:10.068558 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:10.064077    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:10.068558 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:10.064233    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 01:32:10.068558 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:10.064278    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" podUID="e2327580-e346-4424-bb30-156c284120de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 01:32:11.069385 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:11.068927    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 01:32:11.069385 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:11.068993    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" podUID="e2327580-e346-4424-bb30-156c284120de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 01:32:11.665169 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:11.665072    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:12.070714 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:12.070674    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 01:32:12.071163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:12.070737    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" podUID="e2327580-e346-4424-bb30-156c284120de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 01:32:13.067557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:13.066942    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 01:32:13.067557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:13.067007    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" podUID="e2327580-e346-4424-bb30-156c284120de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 01:32:13.199721 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:32:13.199684    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:32:14.064181 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:14.064147    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 01:32:14.064461 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:14.064435    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" podUID="e2327580-e346-4424-bb30-156c284120de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 01:32:15.062865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:15.062828    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Nov 04 01:32:15.063338 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:15.062900    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" podUID="e2327580-e346-4424-bb30-156c284120de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Nov 04 01:32:15.201245 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:15.201204    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:15.215292 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:15.215260    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:16.066652 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:16.066621    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:16.067137 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:16.066929    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:16.067588 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:16.067572    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:32:16.212711 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:16.212685    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:32:16.804841 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:16.804807    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:21.915055 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:21.914980    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:26.997967 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:26.997932    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:28.144240 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:28.144207    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:32.115594 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:32.115521    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:37.222949 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:37.222908    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:40.856322 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:40.856288    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:41.175669 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.175596    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"]
Nov 04 01:32:41.179621 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.179598    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.221492 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.221458    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-token\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.221665 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.221529    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-data\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.221722 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.221651    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76drw\" (UniqueName: \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-kube-api-access-76drw\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.221761 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.221723    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-envoy\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.221803 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.221779    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-certs\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.221884 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.221864    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-podinfo\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.221922 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.221903    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.221965 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.221920    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-credential-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.222011 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.221999    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istiod-ca-cert\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.232761 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.232738    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-00cfe6-openshift-default-dockercfg-5jwvp\""
Nov 04 01:32:41.289876 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.285503    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"]
Nov 04 01:32:41.322987 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.322955    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-token\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323174 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323019    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-data\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323174 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323050    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76drw\" (UniqueName: \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-kube-api-access-76drw\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323174 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323069    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-envoy\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323174 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323101    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-certs\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323174 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323132    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-podinfo\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323174 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323168    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323451 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323191    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-credential-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323451 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323229    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istiod-ca-cert\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323585 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323516    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-data\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323724 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323703    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-certs\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323821 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323799    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-credential-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.323867 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.323811    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-socket\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.324058 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.324041    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istiod-ca-cert\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.325992 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.325969    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-envoy\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.326163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.326144    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-podinfo\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.380792 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.380760    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-token\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.380932 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.380881    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76drw\" (UniqueName: \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-kube-api-access-76drw\") pod \"e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") " pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.492427 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.492395    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:41.916274 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.916250    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"]
Nov 04 01:32:41.918422 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:32:41.918393    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3498f8b8_d8ff_4c3c_a22e_2f7b66d925bc.slice/crio-5c8dc69eb799b658769193631bf0ea0b0aff34211628d514724f3345d7dfdda3 WatchSource:0}: Error finding container 5c8dc69eb799b658769193631bf0ea0b0aff34211628d514724f3345d7dfdda3: Status 404 returned error can't find the container with id 5c8dc69eb799b658769193631bf0ea0b0aff34211628d514724f3345d7dfdda3
Nov 04 01:32:41.920855 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.920822    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:32:41.920940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.920891    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:32:41.920940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:41.920923    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:32:42.338274 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:42.338211    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:42.364803 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:42.364764    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" event={"ID":"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc","Type":"ContainerStarted","Data":"7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40"}
Nov 04 01:32:42.364955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:42.364827    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" event={"ID":"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc","Type":"ContainerStarted","Data":"5c8dc69eb799b658769193631bf0ea0b0aff34211628d514724f3345d7dfdda3"}
Nov 04 01:32:42.492984 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:42.492954    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:42.494982 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:42.494949    5572 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 01:32:42.495182 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:42.494995    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 01:32:42.533263 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:42.533178    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" podStartSLOduration=1.53315431 podStartE2EDuration="1.53315431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:32:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:32:42.48339927 +0000 UTC m=+1293.633607028" watchObservedRunningTime="2026-11-04 01:32:42.53315431 +0000 UTC m=+1293.683362093"
Nov 04 01:32:42.824574 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:42.824525    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:43.038371 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:43.038338    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:43.215156 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:32:43.215121    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:32:43.282015 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:43.281911    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:43.493345 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:43.493265    5572 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 01:32:43.493345 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:43.493315    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 01:32:44.493152 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:44.493121    5572 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 01:32:44.493578 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:44.493172    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 01:32:45.492980 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:45.492947    5572 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 01:32:45.493156 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:45.493011    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 01:32:46.493178 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:46.493139    5572 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 01:32:46.493651 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:46.493213    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 01:32:47.492773 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:47.492736    5572 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 01:32:47.492992 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:47.492803    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 01:32:48.031649 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:48.031605    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:48.492811 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:48.492781    5572 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 01:32:48.492980 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:48.492845    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 01:32:49.497195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:49.497165    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:49.497620 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:49.497523    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:49.498165 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:49.498146    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:32:53.091912 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:53.091878    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:56.174285 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:56.174224    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:56.317955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:56.317917    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:58.706552 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:58.706507    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:59.019112 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:59.019008    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:32:59.197756 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:32:59.197713    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:00.450651 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:00.450602    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:00.593844 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:00.593807    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:03.897499 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:03.897458    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:05.831248 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:05.831208    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:08.990290 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:08.990248    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:10.799178 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:10.799141    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:11.425069 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:11.425005    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:11.616015 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:11.615983    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:11.719000 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:11.718949    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"]
Nov 04 01:33:11.719253 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:11.719215    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" containerName="istio-proxy" containerID="cri-o://7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa" gracePeriod=30
Nov 04 01:33:12.999726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:12.999691    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:13.200194 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:33:13.200150    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:33:14.137485 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:14.137449    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:15.482606 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:15.482568    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:15.681262 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:15.681228    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:15.827277 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:15.827193    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:16.980525 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:16.980494    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:33:17.015891 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.015815    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-envoy\") pod \"809c9398-9db6-4f27-831f-282e3e7d4616\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") "
Nov 04 01:33:17.015891 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.015864    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-credential-socket\") pod \"809c9398-9db6-4f27-831f-282e3e7d4616\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") "
Nov 04 01:33:17.015891 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.015886    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-socket\") pod \"809c9398-9db6-4f27-831f-282e3e7d4616\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") "
Nov 04 01:33:17.016184 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.015905    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-data\") pod \"809c9398-9db6-4f27-831f-282e3e7d4616\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") "
Nov 04 01:33:17.016184 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.015939    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-certs\") pod \"809c9398-9db6-4f27-831f-282e3e7d4616\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") "
Nov 04 01:33:17.016184 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.015976    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/809c9398-9db6-4f27-831f-282e3e7d4616-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/809c9398-9db6-4f27-831f-282e3e7d4616-istio-podinfo\") pod \"809c9398-9db6-4f27-831f-282e3e7d4616\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") "
Nov 04 01:33:17.016184 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016017    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-kube-api-access-l7nx5\" (UniqueName: \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-kube-api-access-l7nx5\") pod \"809c9398-9db6-4f27-831f-282e3e7d4616\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") "
Nov 04 01:33:17.016184 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016053    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/809c9398-9db6-4f27-831f-282e3e7d4616-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/809c9398-9db6-4f27-831f-282e3e7d4616-istiod-ca-cert\") pod \"809c9398-9db6-4f27-831f-282e3e7d4616\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") "
Nov 04 01:33:17.016184 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016088    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-istio-token\" (UniqueName: \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-istio-token\") pod \"809c9398-9db6-4f27-831f-282e3e7d4616\" (UID: \"809c9398-9db6-4f27-831f-282e3e7d4616\") "
Nov 04 01:33:17.016184 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016157    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-socket" pod "809c9398-9db6-4f27-831f-282e3e7d4616" (UID: "809c9398-9db6-4f27-831f-282e3e7d4616"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:33:17.016648 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016239    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-credential-socket" pod "809c9398-9db6-4f27-831f-282e3e7d4616" (UID: "809c9398-9db6-4f27-831f-282e3e7d4616"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:33:17.016648 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016334    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-certs" pod "809c9398-9db6-4f27-831f-282e3e7d4616" (UID: "809c9398-9db6-4f27-831f-282e3e7d4616"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:33:17.016648 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016349    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-data" pod "809c9398-9db6-4f27-831f-282e3e7d4616" (UID: "809c9398-9db6-4f27-831f-282e3e7d4616"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:33:17.016803 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016698    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:33:17.016803 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016720    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:33:17.016803 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016734    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:33:17.016803 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016748    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:33:17.017018 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.016807    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/809c9398-9db6-4f27-831f-282e3e7d4616-istiod-ca-cert" pod "809c9398-9db6-4f27-831f-282e3e7d4616" (UID: "809c9398-9db6-4f27-831f-282e3e7d4616"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:33:17.018290 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.018265    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-envoy" pod "809c9398-9db6-4f27-831f-282e3e7d4616" (UID: "809c9398-9db6-4f27-831f-282e3e7d4616"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:33:17.018408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.018382    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-kube-api-access-l7nx5" pod "809c9398-9db6-4f27-831f-282e3e7d4616" (UID: "809c9398-9db6-4f27-831f-282e3e7d4616"). InnerVolumeSpecName "kube-api-access-l7nx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:33:17.018685 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.018669    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/809c9398-9db6-4f27-831f-282e3e7d4616-istio-podinfo" pod "809c9398-9db6-4f27-831f-282e3e7d4616" (UID: "809c9398-9db6-4f27-831f-282e3e7d4616"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:33:17.018801 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.018780    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-istio-token" pod "809c9398-9db6-4f27-831f-282e3e7d4616" (UID: "809c9398-9db6-4f27-831f-282e3e7d4616"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:33:17.118258 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.118215    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/809c9398-9db6-4f27-831f-282e3e7d4616-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:33:17.118258 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.118258    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7nx5\" (UniqueName: \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-kube-api-access-l7nx5\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:33:17.118479 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.118274    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/809c9398-9db6-4f27-831f-282e3e7d4616-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:33:17.118479 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.118289    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/809c9398-9db6-4f27-831f-282e3e7d4616-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:33:17.118479 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.118303    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/809c9398-9db6-4f27-831f-282e3e7d4616-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:33:17.581303 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.581271    5572 generic.go:356] "Generic (PLEG): container finished" podID="809c9398-9db6-4f27-831f-282e3e7d4616" containerID="7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa" exitCode=0
Nov 04 01:33:17.581511 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.581322    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"
Nov 04 01:33:17.581511 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.581367    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" event={"ID":"809c9398-9db6-4f27-831f-282e3e7d4616","Type":"ContainerDied","Data":"7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa"}
Nov 04 01:33:17.581511 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.581417    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld" event={"ID":"809c9398-9db6-4f27-831f-282e3e7d4616","Type":"ContainerDied","Data":"77e21c4df8834d06b811b8514aa6b492972b2f1b452a7792ba73231c31fea314"}
Nov 04 01:33:17.581511 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.581438    5572 scope.go:122] "RemoveContainer" containerID="7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa"
Nov 04 01:33:17.592495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.592473    5572 scope.go:122] "RemoveContainer" containerID="7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa"
Nov 04 01:33:17.592792 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:33:17.592774    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa\": container with ID starting with 7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa not found: ID does not exist" containerID="7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa"
Nov 04 01:33:17.592857 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.592802    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa"} err="failed to get container status \"7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa\": rpc error: code = NotFound desc = could not find container \"7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa\": container with ID starting with 7d07e00d32ed53f0b9f7b74688b2b0289c1ebcebe5693bb7e7365911a79204aa not found: ID does not exist"
Nov 04 01:33:17.736290 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.736258    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"]
Nov 04 01:33:17.740958 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:17.740926    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-m7jld"]
Nov 04 01:33:18.790349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:18.790311    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:18.960982 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:18.960949    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:18.972213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:18.972185    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" path="/var/lib/kubelet/pods/809c9398-9db6-4f27-831f-282e3e7d4616/volumes"
Nov 04 01:33:19.108258 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:19.108172    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:19.737415 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:19.737384    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:24.889941 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:24.889898    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:29.897042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:29.896988    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:34.623818 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.623781    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"]
Nov 04 01:33:34.624299 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.624285    5572 cpu_manager.go:414] "containerMap: removing container" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" containerName="istio-proxy"
Nov 04 01:33:34.624299 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.624299    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" containerName="istio-proxy"
Nov 04 01:33:34.624433 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.624412    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="809c9398-9db6-4f27-831f-282e3e7d4616" containerName="istio-proxy"
Nov 04 01:33:34.627797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.627777    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:34.676420 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.676386    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-cae0ab-serving-cert\""
Nov 04 01:33:34.705809 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.705772    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsw7k\" (UniqueName: \"kubernetes.io/projected/22838154-4a76-49f3-8d58-d2410f636389-kube-api-access-zsw7k\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:34.705809 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.705812    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22838154-4a76-49f3-8d58-d2410f636389-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:34.706058 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.705832    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-metrics-certs\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:34.706058 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.706022    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-maas-api-tls\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:34.724846 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.724818    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"]
Nov 04 01:33:34.807151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.807106    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-maas-api-tls\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:34.807350 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:33:34.807271    5572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-serving-cert: secret "maas-api-e2e-extmod-b-cae0ab-serving-cert" not found
Nov 04 01:33:34.807350 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.807282    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsw7k\" (UniqueName: \"kubernetes.io/projected/22838154-4a76-49f3-8d58-d2410f636389-kube-api-access-zsw7k\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:34.807350 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.807318    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22838154-4a76-49f3-8d58-d2410f636389-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:34.807350 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:33:34.807342    5572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-maas-api-tls podName:22838154-4a76-49f3-8d58-d2410f636389 nodeName:}" failed. No retries permitted until 2026-11-04 01:33:35.307322354 +0000 UTC m=+1346.457530105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-maas-api-tls") pod "maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl" (UID: "22838154-4a76-49f3-8d58-d2410f636389") : secret "maas-api-e2e-extmod-b-cae0ab-serving-cert" not found
Nov 04 01:33:34.807606 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.807377    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-metrics-certs\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:34.808078 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.808053    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22838154-4a76-49f3-8d58-d2410f636389-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:34.809939 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.809916    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-metrics-certs\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:34.837229 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.837198    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:34.867085 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:34.867058    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsw7k\" (UniqueName: \"kubernetes.io/projected/22838154-4a76-49f3-8d58-d2410f636389-kube-api-access-zsw7k\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:35.005348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:35.005302    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:35.151157 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:35.151111    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:35.314243 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:35.314153    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-maas-api-tls\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:35.316824 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:35.316796    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-maas-api-tls\") pod \"maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:35.543602 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:35.543574    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:35.913806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:35.913782    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"]
Nov 04 01:33:35.916698 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:33:35.916671    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22838154_4a76_49f3_8d58_d2410f636389.slice/crio-c61205d353a39b3bde2ba588f25d677986196d04b95fa2252888515a95101117 WatchSource:0}: Error finding container c61205d353a39b3bde2ba588f25d677986196d04b95fa2252888515a95101117: Status 404 returned error can't find the container with id c61205d353a39b3bde2ba588f25d677986196d04b95fa2252888515a95101117
Nov 04 01:33:36.698588 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:36.698518    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl" event={"ID":"22838154-4a76-49f3-8d58-d2410f636389","Type":"ContainerStarted","Data":"c61205d353a39b3bde2ba588f25d677986196d04b95fa2252888515a95101117"}
Nov 04 01:33:37.705820 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:37.705784    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl" event={"ID":"22838154-4a76-49f3-8d58-d2410f636389","Type":"ContainerStarted","Data":"e57f4e4eac61cf323df1fe26ae33c9259d94532f829895bc71b3149f890d4eb7"}
Nov 04 01:33:37.706231 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:37.705858    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:37.790861 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:37.790823    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:37.817909 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:37.817857    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl" podStartSLOduration=2.877174306 podStartE2EDuration="3.817843002s" totalImagesPullingTime="940.668696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:33:37.816818402 +0000 UTC m=+1348.967026162" watchObservedRunningTime="2026-11-04 01:33:37.817843002 +0000 UTC m=+1348.968050760"
Nov 04 01:33:38.477020 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:38.476982    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:38.699745 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:38.699679    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:40.107112 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:40.107083    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:42.753886 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:42.753850    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:42.941326 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:42.941288    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:43.092124 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:43.092035    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:43.198985 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:33:43.198952    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:33:43.717230 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:43.717194    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:33:45.441969 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:45.441933    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:48.427296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:48.427205    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:48.576857 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:48.576822    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:48.724021 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:48.723967    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:50.286702 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:50.286661    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:50.701436 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:50.701406    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:50.844791 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:50.844751    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:50.988250 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:50.988163    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:51.132635 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:51.132595    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:55.428813 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.428772    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"]
Nov 04 01:33:55.433224 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.433196    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.469661 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.469631    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:55.481628 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.481603    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-a-6db2a7-serving-cert\""
Nov 04 01:33:55.530153 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.530116    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"]
Nov 04 01:33:55.532508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.532480    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"]
Nov 04 01:33:55.536502 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.536483    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.539147 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.539118    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/544688fe-ab53-412e-8c38-e7c38dfd60b9-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.539221 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.539164    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtdbs\" (UniqueName: \"kubernetes.io/projected/544688fe-ab53-412e-8c38-e7c38dfd60b9-kube-api-access-gtdbs\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.539294 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.539277    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-maas-api-tls\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.539439 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.539421    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-metrics-certs\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.605347 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.605313    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"]
Nov 04 01:33:55.639570 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.639457    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:55.640072 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640036    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.640213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640093    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.640213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640129    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-metrics-certs\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.640213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640160    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.640213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640206    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.640434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640255    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.640434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640285    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.640434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640329    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/544688fe-ab53-412e-8c38-e7c38dfd60b9-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.640434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640352    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtdbs\" (UniqueName: \"kubernetes.io/projected/544688fe-ab53-412e-8c38-e7c38dfd60b9-kube-api-access-gtdbs\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.640434 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640413    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.640715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640624    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-maas-api-tls\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.640715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640684    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.640820 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.640717    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nw4m\" (UniqueName: \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-kube-api-access-6nw4m\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.640935 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:33:55.640914    5572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-serving-cert: secret "maas-api-e2e-extmod-a-6db2a7-serving-cert" not found
Nov 04 01:33:55.641020 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:33:55.640982    5572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-maas-api-tls podName:544688fe-ab53-412e-8c38-e7c38dfd60b9 nodeName:}" failed. No retries permitted until 2026-11-04 01:33:56.140961961 +0000 UTC m=+1367.291169704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-maas-api-tls") pod "maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t" (UID: "544688fe-ab53-412e-8c38-e7c38dfd60b9") : secret "maas-api-e2e-extmod-a-6db2a7-serving-cert" not found
Nov 04 01:33:55.642263 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.642236    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/544688fe-ab53-412e-8c38-e7c38dfd60b9-openshift-service-ca\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.643064 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.643034    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-metrics-certs\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.699826 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.699796    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtdbs\" (UniqueName: \"kubernetes.io/projected/544688fe-ab53-412e-8c38-e7c38dfd60b9-kube-api-access-gtdbs\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:55.741775 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.741740    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.741791    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.741832    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.741862    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.741895    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.741922    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.742002    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.742068    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.742092    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nw4m\" (UniqueName: \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-kube-api-access-6nw4m\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.742225    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-certs\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.742263    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.742335    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-data\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.742383    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-credential-socket\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.742654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.742651    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istiod-ca-cert\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.744589 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.744564    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-envoy\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.744962 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.744940    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-podinfo\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.799849 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.799815    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nw4m\" (UniqueName: \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-kube-api-access-6nw4m\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.799996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.799816    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-token\") pod \"e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") " pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.804947 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.804919    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:55.850753 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.850717    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:55.952317 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:55.952245    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:56.145755 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.145718    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-maas-api-tls\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:56.153765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.149143    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-maas-api-tls\") pod \"maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:56.271055 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.271030    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"]
Nov 04 01:33:56.273744 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:33:56.273714    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0152d2_ed01_4c4e_87a6_8d8aae72cffc.slice/crio-d398ee7b4357e2503ca27c2a9602a9c3cb92a15a8c5cffd04b41357c855e19a0 WatchSource:0}: Error finding container d398ee7b4357e2503ca27c2a9602a9c3cb92a15a8c5cffd04b41357c855e19a0: Status 404 returned error can't find the container with id d398ee7b4357e2503ca27c2a9602a9c3cb92a15a8c5cffd04b41357c855e19a0
Nov 04 01:33:56.276261 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.276228    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:33:56.276338 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.276294    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:33:56.276338 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.276321    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:33:56.346808 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.346780    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:56.721902 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.721875    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"]
Nov 04 01:33:56.724494 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:33:56.724466    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod544688fe_ab53_412e_8c38_e7c38dfd60b9.slice/crio-56ba4df176ed19ea9f683054c915eddcd4eca1f8b372f59131c38e64acd2d1c7 WatchSource:0}: Error finding container 56ba4df176ed19ea9f683054c915eddcd4eca1f8b372f59131c38e64acd2d1c7: Status 404 returned error can't find the container with id 56ba4df176ed19ea9f683054c915eddcd4eca1f8b372f59131c38e64acd2d1c7
Nov 04 01:33:56.821781 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.821744    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t" event={"ID":"544688fe-ab53-412e-8c38-e7c38dfd60b9","Type":"ContainerStarted","Data":"56ba4df176ed19ea9f683054c915eddcd4eca1f8b372f59131c38e64acd2d1c7"}
Nov 04 01:33:56.823453 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.823424    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" event={"ID":"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc","Type":"ContainerStarted","Data":"8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e"}
Nov 04 01:33:56.823602 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.823471    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" event={"ID":"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc","Type":"ContainerStarted","Data":"d398ee7b4357e2503ca27c2a9602a9c3cb92a15a8c5cffd04b41357c855e19a0"}
Nov 04 01:33:56.860558 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.852658    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:33:56.938377 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:56.938313    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" podStartSLOduration=1.938293509 podStartE2EDuration="1.938293509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:33:56.935403189 +0000 UTC m=+1368.085610949" watchObservedRunningTime="2026-11-04 01:33:56.938293509 +0000 UTC m=+1368.088501284"
Nov 04 01:33:57.864939 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:57.864822    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 04 01:33:57.864939 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:57.864878    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" podUID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 04 01:33:58.838676 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:58.838641    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t" event={"ID":"544688fe-ab53-412e-8c38-e7c38dfd60b9","Type":"ContainerStarted","Data":"60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17"}
Nov 04 01:33:58.839050 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:58.839027    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:33:58.871004 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:58.870962    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 04 01:33:58.871377 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:58.871045    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" podUID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 04 01:33:58.959473 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:58.956757    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t" podStartSLOduration=2.918123393 podStartE2EDuration="3.956736447s" totalImagesPullingTime="1.038613054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:33:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:33:58.953936721 +0000 UTC m=+1370.104144481" watchObservedRunningTime="2026-11-04 01:33:58.956736447 +0000 UTC m=+1370.106944208"
Nov 04 01:33:59.784078 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:59.784036    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:33:59.852583 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:59.851888    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 04 01:33:59.852583 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:33:59.851975    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" podUID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 04 01:34:00.834862 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:00.834827    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:00.867979 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:00.867939    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 04 01:34:00.868260 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:00.868234    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" podUID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 04 01:34:00.981755 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:00.981709    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:01.862563 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:01.861912    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 04 01:34:01.862563 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:01.861976    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" podUID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 04 01:34:02.851198 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:02.851159    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 04 01:34:02.851402 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:02.851215    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" podUID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 04 01:34:03.856015 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:03.855983    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:34:03.856416 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:03.856396    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:34:03.857270 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:03.857248    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:34:04.851284 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:04.851257    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:34:06.118380 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:06.118346    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:11.104647 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:11.104612    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:13.199415 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:34:13.199376    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:34:16.226953 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:16.226921    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:21.290775 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:21.290718    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:26.380449 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:26.380415    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:27.461291 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:27.461250    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:28.696362 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:28.696322    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:28.847949 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:28.847912    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:28.996228 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:28.996125    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:29.307708 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:29.307633    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:29.455748 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:29.455710    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:29.608329 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:29.608243    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:30.350513 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:30.350472    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:30.494092 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:30.494031    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:31.932422 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:31.932389    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:32.146465 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:32.146425    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:32.291430 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:32.291398    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:36.448130 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:36.448094    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:37.217294 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:37.217259    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:42.302786 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.302734    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:42.446033 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.446001    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"]
Nov 04 01:34:42.450443 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.450421    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.499498 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.499465    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kcfvk\""
Nov 04 01:34:42.564113 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.564033    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a176b23d-38c8-4048-98ec-9bcdef3e4215-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.564113 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.564066    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d659w\" (UniqueName: \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-kube-api-access-d659w\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.564422 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.564155    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.564422 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.564244    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.564422 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.564361    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.564422 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.564392    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.564611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.564466    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.564611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.564495    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.564676 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.564623    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.665980 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.665944    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.665980 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.665980    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.666253 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666009    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.666253 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666035    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.666253 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666105    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.666253 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666160    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a176b23d-38c8-4048-98ec-9bcdef3e4215-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.666253 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666185    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d659w\" (UniqueName: \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-kube-api-access-d659w\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.666253 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666245    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.666595 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666287    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.666595 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666448    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.666719 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666695    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.666781 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666748    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.666968 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666949    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.667037 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.666948    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a176b23d-38c8-4048-98ec-9bcdef3e4215-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.668513 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.668491    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.668619 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.668604    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.679146 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.679122    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"]
Nov 04 01:34:42.724136 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.724107    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.724338 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.724316    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d659w\" (UniqueName: \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-kube-api-access-d659w\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-98jdc\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:42.764108 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:42.764076    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:43.184167 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:43.184097    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"]
Nov 04 01:34:43.188849 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:34:43.188818    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda176b23d_38c8_4048_98ec_9bcdef3e4215.slice/crio-7d59d5a71ca7492adf5a66635c50cb8ab2d604442ae3a005adb66115567f8b9c WatchSource:0}: Error finding container 7d59d5a71ca7492adf5a66635c50cb8ab2d604442ae3a005adb66115567f8b9c: Status 404 returned error can't find the container with id 7d59d5a71ca7492adf5a66635c50cb8ab2d604442ae3a005adb66115567f8b9c
Nov 04 01:34:43.191685 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:43.191652    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:34:43.191775 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:43.191718    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:34:43.191775 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:43.191746    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:34:43.203646 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:34:43.203617    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:34:44.136321 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:44.136278    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" event={"ID":"a176b23d-38c8-4048-98ec-9bcdef3e4215","Type":"ContainerStarted","Data":"a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5"}
Nov 04 01:34:44.136734 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:44.136344    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" event={"ID":"a176b23d-38c8-4048-98ec-9bcdef3e4215","Type":"ContainerStarted","Data":"7d59d5a71ca7492adf5a66635c50cb8ab2d604442ae3a005adb66115567f8b9c"}
Nov 04 01:34:44.293280 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:44.293211    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" podStartSLOduration=2.293196818 podStartE2EDuration="2.293196818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:34:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:34:44.292272576 +0000 UTC m=+1415.442480333" watchObservedRunningTime="2026-11-04 01:34:44.293196818 +0000 UTC m=+1415.443404576"
Nov 04 01:34:44.769558 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:44.768600    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:44.769558 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:44.768732    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-98jdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 01:34:44.769558 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:44.768790    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 01:34:45.767011 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:45.766969    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-98jdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 01:34:45.767644 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:45.767611    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 01:34:46.770559 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:46.765856    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-98jdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 01:34:46.770559 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:46.765940    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 01:34:47.369596 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:47.368503    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:47.764952 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:47.764911    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-98jdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 01:34:47.765198 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:47.765171    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 01:34:48.765951 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:48.765912    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-98jdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 01:34:48.766597 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:48.766564    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 01:34:49.765210 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:49.765171    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-98jdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 01:34:49.765383 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:49.765248    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 01:34:50.764893 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:50.764854    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-98jdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 04 01:34:50.765286 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:50.764918    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 04 01:34:52.071095 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:52.070925    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:52.071824 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:52.071760    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:52.072775 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:52.072747    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:34:52.434412 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:52.434310    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:55.824217 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:55.824177    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:34:57.793759 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:34:57.793686    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:00.640227 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:00.640191    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:01.193576 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:01.193544    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:02.879254 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:02.879209    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:07.456177 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:07.456121    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:07.918799 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:07.918693    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:08.962092 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:08.962017    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:10.025565 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.025518    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"]
Nov 04 01:35:10.029689 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.029669    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.078682 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.078656    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-d057d7-openshift-default-dockercfg-zclt9\""
Nov 04 01:35:10.121265 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.121235    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:10.127067 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.127039    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"]
Nov 04 01:35:10.178823 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.178787    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-envoy\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.179019 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.178838    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96739365-8b06-4d74-b82b-db47e3de3f3c-istiod-ca-cert\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.179019 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.178871    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-credential-socket\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.179113 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.179016    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-certs\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.179152 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.179130    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5fdn\" (UniqueName: \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-kube-api-access-w5fdn\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.179196 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.179166    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-data\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.179234 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.179197    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-token\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.179277 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.179235    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-socket\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.179353 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.179332    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-podinfo\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.280435 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.280325    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-certs\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.280681 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.280441    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5fdn\" (UniqueName: \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-kube-api-access-w5fdn\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.280681 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.280479    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-data\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.280681 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.280507    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-token\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.280681 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.280570    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-socket\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.280681 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.280675    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-podinfo\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.280949 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.280735    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-envoy\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.280949 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.280772    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96739365-8b06-4d74-b82b-db47e3de3f3c-istiod-ca-cert\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.280949 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.280804    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-credential-socket\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.280949 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.280906    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-certs\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.281102 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.280956    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-data\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.281102 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.281000    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-socket\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.281193 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.281115    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-credential-socket\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.281524 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.281497    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96739365-8b06-4d74-b82b-db47e3de3f3c-istiod-ca-cert\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.283739 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.283718    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-envoy\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.284074 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.284053    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-podinfo\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.337995 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.337962    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-token\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.338298 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.338276    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5fdn\" (UniqueName: \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-kube-api-access-w5fdn\") pod \"e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") " pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.343968 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.343946    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:10.346462 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.346416    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:10.770636 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.770612    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"]
Nov 04 01:35:10.772703 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:35:10.772667    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96739365_8b06_4d74_b82b_db47e3de3f3c.slice/crio-11a0c38de56511110183c84d1d30529cc0ae02092a46f44365c24977b5ce280b WatchSource:0}: Error finding container 11a0c38de56511110183c84d1d30529cc0ae02092a46f44365c24977b5ce280b: Status 404 returned error can't find the container with id 11a0c38de56511110183c84d1d30529cc0ae02092a46f44365c24977b5ce280b
Nov 04 01:35:10.775250 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.775220    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:35:10.775337 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.775282    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:35:10.775337 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:10.775313    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:35:11.328100 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:11.328065    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" event={"ID":"96739365-8b06-4d74-b82b-db47e3de3f3c","Type":"ContainerStarted","Data":"5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0"}
Nov 04 01:35:11.328545 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:11.328116    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" event={"ID":"96739365-8b06-4d74-b82b-db47e3de3f3c","Type":"ContainerStarted","Data":"11a0c38de56511110183c84d1d30529cc0ae02092a46f44365c24977b5ce280b"}
Nov 04 01:35:11.344120 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:11.344090    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:11.349599 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:11.349574    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:11.443119 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:11.443065    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" podStartSLOduration=2.443051579 podStartE2EDuration="2.443051579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:11.440950576 +0000 UTC m=+1442.591158334" watchObservedRunningTime="2026-11-04 01:35:11.443051579 +0000 UTC m=+1442.593259337"
Nov 04 01:35:12.334445 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:12.334415    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:12.335287 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:12.335266    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:35:13.053496 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:13.053455    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:13.199071 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:35:13.199037    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:35:14.277435 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:14.277405    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:14.422517 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:14.422484    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:14.587246 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:14.587166    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:14.745159 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:14.745122    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:16.758494 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:16.758454    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:16.952746 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:16.952702    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:17.679018 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:17.678987    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:17.856545 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:17.856489    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:18.788480 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:18.788366    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:23.789108 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:23.789069    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:28.783093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:28.783054    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:30.059342 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:30.059305    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:34.169360 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:34.169325    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:39.206429 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:39.206384    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:41.472049 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:41.472012    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:42.121412 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:42.121372    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:42.597408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:42.597348    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:42.893881 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:42.893793    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"]
Nov 04 01:35:42.898328 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:42.898306    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:42.993052 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:42.993020    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"]
Nov 04 01:35:43.049139 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.049104    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.049139 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.049139    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.049376 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.049230    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7b8b30e-582c-4fe9-a096-022b7305e123-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.049376 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.049349    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.049376 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.049370    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lztt2\" (UniqueName: \"kubernetes.io/projected/c7b8b30e-582c-4fe9-a096-022b7305e123-kube-api-access-lztt2\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.049513 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.049500    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.049589 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.049559    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.049677 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.049659    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.049839 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.049821    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.150760 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.150670    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.150760 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.150750    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.150998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.150767    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.150998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.150796    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7b8b30e-582c-4fe9-a096-022b7305e123-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.150998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.150840    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.150998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.150869    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lztt2\" (UniqueName: \"kubernetes.io/projected/c7b8b30e-582c-4fe9-a096-022b7305e123-kube-api-access-lztt2\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.150998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.150975    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.151279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.151015    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.151279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.151070    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.151279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.151183    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.151279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.151228    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.151505 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.151394    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.151505 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.151442    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.151673 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.151652    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7b8b30e-582c-4fe9-a096-022b7305e123-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.153168 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.153144    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.153285 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.153268    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.199891 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:35:43.199853    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:35:43.208365 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.208331    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7b8b30e-582c-4fe9-a096-022b7305e123-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.208489 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.208405    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lztt2\" (UniqueName: \"kubernetes.io/projected/c7b8b30e-582c-4fe9-a096-022b7305e123-kube-api-access-lztt2\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-fn6tt\" (UID: \"c7b8b30e-582c-4fe9-a096-022b7305e123\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.215299 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.215279    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:43.636915 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.636662    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"]
Nov 04 01:35:43.639733 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:35:43.639705    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b8b30e_582c_4fe9_a096_022b7305e123.slice/crio-62cc0699b5c2072e9d8b7403d2cfadc386ba3f866c20ad70ecb0a3b82e5f4bc0 WatchSource:0}: Error finding container 62cc0699b5c2072e9d8b7403d2cfadc386ba3f866c20ad70ecb0a3b82e5f4bc0: Status 404 returned error can't find the container with id 62cc0699b5c2072e9d8b7403d2cfadc386ba3f866c20ad70ecb0a3b82e5f4bc0
Nov 04 01:35:43.642694 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.642657    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:35:43.642803 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.642748    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:35:43.642803 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.642796    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:35:43.958754 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:43.958717    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:44.103376 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:44.103339    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:44.395671 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:44.395584    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:44.526136 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:44.526092    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt" event={"ID":"c7b8b30e-582c-4fe9-a096-022b7305e123","Type":"ContainerStarted","Data":"920c32061a2af984903ca8ba7fab1267078235ba6372ce08b79d31b925215896"}
Nov 04 01:35:44.526325 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:44.526153    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt" event={"ID":"c7b8b30e-582c-4fe9-a096-022b7305e123","Type":"ContainerStarted","Data":"62cc0699b5c2072e9d8b7403d2cfadc386ba3f866c20ad70ecb0a3b82e5f4bc0"}
Nov 04 01:35:44.640263 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:44.640205    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt" podStartSLOduration=2.640189528 podStartE2EDuration="2.640189528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:44.638050468 +0000 UTC m=+1475.788258228" watchObservedRunningTime="2026-11-04 01:35:44.640189528 +0000 UTC m=+1475.790397286"
Nov 04 01:35:45.216355 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:45.216290    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:45.217723 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:45.217694    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 01:35:45.217844 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:45.217740    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt" podUID="c7b8b30e-582c-4fe9-a096-022b7305e123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 01:35:45.821904 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:45.821863    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:46.216165 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:46.216129    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 01:35:46.216346 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:46.216191    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt" podUID="c7b8b30e-582c-4fe9-a096-022b7305e123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 01:35:46.319078 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:46.319041    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:46.502571 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:46.502441    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:46.671774 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:46.671732    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:47.215913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:47.215882    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 01:35:47.216459 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:47.215942    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt" podUID="c7b8b30e-582c-4fe9-a096-022b7305e123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 01:35:48.216511 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:48.216472    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 01:35:48.217034 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:48.216556    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt" podUID="c7b8b30e-582c-4fe9-a096-022b7305e123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 01:35:49.215859 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:49.215821    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 01:35:49.216040 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:49.215877    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt" podUID="c7b8b30e-582c-4fe9-a096-022b7305e123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 01:35:50.007865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:50.007831    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:50.216113 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:50.216076    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 01:35:50.216295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:50.216134    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt" podUID="c7b8b30e-582c-4fe9-a096-022b7305e123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 01:35:50.875240 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:50.875207    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:51.216178 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:51.216139    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 01:35:51.216611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:51.216223    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt" podUID="c7b8b30e-582c-4fe9-a096-022b7305e123" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 01:35:52.585309 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:52.585273    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:52.585792 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:52.585613    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:52.587359 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:52.587334    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-fn6tt"
Nov 04 01:35:53.603710 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:53.603647    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:53.776042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:53.776007    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:55.015560 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:55.014774    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:56.194321 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:56.194284    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:57.187157 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:57.187120    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:57.656203 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:57.656143    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:57.909607 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:57.909259    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:58.053947 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.053914    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"]
Nov 04 01:35:58.059468 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.059429    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.129911 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.129879    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.129911 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.129913    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51640a89-0c3e-46c8-8ba4-47903cafa26f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.130120 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.129944    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.130120 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.130045    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.130120 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.130069    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.130212 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.130142    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.130212 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.130186    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pghm4\" (UniqueName: \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-kube-api-access-pghm4\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.130279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.130250    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.130338 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.130326    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.231732 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.231695    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pghm4\" (UniqueName: \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-kube-api-access-pghm4\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.231732 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.231734    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.231986 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.231820    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.231986 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.231869    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.231986 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.231891    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51640a89-0c3e-46c8-8ba4-47903cafa26f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.231986 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.231936    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.231986 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.231983    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.232239 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.232011    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.232239 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.232089    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.232345 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.232319    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.232403 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.232361    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-data\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.232634 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.232612    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-credential-socket\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.232820 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.232798    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-certs\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.233104 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.233081    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51640a89-0c3e-46c8-8ba4-47903cafa26f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.234739 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.234683    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.234929 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.234910    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.316896 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.316859    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pghm4\" (UniqueName: \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-kube-api-access-pghm4\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.321377 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.320705    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"]
Nov 04 01:35:58.323099 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.323071    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-token\") pod \"maas-default-gateway-openshift-default-5db77fbd9f-2lkmv\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.384623 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.384562    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:35:58.853821 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:35:58.853775    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51640a89_0c3e_46c8_8ba4_47903cafa26f.slice/crio-34835a5921c30734653eb151125a8e9b552c8075e4cdeffc82ed47baa7853cff WatchSource:0}: Error finding container 34835a5921c30734653eb151125a8e9b552c8075e4cdeffc82ed47baa7853cff: Status 404 returned error can't find the container with id 34835a5921c30734653eb151125a8e9b552c8075e4cdeffc82ed47baa7853cff
Nov 04 01:35:58.854923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.854892    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"]
Nov 04 01:35:58.858509 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.858467    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:35:58.858645 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.858568    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:35:58.858645 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:58.858621    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:35:59.652752 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:59.652594    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" event={"ID":"51640a89-0c3e-46c8-8ba4-47903cafa26f","Type":"ContainerStarted","Data":"7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c"}
Nov 04 01:35:59.652752 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:59.652704    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" event={"ID":"51640a89-0c3e-46c8-8ba4-47903cafa26f","Type":"ContainerStarted","Data":"34835a5921c30734653eb151125a8e9b552c8075e4cdeffc82ed47baa7853cff"}
Nov 04 01:35:59.792623 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:59.792587    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:35:59.814685 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:35:59.814635    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" podStartSLOduration=1.814623189 podStartE2EDuration="1.814623189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:35:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:35:59.813797872 +0000 UTC m=+1490.964005631" watchObservedRunningTime="2026-11-04 01:35:59.814623189 +0000 UTC m=+1490.964830962"
Nov 04 01:36:00.291611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:00.288618    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:00.385189 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:00.385150    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:36:00.387010 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:00.386983    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:36:00.387137 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:00.387044    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 04 01:36:01.385115 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:01.385076    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:36:01.385690 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:01.385145    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 04 01:36:01.566505 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:01.566461    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:02.385926 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:02.385873    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:36:02.386344 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:02.385931    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 04 01:36:03.385059 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:03.385020    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:36:03.385214 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:03.385075    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 04 01:36:03.525462 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:03.525430    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:04.385590 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:04.385522    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:36:04.385752 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:04.385608    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 04 01:36:05.213168 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.213125    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:05.362295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.362253    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:05.385083 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.385048    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:36:05.385314 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.385121    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 04 01:36:05.420348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.420309    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"]
Nov 04 01:36:05.424348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.424314    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.473632 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.473524    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-d057d7-serving-cert\""
Nov 04 01:36:05.526101 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.526062    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"]
Nov 04 01:36:05.532143 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.532110    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-maas-api-tls\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.532326 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.532161    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8kc2\" (UniqueName: \"kubernetes.io/projected/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-kube-api-access-d8kc2\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.532326 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.532279    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.532466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.532364    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-metrics-certs\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.631340 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.631278    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:05.633647 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.633618    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-metrics-certs\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.633805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.633719    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-maas-api-tls\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.633805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.633747    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8kc2\" (UniqueName: \"kubernetes.io/projected/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-kube-api-access-d8kc2\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.633938 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.633805    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.633938 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:36:05.633833    5572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-serving-cert: secret "maas-api-e2e-extmod-b-d057d7-serving-cert" not found
Nov 04 01:36:05.633938 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:36:05.633898    5572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-maas-api-tls podName:09673ea1-4287-4dc1-b19b-5bfd5f6867dd nodeName:}" failed. No retries permitted until 2026-11-04 01:36:06.13387912 +0000 UTC m=+1497.284086870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-maas-api-tls") pod "maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t" (UID: "09673ea1-4287-4dc1-b19b-5bfd5f6867dd") : secret "maas-api-e2e-extmod-b-d057d7-serving-cert" not found
Nov 04 01:36:05.634511 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.634488    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.636836 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.636810    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-metrics-certs\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.693170 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.693137    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8kc2\" (UniqueName: \"kubernetes.io/projected/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-kube-api-access-d8kc2\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:05.804364 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:05.804229    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:06.002491 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:06.002456    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:06.139277 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:06.139190    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-maas-api-tls\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:06.141695 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:06.141668    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-maas-api-tls\") pod \"maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:06.341557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:06.340992    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:06.385673 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:06.385635    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 04 01:36:06.385866 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:06.385688    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 04 01:36:06.733864 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:06.733671    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"]
Nov 04 01:36:06.742213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:06.742148    5572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 01:36:07.735287 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:07.735219    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t" event={"ID":"09673ea1-4287-4dc1-b19b-5bfd5f6867dd","Type":"ContainerStarted","Data":"c62626e6c974aaebf38473ed217156cf33bedfe3a909ccf6ff3dc028a17724fd"}
Nov 04 01:36:08.355575 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:08.355522    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:36:08.355962 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:08.355938    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:36:08.356909 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:08.356890    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:36:08.596178 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:08.596107    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:08.742609 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:08.742568    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t" event={"ID":"09673ea1-4287-4dc1-b19b-5bfd5f6867dd","Type":"ContainerStarted","Data":"eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f"}
Nov 04 01:36:08.743002 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:08.742639    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:08.855616 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:08.855562    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t" podStartSLOduration=2.948522483 podStartE2EDuration="3.855528528s" totalImagesPullingTime="907.006045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:36:08.852921289 +0000 UTC m=+1500.003129049" watchObservedRunningTime="2026-11-04 01:36:08.855528528 +0000 UTC m=+1500.005736283"
Nov 04 01:36:09.490947 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:09.490892    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:11.073891 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:11.073853    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:11.218837 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:11.218776    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:13.199667 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:36:13.199627    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:36:14.737747 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:14.737706    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:14.753357 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:14.753326    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:36:14.886000 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:14.885965    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:15.031138 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:15.031059    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:15.434767 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:15.434686    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:16.210861 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:16.210825    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:20.875632 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:20.875599    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:21.021940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:21.021911    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:21.287273 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:21.287225    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:21.430494 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:21.430426    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:26.489821 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:26.489785    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:27.101166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:27.101132    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:27.254252 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:27.254215    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:28.491803 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:28.491773    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:28.703757 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:28.703708    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:28.873204 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:28.873109    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:29.779320 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:29.779279    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:31.125506 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.125474    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"]
Nov 04 01:36:31.125902 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.125692    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2" podUID="60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f" containerName="maas-api" containerID="cri-o://96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968" gracePeriod=30
Nov 04 01:36:31.233086 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.233050    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:31.500912 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.500888    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:36:31.595554 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.594907    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-openshift-service-ca\") pod \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") "
Nov 04 01:36:31.595554 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.595026    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-kube-api-access-cbdwk\" (UniqueName: \"kubernetes.io/projected/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-kube-api-access-cbdwk\") pod \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") "
Nov 04 01:36:31.595554 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.595156    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-maas-api-tls\") pod \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") "
Nov 04 01:36:31.595554 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.595197    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-metrics-certs\") pod \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\" (UID: \"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f\") "
Nov 04 01:36:31.595554 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.595358    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-openshift-service-ca" pod "60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f" (UID: "60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:36:31.596023 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.595633    5572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-openshift-service-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:31.606121 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.606079    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-metrics-certs" pod "60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f" (UID: "60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:36:31.606292 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.606113    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-maas-api-tls" pod "60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f" (UID: "60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:36:31.606292 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.606214    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-kube-api-access-cbdwk" pod "60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f" (UID: "60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f"). InnerVolumeSpecName "kube-api-access-cbdwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:36:31.697551 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.697452    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbdwk\" (UniqueName: \"kubernetes.io/projected/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-kube-api-access-cbdwk\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:31.697551 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.697491    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-maas-api-tls\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:31.697551 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.697507    5572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f-metrics-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:36:31.907269 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.907188    5572 generic.go:356] "Generic (PLEG): container finished" podID="60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f" containerID="96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968" exitCode=0
Nov 04 01:36:31.907269 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.907239    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"
Nov 04 01:36:31.907269 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.907259    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2" event={"ID":"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f","Type":"ContainerDied","Data":"96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968"}
Nov 04 01:36:31.907555 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.907301    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2" event={"ID":"60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f","Type":"ContainerDied","Data":"180b7bfbda2080f28b93cd838586ea8771f43d5fa5f1006966cb7f0b2bb22f0b"}
Nov 04 01:36:31.907555 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.907321    5572 scope.go:122] "RemoveContainer" containerID="96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968"
Nov 04 01:36:31.917432 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.917413    5572 scope.go:122] "RemoveContainer" containerID="96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968"
Nov 04 01:36:31.917716 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:36:31.917698    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968\": container with ID starting with 96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968 not found: ID does not exist" containerID="96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968"
Nov 04 01:36:31.917771 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:31.917724    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968"} err="failed to get container status \"96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968\": rpc error: code = NotFound desc = could not find container \"96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968\": container with ID starting with 96e4630892a0510d061e6635f3e503c1826ed667ee18751e5a3b901053433968 not found: ID does not exist"
Nov 04 01:36:32.071927 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:32.071862    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"]
Nov 04 01:36:32.075324 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:32.075292    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-5520b3-55f6ccc7f9-fhxc2"]
Nov 04 01:36:32.977353 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:32.977311    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f" path="/var/lib/kubelet/pods/60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f/volumes"
Nov 04 01:36:33.416874 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:33.416836    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:34.771898 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:34.771862    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:34.918053 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:34.918016    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:35.943037 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:35.943002    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:36.087195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:36.087166    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:36.607946 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:36.607910    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:36.938384 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:36.938290    5572 generic.go:356] "Generic (PLEG): container finished" podID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerID="5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0" exitCode=0
Nov 04 01:36:36.938384 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:36.938343    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" event={"ID":"96739365-8b06-4d74-b82b-db47e3de3f3c","Type":"ContainerDied","Data":"5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0"}
Nov 04 01:36:36.938812 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:36.938797    5572 scope.go:122] "RemoveContainer" containerID="5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0"
Nov 04 01:36:36.940442 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:36.940414    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:36:36.940522 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:36.940496    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:36:36.940592 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:36.940556    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:36:37.975595 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:37.970080    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" event={"ID":"96739365-8b06-4d74-b82b-db47e3de3f3c","Type":"ContainerStarted","Data":"829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396"}
Nov 04 01:36:38.344768 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:38.344677    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:36:38.351567 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:38.350689    5572 patch_prober.go:29] interesting pod/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 01:36:38.351567 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:38.350771    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 01:36:38.771514 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:38.771471    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:39.345157 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:39.345126    5572 patch_prober.go:29] interesting pod/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 01:36:39.345624 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:39.345180    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 01:36:40.344267 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:40.344232    5572 patch_prober.go:29] interesting pod/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 01:36:40.344449 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:40.344282    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 01:36:41.344215 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:41.344184    5572 patch_prober.go:29] interesting pod/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 01:36:41.344656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:41.344255    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 01:36:42.335212 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:42.335182    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:36:42.344894 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:42.344866    5572 patch_prober.go:29] interesting pod/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 01:36:42.345282 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:42.344915    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 01:36:43.200126 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:36:43.200084    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:36:43.386923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:43.386891    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:36:43.388184 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:43.388162    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:36:44.126728 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:44.126693    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:44.300626 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:44.300592    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:44.445949 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:44.445910    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:47.153054 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:47.153020    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:48.051237 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:48.051186    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:49.393276 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:49.393243    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:52.311687 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.311647    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"]
Nov 04 01:36:52.312198 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.312184    5572 cpu_manager.go:414] "containerMap: removing container" podUID="60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f" containerName="maas-api"
Nov 04 01:36:52.312241 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.312199    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f" containerName="maas-api"
Nov 04 01:36:52.312291 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.312282    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="60e6bc1c-0a76-4c01-b3d1-8da4c4a4214f" containerName="maas-api"
Nov 04 01:36:52.314903 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.314883    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.413079 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.413047    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"]
Nov 04 01:36:52.443373 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.443335    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7096915-73db-4075-aa66-e778190eb397-istiod-ca-cert\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.443563 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.443391    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-credential-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.443563 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.443502    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-data\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.443563 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.443546    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7096915-73db-4075-aa66-e778190eb397-istio-podinfo\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.443673 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.443635    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-envoy\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.443705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.443678    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-certs\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.443738 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.443714    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.443848 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.443833    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p9kb\" (UniqueName: \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-kube-api-access-5p9kb\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.443897 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.443885    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-istio-token\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.452098 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.452069    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-1baf54-openshift-default-dockercfg-hnfrz\""
Nov 04 01:36:52.544841 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.544806    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9kb\" (UniqueName: \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-kube-api-access-5p9kb\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545051 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.544879    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-istio-token\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545051 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.544904    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7096915-73db-4075-aa66-e778190eb397-istiod-ca-cert\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545051 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.544953    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-credential-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545051 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.545024    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-data\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545275 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.545056    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7096915-73db-4075-aa66-e778190eb397-istio-podinfo\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545275 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.545105    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-envoy\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545275 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.545147    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-certs\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545275 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.545195    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545518 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.545490    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-credential-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545753 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.545659    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-socket\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545857 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.545819    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-certs\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.545857 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.545835    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7096915-73db-4075-aa66-e778190eb397-istiod-ca-cert\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.546145 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.546121    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-data\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.548094 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.548074    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-envoy\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.548193 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.548159    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7096915-73db-4075-aa66-e778190eb397-istio-podinfo\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.603585 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.603497    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-istio-token\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.603700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.603578    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p9kb\" (UniqueName: \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-kube-api-access-5p9kb\") pod \"e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") " pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:52.628392 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:52.628365    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:53.051354 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:53.051328    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"]
Nov 04 01:36:53.053240 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:36:53.053199    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7096915_73db_4075_aa66_e778190eb397.slice/crio-38c1eee9b3df0079cba3dc81b58ec0ac7cc001aaf04951c577b04ed1efd6d7b6 WatchSource:0}: Error finding container 38c1eee9b3df0079cba3dc81b58ec0ac7cc001aaf04951c577b04ed1efd6d7b6: Status 404 returned error can't find the container with id 38c1eee9b3df0079cba3dc81b58ec0ac7cc001aaf04951c577b04ed1efd6d7b6
Nov 04 01:36:53.055678 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:53.055647    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:36:53.055745 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:53.055712    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:36:53.055745 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:53.055741    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:36:53.071847 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:53.071810    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" event={"ID":"d7096915-73db-4075-aa66-e778190eb397","Type":"ContainerStarted","Data":"38c1eee9b3df0079cba3dc81b58ec0ac7cc001aaf04951c577b04ed1efd6d7b6"}
Nov 04 01:36:54.081240 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:54.081205    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" event={"ID":"d7096915-73db-4075-aa66-e778190eb397","Type":"ContainerStarted","Data":"10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6"}
Nov 04 01:36:54.192500 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:54.192459    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:54.242082 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:54.242026    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" podStartSLOduration=2.242013145 podStartE2EDuration="2.242013145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:36:54.239067978 +0000 UTC m=+1545.389275734" watchObservedRunningTime="2026-11-04 01:36:54.242013145 +0000 UTC m=+1545.392220904"
Nov 04 01:36:54.517487 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:54.517455    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:54.629160 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:54.629132    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:36:54.630789 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:54.630764    5572 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:54.630915 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:54.630818    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" podUID="d7096915-73db-4075-aa66-e778190eb397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 04 01:36:55.472322 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:55.472289    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:55.616420 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:55.616380    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:55.629161 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:55.629134    5572 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:55.629348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:55.629185    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" podUID="d7096915-73db-4075-aa66-e778190eb397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 04 01:36:56.567561 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:56.563373    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:56.628888 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:56.628854    5572 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:56.629183 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:56.629158    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" podUID="d7096915-73db-4075-aa66-e778190eb397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 04 01:36:57.109173 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:57.109145    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:57.629410 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:57.629086    5572 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:57.629410 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:57.629140    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" podUID="d7096915-73db-4075-aa66-e778190eb397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 04 01:36:58.628941 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:58.628905    5572 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:58.629127 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:58.628961    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" podUID="d7096915-73db-4075-aa66-e778190eb397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 04 01:36:59.410238 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:59.410203    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:36:59.628793 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:59.628754    5572 patch_prober.go:29] interesting pod/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 04 01:36:59.628991 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:36:59.628816    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" podUID="d7096915-73db-4075-aa66-e778190eb397" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 04 01:37:00.377828 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:00.377789    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:00.715725 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:00.715688    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:37:00.716149 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:00.716040    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:37:00.716977 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:00.716954    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:37:01.429092 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:01.429060    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:01.979061 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:01.979013    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:06.034300 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.034256    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"]
Nov 04 01:37:06.034755 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.034508    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl" podUID="22838154-4a76-49f3-8d58-d2410f636389" containerName="maas-api" containerID="cri-o://e57f4e4eac61cf323df1fe26ae33c9259d94532f829895bc71b3149f890d4eb7" gracePeriod=30
Nov 04 01:37:06.143554 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.143344    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:06.173329 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.173295    5572 generic.go:356] "Generic (PLEG): container finished" podID="22838154-4a76-49f3-8d58-d2410f636389" containerID="e57f4e4eac61cf323df1fe26ae33c9259d94532f829895bc71b3149f890d4eb7" exitCode=0
Nov 04 01:37:06.173663 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.173639    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl" event={"ID":"22838154-4a76-49f3-8d58-d2410f636389","Type":"ContainerDied","Data":"e57f4e4eac61cf323df1fe26ae33c9259d94532f829895bc71b3149f890d4eb7"}
Nov 04 01:37:06.365578 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.364930    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:37:06.540988 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.540938    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-metrics-certs\" (UniqueName: \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-metrics-certs\") pod \"22838154-4a76-49f3-8d58-d2410f636389\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") "
Nov 04 01:37:06.541343 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.541317    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22838154-4a76-49f3-8d58-d2410f636389-kube-api-access-zsw7k\" (UniqueName: \"kubernetes.io/projected/22838154-4a76-49f3-8d58-d2410f636389-kube-api-access-zsw7k\") pod \"22838154-4a76-49f3-8d58-d2410f636389\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") "
Nov 04 01:37:06.541700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.541666    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-maas-api-tls\") pod \"22838154-4a76-49f3-8d58-d2410f636389\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") "
Nov 04 01:37:06.542163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.542140    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22838154-4a76-49f3-8d58-d2410f636389-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22838154-4a76-49f3-8d58-d2410f636389-openshift-service-ca\") pod \"22838154-4a76-49f3-8d58-d2410f636389\" (UID: \"22838154-4a76-49f3-8d58-d2410f636389\") "
Nov 04 01:37:06.543184 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.543162    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22838154-4a76-49f3-8d58-d2410f636389-openshift-service-ca" pod "22838154-4a76-49f3-8d58-d2410f636389" (UID: "22838154-4a76-49f3-8d58-d2410f636389"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:37:06.545750 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.545724    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22838154-4a76-49f3-8d58-d2410f636389-kube-api-access-zsw7k" pod "22838154-4a76-49f3-8d58-d2410f636389" (UID: "22838154-4a76-49f3-8d58-d2410f636389"). InnerVolumeSpecName "kube-api-access-zsw7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:37:06.546665 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.546643    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-maas-api-tls" pod "22838154-4a76-49f3-8d58-d2410f636389" (UID: "22838154-4a76-49f3-8d58-d2410f636389"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:37:06.573084 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.573000    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-metrics-certs" pod "22838154-4a76-49f3-8d58-d2410f636389" (UID: "22838154-4a76-49f3-8d58-d2410f636389"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:37:06.643752 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.643705    5572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-metrics-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:06.643752 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.643749    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsw7k\" (UniqueName: \"kubernetes.io/projected/22838154-4a76-49f3-8d58-d2410f636389-kube-api-access-zsw7k\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:06.644038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.643767    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22838154-4a76-49f3-8d58-d2410f636389-maas-api-tls\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:06.644038 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:06.643780    5572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22838154-4a76-49f3-8d58-d2410f636389-openshift-service-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:07.164520 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:07.164488    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:07.181194 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:07.181170    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"
Nov 04 01:37:07.181355 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:07.181191    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl" event={"ID":"22838154-4a76-49f3-8d58-d2410f636389","Type":"ContainerDied","Data":"c61205d353a39b3bde2ba588f25d677986196d04b95fa2252888515a95101117"}
Nov 04 01:37:07.181355 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:07.181255    5572 scope.go:122] "RemoveContainer" containerID="e57f4e4eac61cf323df1fe26ae33c9259d94532f829895bc71b3149f890d4eb7"
Nov 04 01:37:07.311806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:07.311729    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:07.335046 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:07.335013    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"]
Nov 04 01:37:07.381499 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:07.381463    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-cae0ab-5bf54cc7cc-crcsl"]
Nov 04 01:37:08.095496 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:08.095442    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:08.925825 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:08.925792    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:08.973978 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:08.973941    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="22838154-4a76-49f3-8d58-d2410f636389" path="/var/lib/kubelet/pods/22838154-4a76-49f3-8d58-d2410f636389/volumes"
Nov 04 01:37:09.433963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:09.433930    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"]
Nov 04 01:37:09.434214 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:09.434187    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" podUID="d7096915-73db-4075-aa66-e778190eb397" containerName="istio-proxy" containerID="cri-o://10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6" gracePeriod=30
Nov 04 01:37:09.435776 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:09.435745    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:11.409386 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:11.409354    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:11.552619 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:11.552589    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:12.681504 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:12.681469    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:12.824071 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:12.824036    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:13.119104 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:13.119069    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:13.200578 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:37:13.200546    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:37:13.304750 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:13.304708    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:13.459323 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:13.459294    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:13.618789 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:13.618752    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:14.699676 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.699621    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:37:14.756755 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.756723    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-istio-token\" (UniqueName: \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-istio-token\") pod \"d7096915-73db-4075-aa66-e778190eb397\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") "
Nov 04 01:37:14.756934 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.756769    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-certs\") pod \"d7096915-73db-4075-aa66-e778190eb397\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") "
Nov 04 01:37:14.756934 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.756801    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d7096915-73db-4075-aa66-e778190eb397-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7096915-73db-4075-aa66-e778190eb397-istio-podinfo\") pod \"d7096915-73db-4075-aa66-e778190eb397\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") "
Nov 04 01:37:14.756934 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.756822    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-kube-api-access-5p9kb\" (UniqueName: \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-kube-api-access-5p9kb\") pod \"d7096915-73db-4075-aa66-e778190eb397\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") "
Nov 04 01:37:14.756934 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.756865    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d7096915-73db-4075-aa66-e778190eb397-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7096915-73db-4075-aa66-e778190eb397-istiod-ca-cert\") pod \"d7096915-73db-4075-aa66-e778190eb397\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") "
Nov 04 01:37:14.756934 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.756929    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-envoy\") pod \"d7096915-73db-4075-aa66-e778190eb397\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") "
Nov 04 01:37:14.757206 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.756972    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-socket\") pod \"d7096915-73db-4075-aa66-e778190eb397\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") "
Nov 04 01:37:14.757206 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.757006    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-credential-socket\") pod \"d7096915-73db-4075-aa66-e778190eb397\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") "
Nov 04 01:37:14.757206 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.757096    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-data\") pod \"d7096915-73db-4075-aa66-e778190eb397\" (UID: \"d7096915-73db-4075-aa66-e778190eb397\") "
Nov 04 01:37:14.757206 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.757171    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-certs" pod "d7096915-73db-4075-aa66-e778190eb397" (UID: "d7096915-73db-4075-aa66-e778190eb397"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:14.757436 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.757380    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-socket" pod "d7096915-73db-4075-aa66-e778190eb397" (UID: "d7096915-73db-4075-aa66-e778190eb397"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:14.757436 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.757402    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7096915-73db-4075-aa66-e778190eb397-istiod-ca-cert" pod "d7096915-73db-4075-aa66-e778190eb397" (UID: "d7096915-73db-4075-aa66-e778190eb397"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:37:14.757436 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.757415    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-credential-socket" pod "d7096915-73db-4075-aa66-e778190eb397" (UID: "d7096915-73db-4075-aa66-e778190eb397"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:14.757611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.757579    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-data" pod "d7096915-73db-4075-aa66-e778190eb397" (UID: "d7096915-73db-4075-aa66-e778190eb397"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:14.757668 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.757647    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.757726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.757670    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.757726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.757684    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.757726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.757697    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7096915-73db-4075-aa66-e778190eb397-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.759148 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.759106    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-kube-api-access-5p9kb" pod "d7096915-73db-4075-aa66-e778190eb397" (UID: "d7096915-73db-4075-aa66-e778190eb397"). InnerVolumeSpecName "kube-api-access-5p9kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:37:14.759273 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.759170    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-istio-token" pod "d7096915-73db-4075-aa66-e778190eb397" (UID: "d7096915-73db-4075-aa66-e778190eb397"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:37:14.759428 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.759402    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-envoy" pod "d7096915-73db-4075-aa66-e778190eb397" (UID: "d7096915-73db-4075-aa66-e778190eb397"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:14.759519 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.759498    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d7096915-73db-4075-aa66-e778190eb397-istio-podinfo" pod "d7096915-73db-4075-aa66-e778190eb397" (UID: "d7096915-73db-4075-aa66-e778190eb397"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:37:14.858928 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.858898    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.858928 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.858923    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.858928 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.858932    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7096915-73db-4075-aa66-e778190eb397-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.859325 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.858942    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p9kb\" (UniqueName: \"kubernetes.io/projected/d7096915-73db-4075-aa66-e778190eb397-kube-api-access-5p9kb\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:14.859325 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:14.858953    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7096915-73db-4075-aa66-e778190eb397-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:15.236132 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.236093    5572 generic.go:356] "Generic (PLEG): container finished" podID="d7096915-73db-4075-aa66-e778190eb397" containerID="10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6" exitCode=0
Nov 04 01:37:15.236303 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.236158    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"
Nov 04 01:37:15.236303 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.236178    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" event={"ID":"d7096915-73db-4075-aa66-e778190eb397","Type":"ContainerDied","Data":"10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6"}
Nov 04 01:37:15.236303 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.236240    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h" event={"ID":"d7096915-73db-4075-aa66-e778190eb397","Type":"ContainerDied","Data":"38c1eee9b3df0079cba3dc81b58ec0ac7cc001aaf04951c577b04ed1efd6d7b6"}
Nov 04 01:37:15.236303 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.236263    5572 scope.go:122] "RemoveContainer" containerID="10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6"
Nov 04 01:37:15.246631 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.246610    5572 scope.go:122] "RemoveContainer" containerID="10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6"
Nov 04 01:37:15.246968 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:37:15.246944    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6\": container with ID starting with 10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6 not found: ID does not exist" containerID="10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6"
Nov 04 01:37:15.247023 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.246977    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6"} err="failed to get container status \"10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6\": rpc error: code = NotFound desc = could not find container \"10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6\": container with ID starting with 10b7b49f7ac343d7080de62d9aec6eb0aaef65004fda1091635e1797ca73e9d6 not found: ID does not exist"
Nov 04 01:37:15.398471 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.398426    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"]
Nov 04 01:37:15.432117 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.432081    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:15.445965 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.445927    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-1baf54-openshift-default-84dc6cddcc-gdl9h"]
Nov 04 01:37:15.623088 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.622983    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:15.771757 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:15.771726    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:16.973772 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:16.973740    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7096915-73db-4075-aa66-e778190eb397" path="/var/lib/kubelet/pods/d7096915-73db-4075-aa66-e778190eb397/volumes"
Nov 04 01:37:17.272755 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:17.272672    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:17.780337 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:17.780305    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:18.312394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:18.312350    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:18.744398 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:18.744368    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:19.614600 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:19.614570    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:23.273321 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:23.273289    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"]
Nov 04 01:37:23.368664 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:23.368630    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:23.894414 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:23.894382    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:24.725700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:24.725667    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:28.906647 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:28.906606    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:30.498852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:30.498813    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:31.166318 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:31.166287    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"]
Nov 04 01:37:31.530012 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:31.529970    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:31.676273 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:31.676239    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:34.259732 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:34.259695    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:36.111394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:36.111359    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:36.166788 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:36.166704    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v" podUID="82b10dc5-1cdd-4442-9b25-f379e6a16b07" containerName="payload-processing" containerID="cri-o://7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220" gracePeriod=25
Nov 04 01:37:38.295314 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.295245    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj" podUID="9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" containerName="main" containerID="cri-o://a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e" gracePeriod=45
Nov 04 01:37:38.315676 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.315646    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj" podUID="9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": dial tcp 10.133.0.48:8000: connect: connection refused"
Nov 04 01:37:38.545737 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.545673    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:37:38.642305 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.642266    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tls-certs\") pod \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") "
Nov 04 01:37:38.642495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.642334    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-model-cache\") pod \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") "
Nov 04 01:37:38.642495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.642385    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-kube-api-access-qsv86\" (UniqueName: \"kubernetes.io/projected/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-kube-api-access-qsv86\") pod \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") "
Nov 04 01:37:38.642495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.642479    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tmp-dir\") pod \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") "
Nov 04 01:37:38.642675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.642526    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-dshm\") pod \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") "
Nov 04 01:37:38.642675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.642644    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-model-cache" pod "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" (UID: "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:38.642785 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.642652    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-home\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-home\") pod \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\" (UID: \"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32\") "
Nov 04 01:37:38.642840 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.642780    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tmp-dir" pod "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" (UID: "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:38.642916 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.642894    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-home" pod "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" (UID: "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:38.643315 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.643286    5572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-model-cache\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:38.643442 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.643318    5572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tmp-dir\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:38.643442 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.643334    5572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-home\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:38.644633 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.644600    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tls-certs" pod "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" (UID: "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:37:38.644739 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.644663    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-kube-api-access-qsv86" pod "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" (UID: "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32"). InnerVolumeSpecName "kube-api-access-qsv86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:37:38.644739 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.644675    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-dshm" pod "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" (UID: "9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:37:38.745071 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.745040    5572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-dshm\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:38.745071 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.745071    5572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-tls-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:38.745279 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:38.745084    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsv86\" (UniqueName: \"kubernetes.io/projected/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32-kube-api-access-qsv86\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:39.384397 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:39.384304    5572 generic.go:356] "Generic (PLEG): container finished" podID="9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" containerID="a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e" exitCode=0
Nov 04 01:37:39.384397 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:39.384346    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"
Nov 04 01:37:39.384397 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:39.384381    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj" event={"ID":"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32","Type":"ContainerDied","Data":"a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e"}
Nov 04 01:37:39.385093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:39.384431    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj" event={"ID":"9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32","Type":"ContainerDied","Data":"be94333df13c78674e54fd8e82793a994606ed8ae243c91e087b92f6bfa79c9f"}
Nov 04 01:37:39.385093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:39.384448    5572 scope.go:122] "RemoveContainer" containerID="a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e"
Nov 04 01:37:39.393863 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:39.393843    5572 scope.go:122] "RemoveContainer" containerID="a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e"
Nov 04 01:37:39.394190 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:37:39.394154    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e\": container with ID starting with a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e not found: ID does not exist" containerID="a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e"
Nov 04 01:37:39.394295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:39.394202    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e"} err="failed to get container status \"a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e\": rpc error: code = NotFound desc = could not find container \"a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e\": container with ID starting with a70fa6a68d6a103b59379622f00d42365e4dda6407b6ca6a3dbf192c1bbe3c2e not found: ID does not exist"
Nov 04 01:37:39.538157 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:39.538123    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"]
Nov 04 01:37:39.584646 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:39.584614    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-9f7183/simulator-w3-9f7183-kserve-dfdf75856-5v8hj"]
Nov 04 01:37:39.690756 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:39.690709    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:40.973655 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:40.973618    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" path="/var/lib/kubelet/pods/9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32/volumes"
Nov 04 01:37:43.198914 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:37:43.198874    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:37:43.402759 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:43.402720    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:44.152575 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:44.152523    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v" podUID="82b10dc5-1cdd-4442-9b25-f379e6a16b07" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 01:37:44.675385 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:44.675352    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:44.821913 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:44.821863    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:44.999759 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:44.999725    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:45.146912 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:45.146874    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:45.307276 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:45.307190    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:45.473067 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:45.473033    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:46.344917 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:46.344873    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:46.501150 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:46.501112    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:50.343479 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:50.343443    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:50.489388 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:50.489352    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:51.981270 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:51.981228    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:54.152987 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:54.152950    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v" podUID="82b10dc5-1cdd-4442-9b25-f379e6a16b07" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 01:37:55.392661 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:55.392624    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:56.421326 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.421300    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:37:56.509742 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.509709    5572 generic.go:356] "Generic (PLEG): container finished" podID="82b10dc5-1cdd-4442-9b25-f379e6a16b07" containerID="7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220" exitCode=0
Nov 04 01:37:56.509912 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.509755    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"
Nov 04 01:37:56.509912 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.509780    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v" event={"ID":"82b10dc5-1cdd-4442-9b25-f379e6a16b07","Type":"ContainerDied","Data":"7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220"}
Nov 04 01:37:56.509912 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.509832    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v" event={"ID":"82b10dc5-1cdd-4442-9b25-f379e6a16b07","Type":"ContainerDied","Data":"4ccf4c7d458cc166e22f686bf677a92fe1b7af41ad1452cba1ce4cad3fb72c27"}
Nov 04 01:37:56.509912 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.509861    5572 scope.go:122] "RemoveContainer" containerID="7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220"
Nov 04 01:37:56.519308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.519289    5572 scope.go:122] "RemoveContainer" containerID="7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220"
Nov 04 01:37:56.519577 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:37:56.519527    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220\": container with ID starting with 7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220 not found: ID does not exist" containerID="7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220"
Nov 04 01:37:56.519636 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.519587    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220"} err="failed to get container status \"7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220\": rpc error: code = NotFound desc = could not find container \"7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220\": container with ID starting with 7693fccf4eee8e01e6fb1737c328670e6f8fa91c0c1be4c8865b0f78846c6220 not found: ID does not exist"
Nov 04 01:37:56.562313 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.562281    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/82b10dc5-1cdd-4442-9b25-f379e6a16b07-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82b10dc5-1cdd-4442-9b25-f379e6a16b07-plugins-config-volume\") pod \"82b10dc5-1cdd-4442-9b25-f379e6a16b07\" (UID: \"82b10dc5-1cdd-4442-9b25-f379e6a16b07\") "
Nov 04 01:37:56.562508 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.562334    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82b10dc5-1cdd-4442-9b25-f379e6a16b07-kube-api-access-2htgn\" (UniqueName: \"kubernetes.io/projected/82b10dc5-1cdd-4442-9b25-f379e6a16b07-kube-api-access-2htgn\") pod \"82b10dc5-1cdd-4442-9b25-f379e6a16b07\" (UID: \"82b10dc5-1cdd-4442-9b25-f379e6a16b07\") "
Nov 04 01:37:56.562725 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.562702    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b10dc5-1cdd-4442-9b25-f379e6a16b07-plugins-config-volume" pod "82b10dc5-1cdd-4442-9b25-f379e6a16b07" (UID: "82b10dc5-1cdd-4442-9b25-f379e6a16b07"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:37:56.564557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.564518    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b10dc5-1cdd-4442-9b25-f379e6a16b07-kube-api-access-2htgn" pod "82b10dc5-1cdd-4442-9b25-f379e6a16b07" (UID: "82b10dc5-1cdd-4442-9b25-f379e6a16b07"). InnerVolumeSpecName "kube-api-access-2htgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:37:56.663861 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.663830    5572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82b10dc5-1cdd-4442-9b25-f379e6a16b07-plugins-config-volume\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:56.663861 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.663855    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2htgn\" (UniqueName: \"kubernetes.io/projected/82b10dc5-1cdd-4442-9b25-f379e6a16b07-kube-api-access-2htgn\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:37:56.913771 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.913740    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:37:56.925493 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.925463    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"]
Nov 04 01:37:56.931765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.931742    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-9f7183-84b59f48b4-mpc5v"]
Nov 04 01:37:56.974605 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:37:56.974580    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82b10dc5-1cdd-4442-9b25-f379e6a16b07" path="/var/lib/kubelet/pods/82b10dc5-1cdd-4442-9b25-f379e6a16b07/volumes"
Nov 04 01:38:00.420939 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:00.420908    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:00.598978 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:00.598945    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:01.303737 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:01.303703    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:02.334134 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:02.334091    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:05.507594 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:05.507553    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:07.215329 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:07.215295    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:07.365345 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:07.365312    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:10.597755 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:10.597719    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:11.764258 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:11.764216    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:13.199885 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:38:13.199851    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:38:15.711036 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:15.711002    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:16.140331 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:16.140255    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:20.121494 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:20.121409    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:22.007206 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:22.007174    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:24.285613 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:24.285583    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:24.487823 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:24.487789    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:25.914399 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:25.914367    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:26.440331 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:26.440298    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:26.442901 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:26.442880    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"]
Nov 04 01:38:26.443112 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:26.443091    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f" podUID="c296b226-17b6-47a1-82cc-03dacd75da0d" containerName="istio-proxy" containerID="cri-o://93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422" gracePeriod=30
Nov 04 01:38:27.265297 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:27.265257    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:29.872525 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:29.872493    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:30.016145 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:30.016109    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:30.811551 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:30.811506    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:31.711431 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.711376    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:38:31.724590 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.724519    5572 generic.go:356] "Generic (PLEG): container finished" podID="c296b226-17b6-47a1-82cc-03dacd75da0d" containerID="93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422" exitCode=0
Nov 04 01:38:31.724761 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.724622    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f" event={"ID":"c296b226-17b6-47a1-82cc-03dacd75da0d","Type":"ContainerDied","Data":"93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422"}
Nov 04 01:38:31.724761 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.724713    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f" event={"ID":"c296b226-17b6-47a1-82cc-03dacd75da0d","Type":"ContainerDied","Data":"00db7ca219cff458538264241a9a8b2f4590d6d2178f745ff318e2ea6d9aa36e"}
Nov 04 01:38:31.724761 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.724750    5572 scope.go:122] "RemoveContainer" containerID="93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422"
Nov 04 01:38:31.724960 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.724944    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"
Nov 04 01:38:31.734920 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.734894    5572 scope.go:122] "RemoveContainer" containerID="93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422"
Nov 04 01:38:31.735230 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:38:31.735206    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422\": container with ID starting with 93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422 not found: ID does not exist" containerID="93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422"
Nov 04 01:38:31.735307 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.735239    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422"} err="failed to get container status \"93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422\": rpc error: code = NotFound desc = could not find container \"93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422\": container with ID starting with 93c4521be0b318ded6235cffc3be188dc002aa3b597fbf5eb9f21cf4aad6e422 not found: ID does not exist"
Nov 04 01:38:31.787349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787321    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-kube-api-access-m7xsp\" (UniqueName: \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-kube-api-access-m7xsp\") pod \"c296b226-17b6-47a1-82cc-03dacd75da0d\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") "
Nov 04 01:38:31.787518 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787368    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-socket\") pod \"c296b226-17b6-47a1-82cc-03dacd75da0d\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") "
Nov 04 01:38:31.787518 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787407    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-token\" (UniqueName: \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-token\") pod \"c296b226-17b6-47a1-82cc-03dacd75da0d\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") "
Nov 04 01:38:31.787518 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787425    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-credential-socket\") pod \"c296b226-17b6-47a1-82cc-03dacd75da0d\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") "
Nov 04 01:38:31.787518 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787460    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-certs\") pod \"c296b226-17b6-47a1-82cc-03dacd75da0d\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") "
Nov 04 01:38:31.787518 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787490    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-podinfo\") pod \"c296b226-17b6-47a1-82cc-03dacd75da0d\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") "
Nov 04 01:38:31.787518 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787519    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-envoy\") pod \"c296b226-17b6-47a1-82cc-03dacd75da0d\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") "
Nov 04 01:38:31.787955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787570    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c296b226-17b6-47a1-82cc-03dacd75da0d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c296b226-17b6-47a1-82cc-03dacd75da0d-istiod-ca-cert\") pod \"c296b226-17b6-47a1-82cc-03dacd75da0d\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") "
Nov 04 01:38:31.787955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787605    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-data\") pod \"c296b226-17b6-47a1-82cc-03dacd75da0d\" (UID: \"c296b226-17b6-47a1-82cc-03dacd75da0d\") "
Nov 04 01:38:31.787955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787842    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-certs" pod "c296b226-17b6-47a1-82cc-03dacd75da0d" (UID: "c296b226-17b6-47a1-82cc-03dacd75da0d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:38:31.787955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787842    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-credential-socket" pod "c296b226-17b6-47a1-82cc-03dacd75da0d" (UID: "c296b226-17b6-47a1-82cc-03dacd75da0d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:38:31.787955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.787852    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-socket" pod "c296b226-17b6-47a1-82cc-03dacd75da0d" (UID: "c296b226-17b6-47a1-82cc-03dacd75da0d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:38:31.788216 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.788091    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-data" pod "c296b226-17b6-47a1-82cc-03dacd75da0d" (UID: "c296b226-17b6-47a1-82cc-03dacd75da0d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:38:31.788216 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.788172    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:31.788216 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.788181    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c296b226-17b6-47a1-82cc-03dacd75da0d-istiod-ca-cert" pod "c296b226-17b6-47a1-82cc-03dacd75da0d" (UID: "c296b226-17b6-47a1-82cc-03dacd75da0d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:38:31.788216 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.788196    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:31.788216 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.788212    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:31.789889 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.789824    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-envoy" pod "c296b226-17b6-47a1-82cc-03dacd75da0d" (UID: "c296b226-17b6-47a1-82cc-03dacd75da0d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:38:31.789998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.789905    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-podinfo" pod "c296b226-17b6-47a1-82cc-03dacd75da0d" (UID: "c296b226-17b6-47a1-82cc-03dacd75da0d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:38:31.789998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.789923    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-token" pod "c296b226-17b6-47a1-82cc-03dacd75da0d" (UID: "c296b226-17b6-47a1-82cc-03dacd75da0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:38:31.789998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.789935    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-kube-api-access-m7xsp" pod "c296b226-17b6-47a1-82cc-03dacd75da0d" (UID: "c296b226-17b6-47a1-82cc-03dacd75da0d"). InnerVolumeSpecName "kube-api-access-m7xsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:38:31.888869 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.888835    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7xsp\" (UniqueName: \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-kube-api-access-m7xsp\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:31.888869 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.888868    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:31.889067 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.888882    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:31.889067 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.888895    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:31.889067 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.888908    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c296b226-17b6-47a1-82cc-03dacd75da0d-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:31.889067 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:31.888919    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c296b226-17b6-47a1-82cc-03dacd75da0d-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:38:32.139505 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:32.139475    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"]
Nov 04 01:38:32.143762 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:32.143732    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-9f7183-openshift-default-646bd94655-tgk4f"]
Nov 04 01:38:32.608700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:32.608664    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:32.973818 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:32.973789    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c296b226-17b6-47a1-82cc-03dacd75da0d" path="/var/lib/kubelet/pods/c296b226-17b6-47a1-82cc-03dacd75da0d/volumes"
Nov 04 01:38:36.711342 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:36.711307    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:36.868595 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:36.868562    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:37.011173 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:37.011092    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:37.626792 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:37.626753    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:42.779565 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:42.779519    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:43.099302 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:43.099218    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:43.199188 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:38:43.199153    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:38:43.283712 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:43.283682    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:47.904824 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:47.904785    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:52.994477 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:52.994440    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:53.626394 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:53.626362    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:57.269689 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:57.269643    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:58.104381 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:58.104344    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:59.778140 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:59.778101    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:38:59.929558 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:38:59.925997    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:00.070012 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:00.069924    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:02.680249 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:02.680203    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:03.441731 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:03.441701    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:05.508112 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:05.508072    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:08.498700 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:08.498660    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:10.125813 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:10.125776    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:10.269364 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:10.269331    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:10.414413 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:10.414331    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:10.531064 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:10.531019    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"]
Nov 04 01:39:10.531287 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:10.531261    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" podUID="e2327580-e346-4424-bb30-156c284120de" containerName="istio-proxy" containerID="cri-o://970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b" gracePeriod=30
Nov 04 01:39:10.578739 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:10.578700    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"]
Nov 04 01:39:10.579036 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:10.578995    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" podUID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" containerName="istio-proxy" containerID="cri-o://8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e" gracePeriod=30
Nov 04 01:39:10.914833 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:10.914799    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:12.097824 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:12.097791    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:12.756509 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:12.756480    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:12.900456 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:12.900422    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:13.199641 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:39:13.199608    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:39:13.607746 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:13.607663    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:15.829583 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:15.829559    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:39:15.866691 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:15.866664    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:39:16.002583 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.002555    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-envoy\") pod \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") "
Nov 04 01:39:16.002765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.002614    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-certs\") pod \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") "
Nov 04 01:39:16.002765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.002641    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-kube-api-access-xqcbz\" (UniqueName: \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-kube-api-access-xqcbz\") pod \"e2327580-e346-4424-bb30-156c284120de\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") "
Nov 04 01:39:16.002765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.002662    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-podinfo\") pod \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") "
Nov 04 01:39:16.002765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.002681    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-token\" (UniqueName: \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-token\") pod \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") "
Nov 04 01:39:16.002765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.002746    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-kube-api-access-6nw4m\" (UniqueName: \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-kube-api-access-6nw4m\") pod \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") "
Nov 04 01:39:16.002765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.002769    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-socket\") pod \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") "
Nov 04 01:39:16.003081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.002806    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-data\") pod \"e2327580-e346-4424-bb30-156c284120de\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") "
Nov 04 01:39:16.003081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.002969    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-certs" pod "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" (UID: "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:16.003081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003051    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2327580-e346-4424-bb30-156c284120de-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2327580-e346-4424-bb30-156c284120de-istiod-ca-cert\") pod \"e2327580-e346-4424-bb30-156c284120de\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") "
Nov 04 01:39:16.003081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003057    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-data" pod "e2327580-e346-4424-bb30-156c284120de" (UID: "e2327580-e346-4424-bb30-156c284120de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:16.003295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003098    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-envoy\") pod \"e2327580-e346-4424-bb30-156c284120de\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") "
Nov 04 01:39:16.003295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003147    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-socket\") pod \"e2327580-e346-4424-bb30-156c284120de\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") "
Nov 04 01:39:16.003295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003176    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istiod-ca-cert\") pod \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") "
Nov 04 01:39:16.003295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003239    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-credential-socket\") pod \"e2327580-e346-4424-bb30-156c284120de\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") "
Nov 04 01:39:16.003295 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003278    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-data\") pod \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") "
Nov 04 01:39:16.003656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003315    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-istio-token\" (UniqueName: \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-istio-token\") pod \"e2327580-e346-4424-bb30-156c284120de\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") "
Nov 04 01:39:16.003656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003372    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e2327580-e346-4424-bb30-156c284120de-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2327580-e346-4424-bb30-156c284120de-istio-podinfo\") pod \"e2327580-e346-4424-bb30-156c284120de\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") "
Nov 04 01:39:16.003656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003428    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-certs\") pod \"e2327580-e346-4424-bb30-156c284120de\" (UID: \"e2327580-e346-4424-bb30-156c284120de\") "
Nov 04 01:39:16.003656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003431    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2327580-e346-4424-bb30-156c284120de-istiod-ca-cert" pod "e2327580-e346-4424-bb30-156c284120de" (UID: "e2327580-e346-4424-bb30-156c284120de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:39:16.003656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003488    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-credential-socket\") pod \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\" (UID: \"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc\") "
Nov 04 01:39:16.003656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003522    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-socket" pod "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" (UID: "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:16.003656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003616    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istiod-ca-cert" pod "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" (UID: "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:39:16.004025 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003718    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-credential-socket" pod "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" (UID: "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:16.004025 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.003899    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-socket" pod "e2327580-e346-4424-bb30-156c284120de" (UID: "e2327580-e346-4424-bb30-156c284120de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:16.004135 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.004065    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-credential-socket" pod "e2327580-e346-4424-bb30-156c284120de" (UID: "e2327580-e346-4424-bb30-156c284120de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:16.004251 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.004223    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-certs" pod "e2327580-e346-4424-bb30-156c284120de" (UID: "e2327580-e346-4424-bb30-156c284120de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:16.004316 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.004239    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-data" pod "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" (UID: "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:16.004316 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.004233    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.004316 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.004285    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.004316 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.004303    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.004519 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.004317    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2327580-e346-4424-bb30-156c284120de-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.004519 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.004331    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.004519 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.004345    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.004519 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.004358    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.004519 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.004371    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.006113 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.006084    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2327580-e346-4424-bb30-156c284120de-istio-podinfo" pod "e2327580-e346-4424-bb30-156c284120de" (UID: "e2327580-e346-4424-bb30-156c284120de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:39:16.006219 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.006144    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-podinfo" pod "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" (UID: "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:39:16.006263 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.006229    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-token" pod "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" (UID: "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:39:16.006263 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.006231    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-kube-api-access-xqcbz" pod "e2327580-e346-4424-bb30-156c284120de" (UID: "e2327580-e346-4424-bb30-156c284120de"). InnerVolumeSpecName "kube-api-access-xqcbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:39:16.006652 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.006615    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-kube-api-access-6nw4m" pod "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" (UID: "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc"). InnerVolumeSpecName "kube-api-access-6nw4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:39:16.006776 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.006721    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-istio-token" pod "e2327580-e346-4424-bb30-156c284120de" (UID: "e2327580-e346-4424-bb30-156c284120de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:39:16.006961 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.006928    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-envoy" pod "e2327580-e346-4424-bb30-156c284120de" (UID: "e2327580-e346-4424-bb30-156c284120de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:16.007860 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.007831    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-envoy" pod "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" (UID: "3f0152d2-ed01-4c4e-87a6-8d8aae72cffc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:39:16.019405 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.019380    5572 generic.go:356] "Generic (PLEG): container finished" podID="e2327580-e346-4424-bb30-156c284120de" containerID="970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b" exitCode=0
Nov 04 01:39:16.019567 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.019426    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"
Nov 04 01:39:16.019567 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.019465    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" event={"ID":"e2327580-e346-4424-bb30-156c284120de","Type":"ContainerDied","Data":"970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b"}
Nov 04 01:39:16.019567 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.019525    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs" event={"ID":"e2327580-e346-4424-bb30-156c284120de","Type":"ContainerDied","Data":"5274ed4e49f8ba3a1109bec0186f61173f929450b914105f3964635eb28090ce"}
Nov 04 01:39:16.019742 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.019568    5572 scope.go:122] "RemoveContainer" containerID="970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b"
Nov 04 01:39:16.021174 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.021150    5572 generic.go:356] "Generic (PLEG): container finished" podID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" containerID="8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e" exitCode=0
Nov 04 01:39:16.021278 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.021206    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"
Nov 04 01:39:16.021278 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.021251    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" event={"ID":"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc","Type":"ContainerDied","Data":"8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e"}
Nov 04 01:39:16.021386 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.021304    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9" event={"ID":"3f0152d2-ed01-4c4e-87a6-8d8aae72cffc","Type":"ContainerDied","Data":"d398ee7b4357e2503ca27c2a9602a9c3cb92a15a8c5cffd04b41357c855e19a0"}
Nov 04 01:39:16.029089 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.029067    5572 scope.go:122] "RemoveContainer" containerID="970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b"
Nov 04 01:39:16.029426 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:39:16.029407    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b\": container with ID starting with 970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b not found: ID does not exist" containerID="970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b"
Nov 04 01:39:16.029516 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.029434    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b"} err="failed to get container status \"970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b\": rpc error: code = NotFound desc = could not find container \"970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b\": container with ID starting with 970a98eb177731475e90414ff145a0f29d7cbe0f36ace97cdc8094d7cc0af15b not found: ID does not exist"
Nov 04 01:39:16.029516 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.029452    5572 scope.go:122] "RemoveContainer" containerID="8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e"
Nov 04 01:39:16.041702 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.041677    5572 scope.go:122] "RemoveContainer" containerID="8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e"
Nov 04 01:39:16.042058 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:39:16.042034    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e\": container with ID starting with 8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e not found: ID does not exist" containerID="8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e"
Nov 04 01:39:16.042158 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.042069    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e"} err="failed to get container status \"8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e\": rpc error: code = NotFound desc = could not find container \"8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e\": container with ID starting with 8d7c2c97d7a3174c4ea92cc54bdfdf936415b5668490df4a6dab026df7b4584e not found: ID does not exist"
Nov 04 01:39:16.105424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.105111    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.105424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.105144    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.105424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.105159    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.105424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.105173    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2327580-e346-4424-bb30-156c284120de-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.105424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.105188    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2327580-e346-4424-bb30-156c284120de-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.105424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.105289    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.105424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.105305    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqcbz\" (UniqueName: \"kubernetes.io/projected/e2327580-e346-4424-bb30-156c284120de-kube-api-access-xqcbz\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.105424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.105322    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.105424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.105335    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.105424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.105351    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nw4m\" (UniqueName: \"kubernetes.io/projected/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc-kube-api-access-6nw4m\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:16.209935 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.209900    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"]
Nov 04 01:39:16.214273 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.214245    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-rvhfs"]
Nov 04 01:39:16.317760 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.317719    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"]
Nov 04 01:39:16.321896 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.321869    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-ffnd9"]
Nov 04 01:39:16.977596 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.977562    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" path="/var/lib/kubelet/pods/3f0152d2-ed01-4c4e-87a6-8d8aae72cffc/volumes"
Nov 04 01:39:16.978218 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:16.978197    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e2327580-e346-4424-bb30-156c284120de" path="/var/lib/kubelet/pods/e2327580-e346-4424-bb30-156c284120de/volumes"
Nov 04 01:39:17.092593 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:17.092563    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:17.267641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:17.267554    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:17.427713 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:17.427673    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:18.696436 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:18.696401    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:23.527390 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:23.527356    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:23.774020 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:23.773982    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:23.935213 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:23.935130    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:24.804669 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:24.804636    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:24.948929 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:24.948896    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:28.036495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.036458    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"]
Nov 04 01:39:28.036896 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.036679    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t" podUID="544688fe-ab53-412e-8c38-e7c38dfd60b9" containerName="maas-api" containerID="cri-o://60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17" gracePeriod=30
Nov 04 01:39:28.144987 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.144955    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:28.314433 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.314405    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:39:28.334860 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.334826    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-metrics-certs\") pod \"544688fe-ab53-412e-8c38-e7c38dfd60b9\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") "
Nov 04 01:39:28.335048 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.334930    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-maas-api-tls\") pod \"544688fe-ab53-412e-8c38-e7c38dfd60b9\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") "
Nov 04 01:39:28.335048 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.334967    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/544688fe-ab53-412e-8c38-e7c38dfd60b9-kube-api-access-gtdbs\" (UniqueName: \"kubernetes.io/projected/544688fe-ab53-412e-8c38-e7c38dfd60b9-kube-api-access-gtdbs\") pod \"544688fe-ab53-412e-8c38-e7c38dfd60b9\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") "
Nov 04 01:39:28.335048 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.334999    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/544688fe-ab53-412e-8c38-e7c38dfd60b9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/544688fe-ab53-412e-8c38-e7c38dfd60b9-openshift-service-ca\") pod \"544688fe-ab53-412e-8c38-e7c38dfd60b9\" (UID: \"544688fe-ab53-412e-8c38-e7c38dfd60b9\") "
Nov 04 01:39:28.335412 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.335382    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/544688fe-ab53-412e-8c38-e7c38dfd60b9-openshift-service-ca" pod "544688fe-ab53-412e-8c38-e7c38dfd60b9" (UID: "544688fe-ab53-412e-8c38-e7c38dfd60b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:39:28.337039 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.337017    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-metrics-certs" pod "544688fe-ab53-412e-8c38-e7c38dfd60b9" (UID: "544688fe-ab53-412e-8c38-e7c38dfd60b9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:39:28.337514 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.337484    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-maas-api-tls" pod "544688fe-ab53-412e-8c38-e7c38dfd60b9" (UID: "544688fe-ab53-412e-8c38-e7c38dfd60b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:39:28.337709 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.337577    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/544688fe-ab53-412e-8c38-e7c38dfd60b9-kube-api-access-gtdbs" pod "544688fe-ab53-412e-8c38-e7c38dfd60b9" (UID: "544688fe-ab53-412e-8c38-e7c38dfd60b9"). InnerVolumeSpecName "kube-api-access-gtdbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:39:28.436594 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.436559    5572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/544688fe-ab53-412e-8c38-e7c38dfd60b9-openshift-service-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:28.436594 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.436595    5572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-metrics-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:28.436837 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.436611    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/544688fe-ab53-412e-8c38-e7c38dfd60b9-maas-api-tls\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:28.436837 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:28.436627    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtdbs\" (UniqueName: \"kubernetes.io/projected/544688fe-ab53-412e-8c38-e7c38dfd60b9-kube-api-access-gtdbs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:29.110463 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:29.110429    5572 generic.go:356] "Generic (PLEG): container finished" podID="544688fe-ab53-412e-8c38-e7c38dfd60b9" containerID="60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17" exitCode=0
Nov 04 01:39:29.111012 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:29.110468    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"
Nov 04 01:39:29.111012 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:29.110514    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t" event={"ID":"544688fe-ab53-412e-8c38-e7c38dfd60b9","Type":"ContainerDied","Data":"60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17"}
Nov 04 01:39:29.111012 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:29.110582    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t" event={"ID":"544688fe-ab53-412e-8c38-e7c38dfd60b9","Type":"ContainerDied","Data":"56ba4df176ed19ea9f683054c915eddcd4eca1f8b372f59131c38e64acd2d1c7"}
Nov 04 01:39:29.111012 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:29.110618    5572 scope.go:122] "RemoveContainer" containerID="60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17"
Nov 04 01:39:29.120429 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:29.120402    5572 scope.go:122] "RemoveContainer" containerID="60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17"
Nov 04 01:39:29.120783 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:39:29.120738    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17\": container with ID starting with 60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17 not found: ID does not exist" containerID="60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17"
Nov 04 01:39:29.120857 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:29.120796    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17"} err="failed to get container status \"60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17\": rpc error: code = NotFound desc = could not find container \"60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17\": container with ID starting with 60e47e79ed1946f21abc21fb351c73fe1df9a76f31d24781c4d1ad338925fb17 not found: ID does not exist"
Nov 04 01:39:29.263970 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:29.263890    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"]
Nov 04 01:39:29.309853 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:29.309818    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-a-6db2a7-7b5d4cf894-ttp2t"]
Nov 04 01:39:29.695574 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:29.695515    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:29.847852 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:29.847820    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:30.010016 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:30.009913    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:30.974952 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:30.974914    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="544688fe-ab53-412e-8c38-e7c38dfd60b9" path="/var/lib/kubelet/pods/544688fe-ab53-412e-8c38-e7c38dfd60b9/volumes"
Nov 04 01:39:31.458644 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:31.458614    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:32.124562 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:32.122062    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:32.969884 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:32.969846    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:35.889834 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:35.889773    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:38.915719 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:38.915683    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:41.151346 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:41.151310    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:42.691582 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:42.691525    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:42.853289 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:42.853254    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:43.199731 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:39:43.199698    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:39:45.637018 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:45.636985    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"]
Nov 04 01:39:45.637424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:45.637186    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t" podUID="09673ea1-4287-4dc1-b19b-5bfd5f6867dd" containerName="maas-api" containerID="cri-o://eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f" gracePeriod=30
Nov 04 01:39:45.746978 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:45.746939    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:45.918644 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:45.918613    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:39:46.062955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.062916    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-metrics-certs\" (UniqueName: \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-metrics-certs\") pod \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") "
Nov 04 01:39:46.063137 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.063074    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-kube-api-access-d8kc2\" (UniqueName: \"kubernetes.io/projected/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-kube-api-access-d8kc2\") pod \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") "
Nov 04 01:39:46.063137 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.063121    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-maas-api-tls\") pod \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") "
Nov 04 01:39:46.063264 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.063149    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-openshift-service-ca\") pod \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\" (UID: \"09673ea1-4287-4dc1-b19b-5bfd5f6867dd\") "
Nov 04 01:39:46.066146 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.066104    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-maas-api-tls" pod "09673ea1-4287-4dc1-b19b-5bfd5f6867dd" (UID: "09673ea1-4287-4dc1-b19b-5bfd5f6867dd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:39:46.066306 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.066181    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-metrics-certs" pod "09673ea1-4287-4dc1-b19b-5bfd5f6867dd" (UID: "09673ea1-4287-4dc1-b19b-5bfd5f6867dd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:39:46.066407 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.066388    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-kube-api-access-d8kc2" pod "09673ea1-4287-4dc1-b19b-5bfd5f6867dd" (UID: "09673ea1-4287-4dc1-b19b-5bfd5f6867dd"). InnerVolumeSpecName "kube-api-access-d8kc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:39:46.066523 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.066505    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-openshift-service-ca" pod "09673ea1-4287-4dc1-b19b-5bfd5f6867dd" (UID: "09673ea1-4287-4dc1-b19b-5bfd5f6867dd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:39:46.165108 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.165024    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8kc2\" (UniqueName: \"kubernetes.io/projected/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-kube-api-access-d8kc2\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:46.165108 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.165055    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-maas-api-tls\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:46.165108 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.165066    5572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-openshift-service-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:46.165108 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.165075    5572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09673ea1-4287-4dc1-b19b-5bfd5f6867dd-metrics-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:39:46.259415 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.259380    5572 generic.go:356] "Generic (PLEG): container finished" podID="09673ea1-4287-4dc1-b19b-5bfd5f6867dd" containerID="eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f" exitCode=0
Nov 04 01:39:46.259605 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.259422    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"
Nov 04 01:39:46.259605 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.259465    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t" event={"ID":"09673ea1-4287-4dc1-b19b-5bfd5f6867dd","Type":"ContainerDied","Data":"eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f"}
Nov 04 01:39:46.259605 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.259513    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t" event={"ID":"09673ea1-4287-4dc1-b19b-5bfd5f6867dd","Type":"ContainerDied","Data":"c62626e6c974aaebf38473ed217156cf33bedfe3a909ccf6ff3dc028a17724fd"}
Nov 04 01:39:46.259605 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.259548    5572 scope.go:122] "RemoveContainer" containerID="eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f"
Nov 04 01:39:46.269944 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.269925    5572 scope.go:122] "RemoveContainer" containerID="eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f"
Nov 04 01:39:46.270242 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:39:46.270223    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f\": container with ID starting with eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f not found: ID does not exist" containerID="eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f"
Nov 04 01:39:46.270308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.270251    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f"} err="failed to get container status \"eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f\": rpc error: code = NotFound desc = could not find container \"eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f\": container with ID starting with eb5158e32b914cef8a0ba7abaf2b142ed7d2ecb11ddb03bddf766f68d88d360f not found: ID does not exist"
Nov 04 01:39:46.412914 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.412874    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"]
Nov 04 01:39:46.417027 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.416965    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-d057d7-64c84dfdb-h2h5t"]
Nov 04 01:39:46.972782 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:46.972750    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09673ea1-4287-4dc1-b19b-5bfd5f6867dd" path="/var/lib/kubelet/pods/09673ea1-4287-4dc1-b19b-5bfd5f6867dd/volumes"
Nov 04 01:39:47.588578 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:47.588525    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:52.094205 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:52.094168    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:52.240733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:52.240696    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:52.695665 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:52.695634    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:53.478338 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:53.478302    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:53.628689 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:53.628655    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:54.089095 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:54.089064    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:55.157010 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:55.156973    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:55.714590 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:55.714550    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"]
Nov 04 01:39:55.714862 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:55.714835    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy" containerID="cri-o://829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396" gracePeriod=30
Nov 04 01:39:55.720937 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:55.720909    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:56.199212 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:56.199178    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:57.641854 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:57.641820    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:58.113314 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:58.113281    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:39:58.389618 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:58.389519    5572 patch_prober.go:29] interesting pod/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 01:39:58.389618 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:58.389592    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 01:39:59.066214 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:59.066181    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"]
Nov 04 01:39:59.243665 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:39:59.243629    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:00.974347 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:00.974323    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:40:01.135620 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.135518    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-credential-socket\") pod \"96739365-8b06-4d74-b82b-db47e3de3f3c\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") "
Nov 04 01:40:01.135850 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.135827    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-podinfo\") pod \"96739365-8b06-4d74-b82b-db47e3de3f3c\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") "
Nov 04 01:40:01.135976 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.135959    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-envoy\") pod \"96739365-8b06-4d74-b82b-db47e3de3f3c\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") "
Nov 04 01:40:01.136037 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.135995    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-token\" (UniqueName: \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-token\") pod \"96739365-8b06-4d74-b82b-db47e3de3f3c\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") "
Nov 04 01:40:01.136096 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.136070    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96739365-8b06-4d74-b82b-db47e3de3f3c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96739365-8b06-4d74-b82b-db47e3de3f3c-istiod-ca-cert\") pod \"96739365-8b06-4d74-b82b-db47e3de3f3c\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") "
Nov 04 01:40:01.136151 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.136105    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-socket\") pod \"96739365-8b06-4d74-b82b-db47e3de3f3c\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") "
Nov 04 01:40:01.136206 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.136159    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-data\") pod \"96739365-8b06-4d74-b82b-db47e3de3f3c\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") "
Nov 04 01:40:01.136258 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.136239    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-certs\") pod \"96739365-8b06-4d74-b82b-db47e3de3f3c\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") "
Nov 04 01:40:01.136312 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.136283    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-kube-api-access-w5fdn\" (UniqueName: \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-kube-api-access-w5fdn\") pod \"96739365-8b06-4d74-b82b-db47e3de3f3c\" (UID: \"96739365-8b06-4d74-b82b-db47e3de3f3c\") "
Nov 04 01:40:01.137356 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.137326    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-socket" pod "96739365-8b06-4d74-b82b-db47e3de3f3c" (UID: "96739365-8b06-4d74-b82b-db47e3de3f3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:01.137602 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.137506    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-credential-socket" pod "96739365-8b06-4d74-b82b-db47e3de3f3c" (UID: "96739365-8b06-4d74-b82b-db47e3de3f3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:01.137725 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.137660    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96739365-8b06-4d74-b82b-db47e3de3f3c-istiod-ca-cert" pod "96739365-8b06-4d74-b82b-db47e3de3f3c" (UID: "96739365-8b06-4d74-b82b-db47e3de3f3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:40:01.138749 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.138649    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-data" pod "96739365-8b06-4d74-b82b-db47e3de3f3c" (UID: "96739365-8b06-4d74-b82b-db47e3de3f3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:01.138749 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.138724    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-certs" pod "96739365-8b06-4d74-b82b-db47e3de3f3c" (UID: "96739365-8b06-4d74-b82b-db47e3de3f3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:01.139976 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.139949    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-podinfo" pod "96739365-8b06-4d74-b82b-db47e3de3f3c" (UID: "96739365-8b06-4d74-b82b-db47e3de3f3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:40:01.140961 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.140933    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-kube-api-access-w5fdn" pod "96739365-8b06-4d74-b82b-db47e3de3f3c" (UID: "96739365-8b06-4d74-b82b-db47e3de3f3c"). InnerVolumeSpecName "kube-api-access-w5fdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:01.141210 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.141191    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-envoy" pod "96739365-8b06-4d74-b82b-db47e3de3f3c" (UID: "96739365-8b06-4d74-b82b-db47e3de3f3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:01.142647 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.142619    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-token" pod "96739365-8b06-4d74-b82b-db47e3de3f3c" (UID: "96739365-8b06-4d74-b82b-db47e3de3f3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:01.181823 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.181790    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"]
Nov 04 01:40:01.183959 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.183932    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"]
Nov 04 01:40:01.193570 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.193525    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"]
Nov 04 01:40:01.237407 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.237374    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96739365-8b06-4d74-b82b-db47e3de3f3c-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:01.237407 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.237399    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:01.237407 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.237411    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:01.237746 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.237421    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:01.237746 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.237430    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5fdn\" (UniqueName: \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-kube-api-access-w5fdn\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:01.237746 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.237440    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:01.237746 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.237448    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:01.237746 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.237456    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:01.237746 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.237464    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96739365-8b06-4d74-b82b-db47e3de3f3c-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:01.341849 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.341817    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:01.363996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.363969    5572 generic.go:356] "Generic (PLEG): container finished" podID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerID="829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396" exitCode=0
Nov 04 01:40:01.364152 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.364019    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"
Nov 04 01:40:01.364152 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.364062    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" event={"ID":"96739365-8b06-4d74-b82b-db47e3de3f3c","Type":"ContainerDied","Data":"829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396"}
Nov 04 01:40:01.364152 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.364120    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc" event={"ID":"96739365-8b06-4d74-b82b-db47e3de3f3c","Type":"ContainerDied","Data":"11a0c38de56511110183c84d1d30529cc0ae02092a46f44365c24977b5ce280b"}
Nov 04 01:40:01.364259 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.364150    5572 scope.go:122] "RemoveContainer" containerID="829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396"
Nov 04 01:40:01.374322 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.374305    5572 scope.go:122] "RemoveContainer" containerID="5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0"
Nov 04 01:40:01.383243 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.383226    5572 scope.go:122] "RemoveContainer" containerID="829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396"
Nov 04 01:40:01.383493 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:40:01.383475    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396\": container with ID starting with 829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396 not found: ID does not exist" containerID="829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396"
Nov 04 01:40:01.383552 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.383501    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396"} err="failed to get container status \"829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396\": rpc error: code = NotFound desc = could not find container \"829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396\": container with ID starting with 829b59adb63ebc5ca9feed8c0561d4dc93cb2f3829504b42d4f03cb885306396 not found: ID does not exist"
Nov 04 01:40:01.383552 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.383518    5572 scope.go:122] "RemoveContainer" containerID="5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0"
Nov 04 01:40:01.383756 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:40:01.383739    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0\": container with ID starting with 5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0 not found: ID does not exist" containerID="5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0"
Nov 04 01:40:01.383798 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.383763    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0"} err="failed to get container status \"5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0\": rpc error: code = NotFound desc = could not find container \"5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0\": container with ID starting with 5d4ef32ae72c6f1e3111513f6dacd2c561526827703a7e15eec7b22c5e96e5a0 not found: ID does not exist"
Nov 04 01:40:01.637370 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.637339    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"]
Nov 04 01:40:01.642085 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:01.642055    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-d057d7-openshift-default-6654f4d8fc-g6vwc"]
Nov 04 01:40:02.972828 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:02.972793    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" path="/var/lib/kubelet/pods/96739365-8b06-4d74-b82b-db47e3de3f3c/volumes"
Nov 04 01:40:03.047440 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:03.047407    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:03.388383 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:03.388306    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:05.382910 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:05.382865    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:08.508482 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:08.508449    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:11.917981 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:11.917943    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:13.219502 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:40:13.219447    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:40:13.834181 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:13.834141    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:14.097869 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.097768    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr" podUID="995275c6-2b01-461d-8828-520738a32839" containerName="main" containerID="cri-o://9511af3ac1dbefa8ede83c036c51b2309424238d2692c4087bc01a7fb8110ca6" gracePeriod=45
Nov 04 01:40:14.465563 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.452033    5572 generic.go:356] "Generic (PLEG): container finished" podID="995275c6-2b01-461d-8828-520738a32839" containerID="9511af3ac1dbefa8ede83c036c51b2309424238d2692c4087bc01a7fb8110ca6" exitCode=0
Nov 04 01:40:14.465563 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.452235    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr" event={"ID":"995275c6-2b01-461d-8828-520738a32839","Type":"ContainerDied","Data":"9511af3ac1dbefa8ede83c036c51b2309424238d2692c4087bc01a7fb8110ca6"}
Nov 04 01:40:14.568557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.567459    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:40:14.732933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.722059    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-model-cache\") pod \"995275c6-2b01-461d-8828-520738a32839\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") "
Nov 04 01:40:14.732933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.725625    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-model-cache" pod "995275c6-2b01-461d-8828-520738a32839" (UID: "995275c6-2b01-461d-8828-520738a32839"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:14.732933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.725760    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/995275c6-2b01-461d-8828-520738a32839-kube-api-access-675tr\" (UniqueName: \"kubernetes.io/projected/995275c6-2b01-461d-8828-520738a32839-kube-api-access-675tr\") pod \"995275c6-2b01-461d-8828-520738a32839\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") "
Nov 04 01:40:14.732933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.725813    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/995275c6-2b01-461d-8828-520738a32839-tls-certs\" (UniqueName: \"kubernetes.io/secret/995275c6-2b01-461d-8828-520738a32839-tls-certs\") pod \"995275c6-2b01-461d-8828-520738a32839\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") "
Nov 04 01:40:14.732933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.725873    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-dshm\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-dshm\") pod \"995275c6-2b01-461d-8828-520738a32839\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") "
Nov 04 01:40:14.732933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.725897    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-home\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-home\") pod \"995275c6-2b01-461d-8828-520738a32839\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") "
Nov 04 01:40:14.732933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.725973    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-tmp-dir\") pod \"995275c6-2b01-461d-8828-520738a32839\" (UID: \"995275c6-2b01-461d-8828-520738a32839\") "
Nov 04 01:40:14.732933 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.726390    5572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-model-cache\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:14.738566 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.735688    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-tmp-dir" pod "995275c6-2b01-461d-8828-520738a32839" (UID: "995275c6-2b01-461d-8828-520738a32839"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:14.738566 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.736623    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-home" pod "995275c6-2b01-461d-8828-520738a32839" (UID: "995275c6-2b01-461d-8828-520738a32839"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:14.740640 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.739579    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-dshm" pod "995275c6-2b01-461d-8828-520738a32839" (UID: "995275c6-2b01-461d-8828-520738a32839"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:14.742581 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.742517    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/995275c6-2b01-461d-8828-520738a32839-tls-certs" pod "995275c6-2b01-461d-8828-520738a32839" (UID: "995275c6-2b01-461d-8828-520738a32839"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:40:14.743512 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.743486    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995275c6-2b01-461d-8828-520738a32839-kube-api-access-675tr" pod "995275c6-2b01-461d-8828-520738a32839" (UID: "995275c6-2b01-461d-8828-520738a32839"). InnerVolumeSpecName "kube-api-access-675tr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:14.835658 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.802205    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:14.835658 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.829267    5572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-tmp-dir\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:14.835658 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.829304    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-675tr\" (UniqueName: \"kubernetes.io/projected/995275c6-2b01-461d-8828-520738a32839-kube-api-access-675tr\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:14.835658 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.829320    5572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/995275c6-2b01-461d-8828-520738a32839-tls-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:14.835658 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.829334    5572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-dshm\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:14.835658 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.829347    5572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/995275c6-2b01-461d-8828-520738a32839-home\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:14.964556 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:14.964445    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:15.504506 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:15.504469    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr" event={"ID":"995275c6-2b01-461d-8828-520738a32839","Type":"ContainerDied","Data":"095d010e765290b0bdb8cfee57323d08b3c8e8e92a2f744f207025443072cbdd"}
Nov 04 01:40:15.505110 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:15.505087    5572 scope.go:122] "RemoveContainer" containerID="9511af3ac1dbefa8ede83c036c51b2309424238d2692c4087bc01a7fb8110ca6"
Nov 04 01:40:15.505382 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:15.505362    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"
Nov 04 01:40:15.687588 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:15.681418    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"]
Nov 04 01:40:15.737142 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:15.737103    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-b2eadb/simulator-w4-b2eadb-kserve-865bcd8687-9pdfr"]
Nov 04 01:40:16.203261 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.203218    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7" podUID="64a889d9-1a4b-4230-8110-b2c9a09af77c" containerName="main" containerID="cri-o://f563ea2bdc419f40ba4d1046aae6746f0136a95a30b2f44606aa70f7bba67a05" gracePeriod=45
Nov 04 01:40:16.203424 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.203218    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d" podUID="66385f48-67a4-4a7b-8f65-b780eb1711f7" containerName="main" containerID="cri-o://e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4" gracePeriod=45
Nov 04 01:40:16.213384 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.213349    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d" podUID="66385f48-67a4-4a7b-8f65-b780eb1711f7" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": dial tcp 10.133.0.59:8000: connect: connection refused"
Nov 04 01:40:16.215972 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.215942    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz" podUID="0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" containerName="main" containerID="cri-o://66ddb4bd9328f72719bc1934fac6a8e51fc1e2699fb10bbd1aed1992228e9114" gracePeriod=45
Nov 04 01:40:16.502203 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.502175    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:40:16.515017 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.514987    5572 generic.go:356] "Generic (PLEG): container finished" podID="66385f48-67a4-4a7b-8f65-b780eb1711f7" containerID="e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4" exitCode=0
Nov 04 01:40:16.515435 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.515020    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d" event={"ID":"66385f48-67a4-4a7b-8f65-b780eb1711f7","Type":"ContainerDied","Data":"e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4"}
Nov 04 01:40:16.515435 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.515041    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"
Nov 04 01:40:16.515435 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.515065    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d" event={"ID":"66385f48-67a4-4a7b-8f65-b780eb1711f7","Type":"ContainerDied","Data":"0e20339baf2946b39dafae90bd11f317e13a1f31afc585b84336fb97a364c56a"}
Nov 04 01:40:16.515435 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.515086    5572 scope.go:122] "RemoveContainer" containerID="e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4"
Nov 04 01:40:16.516977 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.516960    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:40:16.517095 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.517069    5572 generic.go:356] "Generic (PLEG): container finished" podID="0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" containerID="66ddb4bd9328f72719bc1934fac6a8e51fc1e2699fb10bbd1aed1992228e9114" exitCode=0
Nov 04 01:40:16.517218 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.517154    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz" event={"ID":"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f","Type":"ContainerDied","Data":"66ddb4bd9328f72719bc1934fac6a8e51fc1e2699fb10bbd1aed1992228e9114"}
Nov 04 01:40:16.519095 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.519076    5572 generic.go:356] "Generic (PLEG): container finished" podID="64a889d9-1a4b-4230-8110-b2c9a09af77c" containerID="f563ea2bdc419f40ba4d1046aae6746f0136a95a30b2f44606aa70f7bba67a05" exitCode=0
Nov 04 01:40:16.519195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.519106    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"
Nov 04 01:40:16.519195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.519162    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7" event={"ID":"64a889d9-1a4b-4230-8110-b2c9a09af77c","Type":"ContainerDied","Data":"f563ea2bdc419f40ba4d1046aae6746f0136a95a30b2f44606aa70f7bba67a05"}
Nov 04 01:40:16.527284 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.527256    5572 scope.go:122] "RemoveContainer" containerID="e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4"
Nov 04 01:40:16.527610 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:40:16.527587    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4\": container with ID starting with e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4 not found: ID does not exist" containerID="e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4"
Nov 04 01:40:16.527683 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.527618    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4"} err="failed to get container status \"e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4\": rpc error: code = NotFound desc = could not find container \"e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4\": container with ID starting with e89f1b0ba97a1e3f7201fafdfc664d405f433c076dde20aab6d72e3ffbbd88c4 not found: ID does not exist"
Nov 04 01:40:16.527683 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.527635    5572 scope.go:122] "RemoveContainer" containerID="f563ea2bdc419f40ba4d1046aae6746f0136a95a30b2f44606aa70f7bba67a05"
Nov 04 01:40:16.530255 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.530238    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:40:16.652293 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652260    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64a889d9-1a4b-4230-8110-b2c9a09af77c-kube-api-access-xfpjt\" (UniqueName: \"kubernetes.io/projected/64a889d9-1a4b-4230-8110-b2c9a09af77c-kube-api-access-xfpjt\") pod \"64a889d9-1a4b-4230-8110-b2c9a09af77c\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") "
Nov 04 01:40:16.652486 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652312    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66385f48-67a4-4a7b-8f65-b780eb1711f7-tls-certs\" (UniqueName: \"kubernetes.io/secret/66385f48-67a4-4a7b-8f65-b780eb1711f7-tls-certs\") pod \"66385f48-67a4-4a7b-8f65-b780eb1711f7\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") "
Nov 04 01:40:16.652486 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652342    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-tmp-dir\") pod \"66385f48-67a4-4a7b-8f65-b780eb1711f7\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") "
Nov 04 01:40:16.652705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652576    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-dshm\") pod \"64a889d9-1a4b-4230-8110-b2c9a09af77c\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") "
Nov 04 01:40:16.652705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652593    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-tmp-dir" pod "66385f48-67a4-4a7b-8f65-b780eb1711f7" (UID: "66385f48-67a4-4a7b-8f65-b780eb1711f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.652705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652630    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-model-cache\") pod \"66385f48-67a4-4a7b-8f65-b780eb1711f7\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") "
Nov 04 01:40:16.652705 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652692    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-home\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-home\") pod \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") "
Nov 04 01:40:16.652918 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652726    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tls-certs\") pod \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") "
Nov 04 01:40:16.652918 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652764    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-tmp-dir\") pod \"64a889d9-1a4b-4230-8110-b2c9a09af77c\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") "
Nov 04 01:40:16.652918 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652793    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tmp-dir\") pod \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") "
Nov 04 01:40:16.652918 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652837    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/64a889d9-1a4b-4230-8110-b2c9a09af77c-tls-certs\" (UniqueName: \"kubernetes.io/secret/64a889d9-1a4b-4230-8110-b2c9a09af77c-tls-certs\") pod \"64a889d9-1a4b-4230-8110-b2c9a09af77c\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") "
Nov 04 01:40:16.652918 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652871    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-model-cache" pod "66385f48-67a4-4a7b-8f65-b780eb1711f7" (UID: "66385f48-67a4-4a7b-8f65-b780eb1711f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.652918 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652872    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66385f48-67a4-4a7b-8f65-b780eb1711f7-kube-api-access-8wlrw\" (UniqueName: \"kubernetes.io/projected/66385f48-67a4-4a7b-8f65-b780eb1711f7-kube-api-access-8wlrw\") pod \"66385f48-67a4-4a7b-8f65-b780eb1711f7\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") "
Nov 04 01:40:16.653220 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652939    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-model-cache\") pod \"64a889d9-1a4b-4230-8110-b2c9a09af77c\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") "
Nov 04 01:40:16.653220 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.652969    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-model-cache\") pod \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") "
Nov 04 01:40:16.653220 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653006    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-kube-api-access-wr7wb\" (UniqueName: \"kubernetes.io/projected/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-kube-api-access-wr7wb\") pod \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") "
Nov 04 01:40:16.653220 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653087    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-home\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-home\") pod \"66385f48-67a4-4a7b-8f65-b780eb1711f7\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") "
Nov 04 01:40:16.653220 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653089    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-home" pod "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" (UID: "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.653220 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653113    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-dshm\") pod \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\" (UID: \"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f\") "
Nov 04 01:40:16.653220 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653131    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-dshm\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-dshm\") pod \"66385f48-67a4-4a7b-8f65-b780eb1711f7\" (UID: \"66385f48-67a4-4a7b-8f65-b780eb1711f7\") "
Nov 04 01:40:16.653220 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653182    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-home\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-home\") pod \"64a889d9-1a4b-4230-8110-b2c9a09af77c\" (UID: \"64a889d9-1a4b-4230-8110-b2c9a09af77c\") "
Nov 04 01:40:16.653661 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653268    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tmp-dir" pod "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" (UID: "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.653661 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653503    5572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-tmp-dir\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.653661 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653523    5572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-model-cache\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.653661 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653549    5572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-home\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.653661 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653563    5572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tmp-dir\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.653928 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.653759    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-home" pod "64a889d9-1a4b-4230-8110-b2c9a09af77c" (UID: "64a889d9-1a4b-4230-8110-b2c9a09af77c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.654652 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.654236    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-home" pod "66385f48-67a4-4a7b-8f65-b780eb1711f7" (UID: "66385f48-67a4-4a7b-8f65-b780eb1711f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.654652 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.654329    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-model-cache" pod "64a889d9-1a4b-4230-8110-b2c9a09af77c" (UID: "64a889d9-1a4b-4230-8110-b2c9a09af77c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.654652 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.654553    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-model-cache" pod "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" (UID: "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.654652 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.654606    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-tmp-dir" pod "64a889d9-1a4b-4230-8110-b2c9a09af77c" (UID: "64a889d9-1a4b-4230-8110-b2c9a09af77c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.655272 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.655194    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66385f48-67a4-4a7b-8f65-b780eb1711f7-tls-certs" pod "66385f48-67a4-4a7b-8f65-b780eb1711f7" (UID: "66385f48-67a4-4a7b-8f65-b780eb1711f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:40:16.656425 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.656264    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-kube-api-access-wr7wb" pod "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" (UID: "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f"). InnerVolumeSpecName "kube-api-access-wr7wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:16.656425 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.656386    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64a889d9-1a4b-4230-8110-b2c9a09af77c-tls-certs" pod "64a889d9-1a4b-4230-8110-b2c9a09af77c" (UID: "64a889d9-1a4b-4230-8110-b2c9a09af77c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:40:16.656650 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.656430    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a889d9-1a4b-4230-8110-b2c9a09af77c-kube-api-access-xfpjt" pod "64a889d9-1a4b-4230-8110-b2c9a09af77c" (UID: "64a889d9-1a4b-4230-8110-b2c9a09af77c"). InnerVolumeSpecName "kube-api-access-xfpjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:16.657349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.657323    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66385f48-67a4-4a7b-8f65-b780eb1711f7-kube-api-access-8wlrw" pod "66385f48-67a4-4a7b-8f65-b780eb1711f7" (UID: "66385f48-67a4-4a7b-8f65-b780eb1711f7"). InnerVolumeSpecName "kube-api-access-8wlrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:16.657455 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.657432    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-dshm" pod "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" (UID: "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.657956 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.657928    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tls-certs" pod "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" (UID: "0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:40:16.657956 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.657942    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-dshm" pod "66385f48-67a4-4a7b-8f65-b780eb1711f7" (UID: "66385f48-67a4-4a7b-8f65-b780eb1711f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.658127 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.658037    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-dshm" pod "64a889d9-1a4b-4230-8110-b2c9a09af77c" (UID: "64a889d9-1a4b-4230-8110-b2c9a09af77c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:16.754366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754287    5572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-home\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754313    5572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-dshm\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754322    5572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66385f48-67a4-4a7b-8f65-b780eb1711f7-dshm\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754332    5572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-home\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754346    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfpjt\" (UniqueName: \"kubernetes.io/projected/64a889d9-1a4b-4230-8110-b2c9a09af77c-kube-api-access-xfpjt\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754356    5572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66385f48-67a4-4a7b-8f65-b780eb1711f7-tls-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754364    5572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-dshm\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754366 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754372    5572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-tls-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754380    5572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-tmp-dir\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754390    5572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64a889d9-1a4b-4230-8110-b2c9a09af77c-tls-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754398    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wlrw\" (UniqueName: \"kubernetes.io/projected/66385f48-67a4-4a7b-8f65-b780eb1711f7-kube-api-access-8wlrw\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754407    5572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64a889d9-1a4b-4230-8110-b2c9a09af77c-model-cache\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754415    5572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-model-cache\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.754726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.754424    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr7wb\" (UniqueName: \"kubernetes.io/projected/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f-kube-api-access-wr7wb\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:16.972342 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.972311    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="995275c6-2b01-461d-8828-520738a32839" path="/var/lib/kubelet/pods/995275c6-2b01-461d-8828-520738a32839/volumes"
Nov 04 01:40:16.988613 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.988587    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"]
Nov 04 01:40:16.994840 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:16.994817    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-2-w2-00cfe6-kserve-58fb495886-t266d"]
Nov 04 01:40:17.110168 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:17.099604    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"]
Nov 04 01:40:17.112577 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:17.112527    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/distinct-w2-00cfe6-kserve-f76dd9b9-r9sg7"]
Nov 04 01:40:17.480104 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:17.480058    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz" podUID="0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 01:40:17.491015 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:17.490984    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:17.528385 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:17.528351    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz" event={"ID":"0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f","Type":"ContainerDied","Data":"7d261f1f89f78818f6dc722c8ffa97e07aafe271755bcc3cf5aa38901561fae2"}
Nov 04 01:40:17.528865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:17.528363    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"
Nov 04 01:40:17.528865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:17.528403    5572 scope.go:122] "RemoveContainer" containerID="66ddb4bd9328f72719bc1934fac6a8e51fc1e2699fb10bbd1aed1992228e9114"
Nov 04 01:40:17.680833 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:17.680797    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"]
Nov 04 01:40:17.687863 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:17.687834    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-00cfe6/simulator-w2-00cfe6-kserve-54fc8d4d6c-pzgdz"]
Nov 04 01:40:18.162956 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:18.162919    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:18.972417 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:18.972382    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" path="/var/lib/kubelet/pods/0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f/volumes"
Nov 04 01:40:18.972831 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:18.972820    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64a889d9-1a4b-4230-8110-b2c9a09af77c" path="/var/lib/kubelet/pods/64a889d9-1a4b-4230-8110-b2c9a09af77c/volumes"
Nov 04 01:40:18.973183 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:18.973170    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66385f48-67a4-4a7b-8f65-b780eb1711f7" path="/var/lib/kubelet/pods/66385f48-67a4-4a7b-8f65-b780eb1711f7/volumes"
Nov 04 01:40:19.304863 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:19.304782    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:22.885923 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:22.885887    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"]
Nov 04 01:40:23.216188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:23.216148    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:23.360176 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:23.360137    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:24.100926 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:24.100888    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:24.504285 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:24.504245    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:24.649372 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:24.649334    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:27.886707 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:27.886663    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg" podUID="62ae3dce-4771-4dc6-8db5-9c4266e8b49b" containerName="payload-pre-processing" containerID="cri-o://bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73" gracePeriod=25
Nov 04 01:40:29.720346 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:29.720304    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:30.033715 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:30.033626    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:32.199197 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:32.199164    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg" podUID="62ae3dce-4771-4dc6-8db5-9c4266e8b49b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 01:40:35.294137 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:35.294095    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:36.472185 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:36.472138    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:37.265031 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:37.264991    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:37.463947 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:37.463913    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:37.793132 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:37.793089    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:39.097756 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:39.097719    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:39.248653 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:39.248613    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:39.706796 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:39.706754    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"]
Nov 04 01:40:39.707006 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:39.706980    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g" podUID="d15eec1d-2ec7-474d-a077-71869a0ea48d" containerName="maas-api" containerID="cri-o://f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa" gracePeriod=30
Nov 04 01:40:39.774190 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:39.774155    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:39.927029 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:39.926991    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:39.972924 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:39.972858    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:40:40.086561 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.086520    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d15eec1d-2ec7-474d-a077-71869a0ea48d-kube-api-access-szt8m\" (UniqueName: \"kubernetes.io/projected/d15eec1d-2ec7-474d-a077-71869a0ea48d-kube-api-access-szt8m\") pod \"d15eec1d-2ec7-474d-a077-71869a0ea48d\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") "
Nov 04 01:40:40.086730 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.086598    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d15eec1d-2ec7-474d-a077-71869a0ea48d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d15eec1d-2ec7-474d-a077-71869a0ea48d-openshift-service-ca\") pod \"d15eec1d-2ec7-474d-a077-71869a0ea48d\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") "
Nov 04 01:40:40.086730 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.086641    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-maas-api-tls\") pod \"d15eec1d-2ec7-474d-a077-71869a0ea48d\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") "
Nov 04 01:40:40.086847 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.086798    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-metrics-certs\") pod \"d15eec1d-2ec7-474d-a077-71869a0ea48d\" (UID: \"d15eec1d-2ec7-474d-a077-71869a0ea48d\") "
Nov 04 01:40:40.086940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.086918    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d15eec1d-2ec7-474d-a077-71869a0ea48d-openshift-service-ca" pod "d15eec1d-2ec7-474d-a077-71869a0ea48d" (UID: "d15eec1d-2ec7-474d-a077-71869a0ea48d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:40:40.087207 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.087187    5572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d15eec1d-2ec7-474d-a077-71869a0ea48d-openshift-service-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:40.088848 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.088824    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-metrics-certs" pod "d15eec1d-2ec7-474d-a077-71869a0ea48d" (UID: "d15eec1d-2ec7-474d-a077-71869a0ea48d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:40:40.089087 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.089059    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-maas-api-tls" pod "d15eec1d-2ec7-474d-a077-71869a0ea48d" (UID: "d15eec1d-2ec7-474d-a077-71869a0ea48d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:40:40.089202 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.089165    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d15eec1d-2ec7-474d-a077-71869a0ea48d-kube-api-access-szt8m" pod "d15eec1d-2ec7-474d-a077-71869a0ea48d" (UID: "d15eec1d-2ec7-474d-a077-71869a0ea48d"). InnerVolumeSpecName "kube-api-access-szt8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:40.188830 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.188789    5572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-metrics-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:40.188830 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.188820    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szt8m\" (UniqueName: \"kubernetes.io/projected/d15eec1d-2ec7-474d-a077-71869a0ea48d-kube-api-access-szt8m\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:40.188830 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.188834    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d15eec1d-2ec7-474d-a077-71869a0ea48d-maas-api-tls\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:40.655089 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.655053    5572 generic.go:356] "Generic (PLEG): container finished" podID="d15eec1d-2ec7-474d-a077-71869a0ea48d" containerID="f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa" exitCode=0
Nov 04 01:40:40.655292 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.655099    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"
Nov 04 01:40:40.655292 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.655151    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g" event={"ID":"d15eec1d-2ec7-474d-a077-71869a0ea48d","Type":"ContainerDied","Data":"f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa"}
Nov 04 01:40:40.655292 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.655210    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g" event={"ID":"d15eec1d-2ec7-474d-a077-71869a0ea48d","Type":"ContainerDied","Data":"e4613a83a604a18cc582c781c2196eb9b1c2fa2e94527efd4b0ab0acd0dea2d2"}
Nov 04 01:40:40.655292 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.655241    5572 scope.go:122] "RemoveContainer" containerID="f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa"
Nov 04 01:40:40.665271 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.665255    5572 scope.go:122] "RemoveContainer" containerID="f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa"
Nov 04 01:40:40.665584 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:40:40.665557    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa\": container with ID starting with f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa not found: ID does not exist" containerID="f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa"
Nov 04 01:40:40.665648 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.665595    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa"} err="failed to get container status \"f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa\": rpc error: code = NotFound desc = could not find container \"f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa\": container with ID starting with f543a3a2c33ee3ee8c543b247b104ee837b44dc8d9aa6c7ad4adfdd6fd82b4fa not found: ID does not exist"
Nov 04 01:40:40.809098 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.809058    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"]
Nov 04 01:40:40.855471 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.855428    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-00cfe6-8459c68bcc-xhq4g"]
Nov 04 01:40:40.972628 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:40.972585    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d15eec1d-2ec7-474d-a077-71869a0ea48d" path="/var/lib/kubelet/pods/d15eec1d-2ec7-474d-a077-71869a0ea48d/volumes"
Nov 04 01:40:41.261341 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261267    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"]
Nov 04 01:40:41.261733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261711    5572 cpu_manager.go:414] "containerMap: removing container" podUID="d15eec1d-2ec7-474d-a077-71869a0ea48d" containerName="maas-api"
Nov 04 01:40:41.261733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261723    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d15eec1d-2ec7-474d-a077-71869a0ea48d" containerName="maas-api"
Nov 04 01:40:41.261733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261732    5572 cpu_manager.go:414] "containerMap: removing container" podUID="66385f48-67a4-4a7b-8f65-b780eb1711f7" containerName="main"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261737    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66385f48-67a4-4a7b-8f65-b780eb1711f7" containerName="main"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261744    5572 cpu_manager.go:414] "containerMap: removing container" podUID="22838154-4a76-49f3-8d58-d2410f636389" containerName="maas-api"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261749    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22838154-4a76-49f3-8d58-d2410f636389" containerName="maas-api"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261762    5572 cpu_manager.go:414] "containerMap: removing container" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261767    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261781    5572 cpu_manager.go:414] "containerMap: removing container" podUID="c296b226-17b6-47a1-82cc-03dacd75da0d" containerName="istio-proxy"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261785    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c296b226-17b6-47a1-82cc-03dacd75da0d" containerName="istio-proxy"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261798    5572 cpu_manager.go:414] "containerMap: removing container" podUID="0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" containerName="main"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261802    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" containerName="main"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261810    5572 cpu_manager.go:414] "containerMap: removing container" podUID="995275c6-2b01-461d-8828-520738a32839" containerName="main"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261814    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="995275c6-2b01-461d-8828-520738a32839" containerName="main"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261821    5572 cpu_manager.go:414] "containerMap: removing container" podUID="e2327580-e346-4424-bb30-156c284120de" containerName="istio-proxy"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261826    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e2327580-e346-4424-bb30-156c284120de" containerName="istio-proxy"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261834    5572 cpu_manager.go:414] "containerMap: removing container" podUID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" containerName="istio-proxy"
Nov 04 01:40:41.261832 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261838    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" containerName="istio-proxy"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261844    5572 cpu_manager.go:414] "containerMap: removing container" podUID="544688fe-ab53-412e-8c38-e7c38dfd60b9" containerName="maas-api"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261850    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="544688fe-ab53-412e-8c38-e7c38dfd60b9" containerName="maas-api"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261855    5572 cpu_manager.go:414] "containerMap: removing container" podUID="09673ea1-4287-4dc1-b19b-5bfd5f6867dd" containerName="maas-api"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261860    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09673ea1-4287-4dc1-b19b-5bfd5f6867dd" containerName="maas-api"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261870    5572 cpu_manager.go:414] "containerMap: removing container" podUID="d7096915-73db-4075-aa66-e778190eb397" containerName="istio-proxy"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261875    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7096915-73db-4075-aa66-e778190eb397" containerName="istio-proxy"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261886    5572 cpu_manager.go:414] "containerMap: removing container" podUID="82b10dc5-1cdd-4442-9b25-f379e6a16b07" containerName="payload-processing"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261890    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82b10dc5-1cdd-4442-9b25-f379e6a16b07" containerName="payload-processing"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261896    5572 cpu_manager.go:414] "containerMap: removing container" podUID="9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" containerName="main"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261901    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" containerName="main"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261906    5572 cpu_manager.go:414] "containerMap: removing container" podUID="64a889d9-1a4b-4230-8110-b2c9a09af77c" containerName="main"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261911    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64a889d9-1a4b-4230-8110-b2c9a09af77c" containerName="main"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261971    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d3eb4a9-fa39-40f5-b7a6-769a6b7eb75f" containerName="main"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261977    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="995275c6-2b01-461d-8828-520738a32839" containerName="main"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261983    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="e2327580-e346-4424-bb30-156c284120de" containerName="istio-proxy"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261989    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f0152d2-ed01-4c4e-87a6-8d8aae72cffc" containerName="istio-proxy"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261994    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="544688fe-ab53-412e-8c38-e7c38dfd60b9" containerName="maas-api"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.261999    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="09673ea1-4287-4dc1-b19b-5bfd5f6867dd" containerName="maas-api"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.262005    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7096915-73db-4075-aa66-e778190eb397" containerName="istio-proxy"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.262011    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="82b10dc5-1cdd-4442-9b25-f379e6a16b07" containerName="payload-processing"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.262017    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e6d5295-bee1-4c67-8e1b-2ae1b8c90e32" containerName="main"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.262022    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="64a889d9-1a4b-4230-8110-b2c9a09af77c" containerName="main"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.262028    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.262034    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="d15eec1d-2ec7-474d-a077-71869a0ea48d" containerName="maas-api"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.262039    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="66385f48-67a4-4a7b-8f65-b780eb1711f7" containerName="main"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.262044    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="22838154-4a76-49f3-8d58-d2410f636389" containerName="maas-api"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.262050    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy"
Nov 04 01:40:41.262266 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.262057    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="c296b226-17b6-47a1-82cc-03dacd75da0d" containerName="istio-proxy"
Nov 04 01:40:41.266417 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.266399    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.277336 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.277314    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"]
Nov 04 01:40:41.277841 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.277822    5572 cpu_manager.go:414] "containerMap: removing container" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy"
Nov 04 01:40:41.277906 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.277843    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96739365-8b06-4d74-b82b-db47e3de3f3c" containerName="istio-proxy"
Nov 04 01:40:41.280916 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.280896    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.300096 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.300067    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.300233 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.300105    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.300233 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.300126    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.300233 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.300196    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.300233 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.300232    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqppl\" (UniqueName: \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-kube-api-access-cqppl\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.300406 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.300305    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.300406 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.300342    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25bbddb2-e3ec-4490-aefa-66f1c7075210-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.300406 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.300361    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.300406 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.300395    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.315616 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.315594    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-b2eadb-openshift-default-dockercfg-b9qd7\""
Nov 04 01:40:41.328186 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.328162    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"]
Nov 04 01:40:41.369497 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.369469    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"]
Nov 04 01:40:41.401676 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.401648    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.401831 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.401683    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.401831 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.401706    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.401831 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.401728    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqppl\" (UniqueName: \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-kube-api-access-cqppl\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.401831 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.401789    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.401831 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.401824    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-628vs\" (UniqueName: \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-kube-api-access-628vs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.402093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.401845    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.402093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.401885    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25bbddb2-e3ec-4490-aefa-66f1c7075210-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.402093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.401903    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.402093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402018    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.402093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402061    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.402332 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402114    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04de3be6-b849-4502-8dd3-da8419b891cf-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.402332 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402283    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.402418 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402332    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.402418 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402362    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.402418 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402393    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.402622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402453    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.402622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402486    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.402622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402522    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.402622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402561    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.402622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402573    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04de3be6-b849-4502-8dd3-da8419b891cf-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.402863 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402722    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25bbddb2-e3ec-4490-aefa-66f1c7075210-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.402863 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.402758    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.404599 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.404574    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.405070 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.405047    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.459093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.459058    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.459234 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.459206    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqppl\" (UniqueName: \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-kube-api-access-cqppl\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.504224 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504187    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504383 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504231    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04de3be6-b849-4502-8dd3-da8419b891cf-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504383 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504308    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504460 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504439    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504495 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504486    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504574 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504558    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04de3be6-b849-4502-8dd3-da8419b891cf-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504631 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504605    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504686 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504658    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-628vs\" (UniqueName: \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-kube-api-access-628vs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504686 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504668    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-data\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504776 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504686    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504776 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504692    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-credential-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504877 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504858    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-certs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.504961 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.504939    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-socket\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.505129 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.505108    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04de3be6-b849-4502-8dd3-da8419b891cf-istiod-ca-cert\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.507088 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.507066    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-envoy\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.507272 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.507244    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04de3be6-b849-4502-8dd3-da8419b891cf-istio-podinfo\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.561820 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.561753    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-istio-token\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.561942 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.561920    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-628vs\" (UniqueName: \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-kube-api-access-628vs\") pod \"e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") " pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.580936 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.580907    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:41.593363 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.593344    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:41.695977 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:41.695946    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:42.010855 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.010821    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"]
Nov 04 01:40:42.013437 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.012996    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"]
Nov 04 01:40:42.015442 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:40:42.015410    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bbddb2_e3ec_4490_aefa_66f1c7075210.slice/crio-3ffcf1103a33faad96a15bcc1edb33dcec3b06db0b70bb71ef9d7e1e70ea124d WatchSource:0}: Error finding container 3ffcf1103a33faad96a15bcc1edb33dcec3b06db0b70bb71ef9d7e1e70ea124d: Status 404 returned error can't find the container with id 3ffcf1103a33faad96a15bcc1edb33dcec3b06db0b70bb71ef9d7e1e70ea124d
Nov 04 01:40:42.016011 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:40:42.015980    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04de3be6_b849_4502_8dd3_da8419b891cf.slice/crio-44c4c509355833a4b49510b81265d8011d6c1e799bb7ba7289561cc2bde23bb6 WatchSource:0}: Error finding container 44c4c509355833a4b49510b81265d8011d6c1e799bb7ba7289561cc2bde23bb6: Status 404 returned error can't find the container with id 44c4c509355833a4b49510b81265d8011d6c1e799bb7ba7289561cc2bde23bb6
Nov 04 01:40:42.017751 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.017716    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:40:42.017835 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.017788    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:40:42.017835 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.017824    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:40:42.018132 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.018099    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:40:42.018235 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.018172    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:40:42.018235 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.018215    5572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Nov 04 01:40:42.036170 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.036145    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:42.180461 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.180427    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:42.199794 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.199751    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg" podUID="62ae3dce-4771-4dc6-8db5-9c4266e8b49b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 01:40:42.708719 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.708673    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" event={"ID":"25bbddb2-e3ec-4490-aefa-66f1c7075210","Type":"ContainerStarted","Data":"6a1afefbde7a4b739bf10e45e7f6a0c6b807fdbcc04499f349a95e109a56e950"}
Nov 04 01:40:42.709180 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.708744    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" event={"ID":"25bbddb2-e3ec-4490-aefa-66f1c7075210","Type":"ContainerStarted","Data":"3ffcf1103a33faad96a15bcc1edb33dcec3b06db0b70bb71ef9d7e1e70ea124d"}
Nov 04 01:40:42.710664 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.710632    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" event={"ID":"04de3be6-b849-4502-8dd3-da8419b891cf","Type":"ContainerStarted","Data":"cee69c9c679bd97201c15831f3ce8b2734170e4bc47d809a00d09a6cbe2ce108"}
Nov 04 01:40:42.710802 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.710685    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" event={"ID":"04de3be6-b849-4502-8dd3-da8419b891cf","Type":"ContainerStarted","Data":"44c4c509355833a4b49510b81265d8011d6c1e799bb7ba7289561cc2bde23bb6"}
Nov 04 01:40:42.835256 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.835200    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" podStartSLOduration=1.835183199 podStartE2EDuration="1.835183199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:40:42.833339165 +0000 UTC m=+1773.983546923" watchObservedRunningTime="2026-11-04 01:40:42.835183199 +0000 UTC m=+1773.985390961"
Nov 04 01:40:42.964610 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:42.956200    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" podStartSLOduration=1.956180295 podStartE2EDuration="1.956180295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:40:42.952012878 +0000 UTC m=+1774.102220639" watchObservedRunningTime="2026-11-04 01:40:42.956180295 +0000 UTC m=+1774.106388055"
Nov 04 01:40:43.229031 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:40:43.228916    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:40:43.586613 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:43.585630    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:43.586613 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:43.585771    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:40:43.586613 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:43.585824    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" podUID="25bbddb2-e3ec-4490-aefa-66f1c7075210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 01:40:43.594952 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:43.594925    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:43.607567 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:43.604709    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 01:40:43.607567 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:43.604773    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" podUID="04de3be6-b849-4502-8dd3-da8419b891cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 01:40:43.761283 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:43.761241    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:44.051874 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:44.051841    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:44.211460 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:44.208039    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:44.389617 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:44.368320    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"]
Nov 04 01:40:44.390096 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:44.390058    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy" containerID="cri-o://7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40" gracePeriod=30
Nov 04 01:40:44.395059 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:44.385945    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:44.585557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:44.581883    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:40:44.585557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:44.581941    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" podUID="25bbddb2-e3ec-4490-aefa-66f1c7075210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 01:40:44.595559 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:44.593891    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 01:40:44.595559 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:44.593950    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" podUID="04de3be6-b849-4502-8dd3-da8419b891cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 01:40:45.589558 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:45.586676    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:40:45.589558 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:45.586759    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" podUID="25bbddb2-e3ec-4490-aefa-66f1c7075210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 01:40:45.593945 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:45.593914    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 01:40:45.594202 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:45.594175    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" podUID="04de3be6-b849-4502-8dd3-da8419b891cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 01:40:46.163560 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:46.160588    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:46.313929 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:46.313891    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:46.582557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:46.582057    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:40:46.582557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:46.582123    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" podUID="25bbddb2-e3ec-4490-aefa-66f1c7075210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 01:40:46.597568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:46.597014    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 01:40:46.597568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:46.597062    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" podUID="04de3be6-b849-4502-8dd3-da8419b891cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 01:40:46.599287 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:46.599260    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"]
Nov 04 01:40:46.599524 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:46.599501    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9" podUID="edd40302-6462-4d1c-b949-addf9cb235d6" containerName="maas-api" containerID="cri-o://44af674a1e75473c0c40da81a90661b47edd4694c5e1001b21bf81d18c143159" gracePeriod=30
Nov 04 01:40:46.713559 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:46.711577    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:46.811256 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:46.811100    5572 generic.go:356] "Generic (PLEG): container finished" podID="edd40302-6462-4d1c-b949-addf9cb235d6" containerID="44af674a1e75473c0c40da81a90661b47edd4694c5e1001b21bf81d18c143159" exitCode=0
Nov 04 01:40:46.811256 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:46.811161    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9" event={"ID":"edd40302-6462-4d1c-b949-addf9cb235d6","Type":"ContainerDied","Data":"44af674a1e75473c0c40da81a90661b47edd4694c5e1001b21bf81d18c143159"}
Nov 04 01:40:47.111444 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.111365    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:40:47.220160 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.220088    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/edd40302-6462-4d1c-b949-addf9cb235d6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd40302-6462-4d1c-b949-addf9cb235d6-openshift-service-ca\") pod \"edd40302-6462-4d1c-b949-addf9cb235d6\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") "
Nov 04 01:40:47.220360 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.220204    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-maas-api-tls\") pod \"edd40302-6462-4d1c-b949-addf9cb235d6\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") "
Nov 04 01:40:47.220360 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.220304    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/edd40302-6462-4d1c-b949-addf9cb235d6-kube-api-access-lqml9\" (UniqueName: \"kubernetes.io/projected/edd40302-6462-4d1c-b949-addf9cb235d6-kube-api-access-lqml9\") pod \"edd40302-6462-4d1c-b949-addf9cb235d6\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") "
Nov 04 01:40:47.220360 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.220337    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-metrics-certs\") pod \"edd40302-6462-4d1c-b949-addf9cb235d6\" (UID: \"edd40302-6462-4d1c-b949-addf9cb235d6\") "
Nov 04 01:40:47.220972 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.220939    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edd40302-6462-4d1c-b949-addf9cb235d6-openshift-service-ca" pod "edd40302-6462-4d1c-b949-addf9cb235d6" (UID: "edd40302-6462-4d1c-b949-addf9cb235d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:40:47.222611 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.222590    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-metrics-certs" pod "edd40302-6462-4d1c-b949-addf9cb235d6" (UID: "edd40302-6462-4d1c-b949-addf9cb235d6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:40:47.222748 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.222718    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-maas-api-tls" pod "edd40302-6462-4d1c-b949-addf9cb235d6" (UID: "edd40302-6462-4d1c-b949-addf9cb235d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:40:47.223017 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.222995    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edd40302-6462-4d1c-b949-addf9cb235d6-kube-api-access-lqml9" pod "edd40302-6462-4d1c-b949-addf9cb235d6" (UID: "edd40302-6462-4d1c-b949-addf9cb235d6"). InnerVolumeSpecName "kube-api-access-lqml9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:47.322232 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.322191    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-maas-api-tls\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:47.322232 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.322226    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqml9\" (UniqueName: \"kubernetes.io/projected/edd40302-6462-4d1c-b949-addf9cb235d6-kube-api-access-lqml9\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:47.322232 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.322239    5572 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edd40302-6462-4d1c-b949-addf9cb235d6-metrics-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:47.322468 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.322252    5572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd40302-6462-4d1c-b949-addf9cb235d6-openshift-service-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:47.582487 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.582005    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:40:47.582487 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.582072    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" podUID="25bbddb2-e3ec-4490-aefa-66f1c7075210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 01:40:47.597058 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.596941    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 01:40:47.597058 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.596999    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" podUID="04de3be6-b849-4502-8dd3-da8419b891cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 01:40:47.820686 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.820655    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9" event={"ID":"edd40302-6462-4d1c-b949-addf9cb235d6","Type":"ContainerDied","Data":"7315c115a24fb49006023cdeedcbdd0db78b771bb28f02b0ab8198c9cc4f9d33"}
Nov 04 01:40:47.821098 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.820711    5572 scope.go:122] "RemoveContainer" containerID="44af674a1e75473c0c40da81a90661b47edd4694c5e1001b21bf81d18c143159"
Nov 04 01:40:47.821098 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.820819    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"
Nov 04 01:40:47.999503 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:47.999469    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"]
Nov 04 01:40:48.044092 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.044059    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b2eadb-6cc4c7cc5c-65fm9"]
Nov 04 01:40:48.238193 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.238162    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:40:48.336667 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.336634    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-kube-api-access-jpcvr\" (UniqueName: \"kubernetes.io/projected/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-kube-api-access-jpcvr\") pod \"62ae3dce-4771-4dc6-8db5-9c4266e8b49b\" (UID: \"62ae3dce-4771-4dc6-8db5-9c4266e8b49b\") "
Nov 04 01:40:48.336851 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.336690    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-plugins-config-volume\") pod \"62ae3dce-4771-4dc6-8db5-9c4266e8b49b\" (UID: \"62ae3dce-4771-4dc6-8db5-9c4266e8b49b\") "
Nov 04 01:40:48.337150 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.337128    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-plugins-config-volume" pod "62ae3dce-4771-4dc6-8db5-9c4266e8b49b" (UID: "62ae3dce-4771-4dc6-8db5-9c4266e8b49b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:40:48.338963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.338928    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-kube-api-access-jpcvr" pod "62ae3dce-4771-4dc6-8db5-9c4266e8b49b" (UID: "62ae3dce-4771-4dc6-8db5-9c4266e8b49b"). InnerVolumeSpecName "kube-api-access-jpcvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:48.437783 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.437700    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpcvr\" (UniqueName: \"kubernetes.io/projected/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-kube-api-access-jpcvr\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:48.437783 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.437730    5572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62ae3dce-4771-4dc6-8db5-9c4266e8b49b-plugins-config-volume\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:48.581310 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.581271    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 01:40:48.581480 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.581339    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" podUID="25bbddb2-e3ec-4490-aefa-66f1c7075210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 01:40:48.594605 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.594582    5572 patch_prober.go:29] interesting pod/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 01:40:48.594656 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.594623    5572 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" podUID="04de3be6-b849-4502-8dd3-da8419b891cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 01:40:48.796726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.796683    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:48.829429 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.829400    5572 generic.go:356] "Generic (PLEG): container finished" podID="62ae3dce-4771-4dc6-8db5-9c4266e8b49b" containerID="bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73" exitCode=0
Nov 04 01:40:48.829909 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.829457    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg" event={"ID":"62ae3dce-4771-4dc6-8db5-9c4266e8b49b","Type":"ContainerDied","Data":"bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73"}
Nov 04 01:40:48.829909 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.829462    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"
Nov 04 01:40:48.829909 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.829503    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg" event={"ID":"62ae3dce-4771-4dc6-8db5-9c4266e8b49b","Type":"ContainerDied","Data":"e99702dd7c81791b1e1e99f911b1c90a853c780ef96f160449b6066f4bb9ee8c"}
Nov 04 01:40:48.829909 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.829525    5572 scope.go:122] "RemoveContainer" containerID="bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73"
Nov 04 01:40:48.842919 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.842891    5572 scope.go:122] "RemoveContainer" containerID="bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73"
Nov 04 01:40:48.843240 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:40:48.843219    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73\": container with ID starting with bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73 not found: ID does not exist" containerID="bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73"
Nov 04 01:40:48.843340 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.843250    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73"} err="failed to get container status \"bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73\": rpc error: code = NotFound desc = could not find container \"bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73\": container with ID starting with bb7ea97adc1ec8b4728e83df7d3a61b2fa0713495c0d3460cfc2c0538581ff73 not found: ID does not exist"
Nov 04 01:40:48.971846 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.971810    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="edd40302-6462-4d1c-b949-addf9cb235d6" path="/var/lib/kubelet/pods/edd40302-6462-4d1c-b949-addf9cb235d6/volumes"
Nov 04 01:40:48.982803 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.982770    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"]
Nov 04 01:40:48.990984 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:48.990953    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-00cfe6-6797d7fb67-sqgbg"]
Nov 04 01:40:49.499684 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.499645    5572 patch_prober.go:29] interesting pod/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 01:40:49.499866 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.499711    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 01:40:49.727022 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.726983    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:40:49.739137 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.739107    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:49.739612 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.739590    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:49.740626 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.740601    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:40:49.746928 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.746905    5572 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:49.747806 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.747787    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:49.748419 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.748404    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:40:49.838216 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.838179    5572 generic.go:356] "Generic (PLEG): container finished" podID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerID="7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40" exitCode=0
Nov 04 01:40:49.838751 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.838247    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"
Nov 04 01:40:49.838751 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.838256    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" event={"ID":"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc","Type":"ContainerDied","Data":"7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40"}
Nov 04 01:40:49.838751 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.838316    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6" event={"ID":"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc","Type":"ContainerDied","Data":"5c8dc69eb799b658769193631bf0ea0b0aff34211628d514724f3345d7dfdda3"}
Nov 04 01:40:49.838751 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.838342    5572 scope.go:122] "RemoveContainer" containerID="7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40"
Nov 04 01:40:49.849033 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.849007    5572 scope.go:122] "RemoveContainer" containerID="7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40"
Nov 04 01:40:49.849409 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:40:49.849381    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40\": container with ID starting with 7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40 not found: ID does not exist" containerID="7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40"
Nov 04 01:40:49.849509 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.849425    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40"} err="failed to get container status \"7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40\": rpc error: code = NotFound desc = could not find container \"7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40\": container with ID starting with 7428031aa23979f14b47990b56ea1216040489598b758ef5e46766a4415b9e40 not found: ID does not exist"
Nov 04 01:40:49.852784 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.852758    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-socket\") pod \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") "
Nov 04 01:40:49.852897 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.852860    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istiod-ca-cert\") pod \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") "
Nov 04 01:40:49.852897 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.852890    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-token\" (UniqueName: \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-token\") pod \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") "
Nov 04 01:40:49.853011 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.852932    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-envoy\") pod \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") "
Nov 04 01:40:49.853011 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.852974    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-kube-api-access-76drw\" (UniqueName: \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-kube-api-access-76drw\") pod \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") "
Nov 04 01:40:49.853172 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.853024    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-credential-socket\") pod \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") "
Nov 04 01:40:49.853172 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.853053    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-podinfo\") pod \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") "
Nov 04 01:40:49.853172 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.853054    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-socket" pod "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" (UID: "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:49.853172 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.853113    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-data\") pod \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") "
Nov 04 01:40:49.853382 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.853174    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-certs\") pod \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\" (UID: \"3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc\") "
Nov 04 01:40:49.853382 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.853255    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istiod-ca-cert" pod "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" (UID: "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:40:49.853483 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.853451    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-certs" pod "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" (UID: "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:49.853863 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.853834    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.853976 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.853865    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.853976 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.853879    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.855488 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.855448    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-credential-socket" pod "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" (UID: "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:49.855770 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.855720    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-data" pod "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" (UID: "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:49.860298 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.860272    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-kube-api-access-76drw" pod "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" (UID: "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc"). InnerVolumeSpecName "kube-api-access-76drw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:49.860936 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.860911    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-token" pod "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" (UID: "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:40:49.862368 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.862115    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-podinfo" pod "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" (UID: "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:40:49.863826 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.863804    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-envoy" pod "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" (UID: "3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:40:49.955750 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.955665    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76drw\" (UniqueName: \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-kube-api-access-76drw\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.955750 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.955701    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.955750 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.955719    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.955750 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.955734    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.955750 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.955749    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:49.956050 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:49.955765    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:40:50.259564 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:50.259426    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"]
Nov 04 01:40:50.265006 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:50.264968    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-00cfe6-openshift-default-64579789c7-xh7f6"]
Nov 04 01:40:50.978100 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:50.978052    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" path="/var/lib/kubelet/pods/3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc/volumes"
Nov 04 01:40:50.978677 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:50.978653    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62ae3dce-4771-4dc6-8db5-9c4266e8b49b" path="/var/lib/kubelet/pods/62ae3dce-4771-4dc6-8db5-9c4266e8b49b/volumes"
Nov 04 01:40:53.905471 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:53.905429    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:55.429856 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:55.429811    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:55.583557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:55.583044    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:57.140188 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:57.140154    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:58.043461 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:58.043427    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:40:59.632946 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:40:59.632913    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:03.398689 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:03.398644    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:04.891101 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:04.891065    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:07.713623 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:07.713589    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"]
Nov 04 01:41:07.714104 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:07.713797    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" podUID="04de3be6-b849-4502-8dd3-da8419b891cf" containerName="istio-proxy" containerID="cri-o://cee69c9c679bd97201c15831f3ce8b2734170e4bc47d809a00d09a6cbe2ce108" gracePeriod=30
Nov 04 01:41:07.726449 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:07.726421    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:07.731712 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:07.731686    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"]
Nov 04 01:41:07.731940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:07.731917    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" podUID="25bbddb2-e3ec-4490-aefa-66f1c7075210" containerName="istio-proxy" containerID="cri-o://6a1afefbde7a4b739bf10e45e7f6a0c6b807fdbcc04499f349a95e109a56e950" gracePeriod=30
Nov 04 01:41:10.094788 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:10.094745    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:12.870853 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:41:12.870792    5572 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bbddb2_e3ec_4490_aefa_66f1c7075210.slice/crio-conmon-6a1afefbde7a4b739bf10e45e7f6a0c6b807fdbcc04499f349a95e109a56e950.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04de3be6_b849_4502_8dd3_da8419b891cf.slice/crio-conmon-cee69c9c679bd97201c15831f3ce8b2734170e4bc47d809a00d09a6cbe2ce108.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04de3be6_b849_4502_8dd3_da8419b891cf.slice/crio-cee69c9c679bd97201c15831f3ce8b2734170e4bc47d809a00d09a6cbe2ce108.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bbddb2_e3ec_4490_aefa_66f1c7075210.slice/crio-6a1afefbde7a4b739bf10e45e7f6a0c6b807fdbcc04499f349a95e109a56e950.scope\": RecentStats: unable to find data in memory cache]"
Nov 04 01:41:12.871462 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:41:12.870799    5572 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04de3be6_b849_4502_8dd3_da8419b891cf.slice/crio-conmon-cee69c9c679bd97201c15831f3ce8b2734170e4bc47d809a00d09a6cbe2ce108.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04de3be6_b849_4502_8dd3_da8419b891cf.slice/crio-cee69c9c679bd97201c15831f3ce8b2734170e4bc47d809a00d09a6cbe2ce108.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bbddb2_e3ec_4490_aefa_66f1c7075210.slice/crio-6a1afefbde7a4b739bf10e45e7f6a0c6b807fdbcc04499f349a95e109a56e950.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bbddb2_e3ec_4490_aefa_66f1c7075210.slice/crio-conmon-6a1afefbde7a4b739bf10e45e7f6a0c6b807fdbcc04499f349a95e109a56e950.scope\": RecentStats: unable to find data in memory cache]"
Nov 04 01:41:12.989940 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:12.989899    5572 generic.go:356] "Generic (PLEG): container finished" podID="25bbddb2-e3ec-4490-aefa-66f1c7075210" containerID="6a1afefbde7a4b739bf10e45e7f6a0c6b807fdbcc04499f349a95e109a56e950" exitCode=0
Nov 04 01:41:12.990095 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:12.989974    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" event={"ID":"25bbddb2-e3ec-4490-aefa-66f1c7075210","Type":"ContainerDied","Data":"6a1afefbde7a4b739bf10e45e7f6a0c6b807fdbcc04499f349a95e109a56e950"}
Nov 04 01:41:12.991485 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:12.991463    5572 generic.go:356] "Generic (PLEG): container finished" podID="04de3be6-b849-4502-8dd3-da8419b891cf" containerID="cee69c9c679bd97201c15831f3ce8b2734170e4bc47d809a00d09a6cbe2ce108" exitCode=0
Nov 04 01:41:12.991641 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:12.991550    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" event={"ID":"04de3be6-b849-4502-8dd3-da8419b891cf","Type":"ContainerDied","Data":"cee69c9c679bd97201c15831f3ce8b2734170e4bc47d809a00d09a6cbe2ce108"}
Nov 04 01:41:13.008765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.008743    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:41:13.032170 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.032151    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:41:13.102044 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102016    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-credential-socket\") pod \"25bbddb2-e3ec-4490-aefa-66f1c7075210\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") "
Nov 04 01:41:13.102203 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102061    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-data\") pod \"04de3be6-b849-4502-8dd3-da8419b891cf\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") "
Nov 04 01:41:13.102203 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102093    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04de3be6-b849-4502-8dd3-da8419b891cf-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04de3be6-b849-4502-8dd3-da8419b891cf-istiod-ca-cert\") pod \"04de3be6-b849-4502-8dd3-da8419b891cf\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") "
Nov 04 01:41:13.102203 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102125    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-socket\") pod \"25bbddb2-e3ec-4490-aefa-66f1c7075210\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") "
Nov 04 01:41:13.102203 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102161    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-envoy\") pod \"04de3be6-b849-4502-8dd3-da8419b891cf\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") "
Nov 04 01:41:13.102203 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102193    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-kube-api-access-cqppl\" (UniqueName: \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-kube-api-access-cqppl\") pod \"25bbddb2-e3ec-4490-aefa-66f1c7075210\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") "
Nov 04 01:41:13.102466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102249    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-data\") pod \"25bbddb2-e3ec-4490-aefa-66f1c7075210\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") "
Nov 04 01:41:13.102466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102276    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25bbddb2-e3ec-4490-aefa-66f1c7075210-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25bbddb2-e3ec-4490-aefa-66f1c7075210-istiod-ca-cert\") pod \"25bbddb2-e3ec-4490-aefa-66f1c7075210\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") "
Nov 04 01:41:13.102466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102306    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-podinfo\") pod \"25bbddb2-e3ec-4490-aefa-66f1c7075210\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") "
Nov 04 01:41:13.102466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102328    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-credential-socket" pod "25bbddb2-e3ec-4490-aefa-66f1c7075210" (UID: "25bbddb2-e3ec-4490-aefa-66f1c7075210"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.102466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102338    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/04de3be6-b849-4502-8dd3-da8419b891cf-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04de3be6-b849-4502-8dd3-da8419b891cf-istio-podinfo\") pod \"04de3be6-b849-4502-8dd3-da8419b891cf\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") "
Nov 04 01:41:13.102466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102372    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-token\" (UniqueName: \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-token\") pod \"25bbddb2-e3ec-4490-aefa-66f1c7075210\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") "
Nov 04 01:41:13.102466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102399    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-kube-api-access-628vs\" (UniqueName: \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-kube-api-access-628vs\") pod \"04de3be6-b849-4502-8dd3-da8419b891cf\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") "
Nov 04 01:41:13.102466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102397    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-data" pod "04de3be6-b849-4502-8dd3-da8419b891cf" (UID: "04de3be6-b849-4502-8dd3-da8419b891cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.102466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102452    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-socket\") pod \"04de3be6-b849-4502-8dd3-da8419b891cf\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") "
Nov 04 01:41:13.102957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102503    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-certs\") pod \"25bbddb2-e3ec-4490-aefa-66f1c7075210\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") "
Nov 04 01:41:13.102957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102610    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-credential-socket\") pod \"04de3be6-b849-4502-8dd3-da8419b891cf\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") "
Nov 04 01:41:13.102957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102640    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-data" pod "25bbddb2-e3ec-4490-aefa-66f1c7075210" (UID: "25bbddb2-e3ec-4490-aefa-66f1c7075210"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.102957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102660    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04de3be6-b849-4502-8dd3-da8419b891cf-istiod-ca-cert" pod "04de3be6-b849-4502-8dd3-da8419b891cf" (UID: "04de3be6-b849-4502-8dd3-da8419b891cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:41:13.102957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102681    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25bbddb2-e3ec-4490-aefa-66f1c7075210-istiod-ca-cert" pod "25bbddb2-e3ec-4490-aefa-66f1c7075210" (UID: "25bbddb2-e3ec-4490-aefa-66f1c7075210"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:41:13.102957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102694    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-envoy\") pod \"25bbddb2-e3ec-4490-aefa-66f1c7075210\" (UID: \"25bbddb2-e3ec-4490-aefa-66f1c7075210\") "
Nov 04 01:41:13.102957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102723    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-istio-token\" (UniqueName: \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-istio-token\") pod \"04de3be6-b849-4502-8dd3-da8419b891cf\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") "
Nov 04 01:41:13.102957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102766    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-certs\") pod \"04de3be6-b849-4502-8dd3-da8419b891cf\" (UID: \"04de3be6-b849-4502-8dd3-da8419b891cf\") "
Nov 04 01:41:13.102957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102794    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-socket" pod "25bbddb2-e3ec-4490-aefa-66f1c7075210" (UID: "25bbddb2-e3ec-4490-aefa-66f1c7075210"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.102957 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102917    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-certs" pod "25bbddb2-e3ec-4490-aefa-66f1c7075210" (UID: "25bbddb2-e3ec-4490-aefa-66f1c7075210"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.103475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.102980    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-socket" pod "04de3be6-b849-4502-8dd3-da8419b891cf" (UID: "04de3be6-b849-4502-8dd3-da8419b891cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.103475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.103135    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-certs" pod "04de3be6-b849-4502-8dd3-da8419b891cf" (UID: "04de3be6-b849-4502-8dd3-da8419b891cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.103475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.103204    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.103475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.103227    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.103475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.103241    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04de3be6-b849-4502-8dd3-da8419b891cf-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.103475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.103260    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.103475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.103278    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.103475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.103293    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25bbddb2-e3ec-4490-aefa-66f1c7075210-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.103475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.103306    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.103475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.103320    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.103475 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.103330    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-credential-socket" pod "04de3be6-b849-4502-8dd3-da8419b891cf" (UID: "04de3be6-b849-4502-8dd3-da8419b891cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.105318 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.105274    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-kube-api-access-628vs" pod "04de3be6-b849-4502-8dd3-da8419b891cf" (UID: "04de3be6-b849-4502-8dd3-da8419b891cf"). InnerVolumeSpecName "kube-api-access-628vs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:41:13.105318 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.105278    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-envoy" pod "04de3be6-b849-4502-8dd3-da8419b891cf" (UID: "04de3be6-b849-4502-8dd3-da8419b891cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.105490 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.105371    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-kube-api-access-cqppl" pod "25bbddb2-e3ec-4490-aefa-66f1c7075210" (UID: "25bbddb2-e3ec-4490-aefa-66f1c7075210"). InnerVolumeSpecName "kube-api-access-cqppl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:41:13.105490 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.105381    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-podinfo" pod "25bbddb2-e3ec-4490-aefa-66f1c7075210" (UID: "25bbddb2-e3ec-4490-aefa-66f1c7075210"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:41:13.105601 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.105522    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-token" pod "25bbddb2-e3ec-4490-aefa-66f1c7075210" (UID: "25bbddb2-e3ec-4490-aefa-66f1c7075210"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:41:13.105637 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.105604    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-istio-token" pod "04de3be6-b849-4502-8dd3-da8419b891cf" (UID: "04de3be6-b849-4502-8dd3-da8419b891cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:41:13.106058 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.106035    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04de3be6-b849-4502-8dd3-da8419b891cf-istio-podinfo" pod "04de3be6-b849-4502-8dd3-da8419b891cf" (UID: "04de3be6-b849-4502-8dd3-da8419b891cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:41:13.106501 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.106479    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-envoy" pod "25bbddb2-e3ec-4490-aefa-66f1c7075210" (UID: "25bbddb2-e3ec-4490-aefa-66f1c7075210"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:41:13.202050 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:41:13.202016    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:41:13.204835 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.204804    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.204963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.204838    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqppl\" (UniqueName: \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-kube-api-access-cqppl\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.204963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.204855    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.204963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.204867    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04de3be6-b849-4502-8dd3-da8419b891cf-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.204963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.204880    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.204963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.204893    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-628vs\" (UniqueName: \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-kube-api-access-628vs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.204963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.204905    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.204963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.204920    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25bbddb2-e3ec-4490-aefa-66f1c7075210-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.204963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.204933    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04de3be6-b849-4502-8dd3-da8419b891cf-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.204963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.204945    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04de3be6-b849-4502-8dd3-da8419b891cf-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:41:13.998091 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.998004    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"
Nov 04 01:41:13.998607 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.998008    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv" event={"ID":"25bbddb2-e3ec-4490-aefa-66f1c7075210","Type":"ContainerDied","Data":"3ffcf1103a33faad96a15bcc1edb33dcec3b06db0b70bb71ef9d7e1e70ea124d"}
Nov 04 01:41:13.998607 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.998174    5572 scope.go:122] "RemoveContainer" containerID="6a1afefbde7a4b739bf10e45e7f6a0c6b807fdbcc04499f349a95e109a56e950"
Nov 04 01:41:13.999604 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.999582    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt" event={"ID":"04de3be6-b849-4502-8dd3-da8419b891cf","Type":"ContainerDied","Data":"44c4c509355833a4b49510b81265d8011d6c1e799bb7ba7289561cc2bde23bb6"}
Nov 04 01:41:13.999665 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:13.999619    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"
Nov 04 01:41:14.008877 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:14.008861    5572 scope.go:122] "RemoveContainer" containerID="cee69c9c679bd97201c15831f3ce8b2734170e4bc47d809a00d09a6cbe2ce108"
Nov 04 01:41:14.197706 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:14.197674    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"]
Nov 04 01:41:14.244004 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:14.243975    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-q8tcv"]
Nov 04 01:41:14.304485 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:14.304409    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"]
Nov 04 01:41:14.308382 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:14.308357    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b2eadb-openshift-default-54d5bd64fc-hl5mt"]
Nov 04 01:41:14.972041 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:14.972007    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04de3be6-b849-4502-8dd3-da8419b891cf" path="/var/lib/kubelet/pods/04de3be6-b849-4502-8dd3-da8419b891cf/volumes"
Nov 04 01:41:14.972436 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:14.972422    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25bbddb2-e3ec-4490-aefa-66f1c7075210" path="/var/lib/kubelet/pods/25bbddb2-e3ec-4490-aefa-66f1c7075210/volumes"
Nov 04 01:41:15.107315 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:15.107280    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:17.476819 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:17.476776    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:20.183107 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:20.183024    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:25.194437 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:25.194401    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:30.249666 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:30.249626    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:35.201235 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:35.201198    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:40.297874 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:40.297838    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:43.199399 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:41:43.199358    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:41:45.388829 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:45.388777    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:50.482521 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:50.482451    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:55.511708 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:55.511673    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:41:58.356850 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:41:58.356819    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:00.602061 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:00.602015    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:03.751762 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:03.751722    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:05.608822 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:05.608784    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:10.705311 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:10.705275    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:13.199835 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:42:13.199799    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:42:15.719466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:15.719429    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:17.828214 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:17.828182    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:20.796272 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:20.796232    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:25.878647 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:25.878614    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:30.898436 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:30.898401    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:35.912428 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:35.912391    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:38.111039 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:38.110992    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:38.258166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:38.258123    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:40.990341 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:40.990303    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:43.199673 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:42:43.199628    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:42:43.306779 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:43.306751    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:43.452109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:43.452008    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:44.641610 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:44.641570    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:46.086805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:46.086775    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:51.106304 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:51.106271    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:56.116833 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:56.116784    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:42:57.950122 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:42:57.950090    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:01.197512 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:01.197474    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:04.124592 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:04.124557    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:06.223049 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:06.223013    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:08.712804 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:08.712772    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:11.308975 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:11.308937    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:13.199511 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:43:13.199465    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:43:16.421805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:16.421774    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:18.169669 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:18.169636    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:21.688075 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:21.688040    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:26.816743 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:26.816713    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:31.905825 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:31.905795    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:32.107271 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:32.107241    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:32.262167 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:32.262128    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:37.020798 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:37.020758    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:42.212103 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:42.212069    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:43.200983 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:43:43.200947    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:43:47.308200 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:47.308165    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:52.429980 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:52.429949    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:43:57.315856 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:43:57.315823    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:02.413493 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:02.413457    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:04.465791 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:04.465757    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:07.407088 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:07.407053    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:12.490081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:12.490043    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:13.198220 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:44:13.198179    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:44:17.524523 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:17.524482    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:18.533736 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:18.533663    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:19.066452 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:19.066425    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:22.599392 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:22.599358    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:27.720323 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:27.720290    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:32.786436 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:32.786396    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:37.801725 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:37.801682    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:42.999195 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:42.999163    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:43.198373 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:44:43.198336    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:44:48.082921 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:48.082890    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:48.893095 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:48.893065    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:53.090281 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:53.090250    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:44:58.101829 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:44:58.101792    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:00.177679 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.177642    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"]
Nov 04 01:45:00.178163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178081    5572 cpu_manager.go:414] "containerMap: removing container" podUID="62ae3dce-4771-4dc6-8db5-9c4266e8b49b" containerName="payload-pre-processing"
Nov 04 01:45:00.178163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178094    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62ae3dce-4771-4dc6-8db5-9c4266e8b49b" containerName="payload-pre-processing"
Nov 04 01:45:00.178163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178113    5572 cpu_manager.go:414] "containerMap: removing container" podUID="04de3be6-b849-4502-8dd3-da8419b891cf" containerName="istio-proxy"
Nov 04 01:45:00.178163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178119    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04de3be6-b849-4502-8dd3-da8419b891cf" containerName="istio-proxy"
Nov 04 01:45:00.178163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178142    5572 cpu_manager.go:414] "containerMap: removing container" podUID="25bbddb2-e3ec-4490-aefa-66f1c7075210" containerName="istio-proxy"
Nov 04 01:45:00.178163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178148    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25bbddb2-e3ec-4490-aefa-66f1c7075210" containerName="istio-proxy"
Nov 04 01:45:00.178163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178162    5572 cpu_manager.go:414] "containerMap: removing container" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy"
Nov 04 01:45:00.178163 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178168    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy"
Nov 04 01:45:00.178408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178174    5572 cpu_manager.go:414] "containerMap: removing container" podUID="edd40302-6462-4d1c-b949-addf9cb235d6" containerName="maas-api"
Nov 04 01:45:00.178408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178180    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edd40302-6462-4d1c-b949-addf9cb235d6" containerName="maas-api"
Nov 04 01:45:00.178408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178238    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="3498f8b8-d8ff-4c3c-a22e-2f7b66d925bc" containerName="istio-proxy"
Nov 04 01:45:00.178408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178245    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="edd40302-6462-4d1c-b949-addf9cb235d6" containerName="maas-api"
Nov 04 01:45:00.178408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178254    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="62ae3dce-4771-4dc6-8db5-9c4266e8b49b" containerName="payload-pre-processing"
Nov 04 01:45:00.178408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178262    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="04de3be6-b849-4502-8dd3-da8419b891cf" containerName="istio-proxy"
Nov 04 01:45:00.178408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.178269    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="25bbddb2-e3ec-4490-aefa-66f1c7075210" containerName="istio-proxy"
Nov 04 01:45:00.181403 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.181381    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"]
Nov 04 01:45:00.181512 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.181498    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"
Nov 04 01:45:00.185089 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.185067    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"
Nov 04 01:45:00.230675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.230643    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w799x\""
Nov 04 01:45:00.245857 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.245821    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jn4b\" (UniqueName: \"kubernetes.io/projected/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-kube-api-access-5jn4b\") pod \"maas-api-key-cleanup-29895945-hjg24\" (UID: \"7bb82c7b-5009-48c7-bfa2-cef74ee89f66\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"
Nov 04 01:45:00.245994 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.245892    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895945-hjg24\" (UID: \"7bb82c7b-5009-48c7-bfa2-cef74ee89f66\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"
Nov 04 01:45:00.245994 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.245971    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87r2f\" (UniqueName: \"kubernetes.io/projected/fb9432b7-2ac9-4187-b43e-3c385d86c090-kube-api-access-87r2f\") pod \"maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt\" (UID: \"fb9432b7-2ac9-4187-b43e-3c385d86c090\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"
Nov 04 01:45:00.246171 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.246141    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb9432b7-2ac9-4187-b43e-3c385d86c090-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt\" (UID: \"fb9432b7-2ac9-4187-b43e-3c385d86c090\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"
Nov 04 01:45:00.278312 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.278281    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"]
Nov 04 01:45:00.279843 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.279821    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"]
Nov 04 01:45:00.347377 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.347338    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jn4b\" (UniqueName: \"kubernetes.io/projected/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-kube-api-access-5jn4b\") pod \"maas-api-key-cleanup-29895945-hjg24\" (UID: \"7bb82c7b-5009-48c7-bfa2-cef74ee89f66\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"
Nov 04 01:45:00.347619 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.347400    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895945-hjg24\" (UID: \"7bb82c7b-5009-48c7-bfa2-cef74ee89f66\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"
Nov 04 01:45:00.347619 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.347441    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87r2f\" (UniqueName: \"kubernetes.io/projected/fb9432b7-2ac9-4187-b43e-3c385d86c090-kube-api-access-87r2f\") pod \"maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt\" (UID: \"fb9432b7-2ac9-4187-b43e-3c385d86c090\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"
Nov 04 01:45:00.347779 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.347616    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb9432b7-2ac9-4187-b43e-3c385d86c090-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt\" (UID: \"fb9432b7-2ac9-4187-b43e-3c385d86c090\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"
Nov 04 01:45:00.348119 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.348101    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895945-hjg24\" (UID: \"7bb82c7b-5009-48c7-bfa2-cef74ee89f66\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"
Nov 04 01:45:00.348215 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.348198    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb9432b7-2ac9-4187-b43e-3c385d86c090-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt\" (UID: \"fb9432b7-2ac9-4187-b43e-3c385d86c090\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"
Nov 04 01:45:00.407474 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.407444    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jn4b\" (UniqueName: \"kubernetes.io/projected/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-kube-api-access-5jn4b\") pod \"maas-api-key-cleanup-29895945-hjg24\" (UID: \"7bb82c7b-5009-48c7-bfa2-cef74ee89f66\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"
Nov 04 01:45:00.407675 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.407454    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87r2f\" (UniqueName: \"kubernetes.io/projected/fb9432b7-2ac9-4187-b43e-3c385d86c090-kube-api-access-87r2f\") pod \"maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt\" (UID: \"fb9432b7-2ac9-4187-b43e-3c385d86c090\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"
Nov 04 01:45:00.495410 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.495380    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"
Nov 04 01:45:00.501585 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.501561    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"
Nov 04 01:45:00.865028 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.864870    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"]
Nov 04 01:45:00.867949 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:45:00.867917    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb82c7b_5009_48c7_bfa2_cef74ee89f66.slice/crio-ebfea7637599075033b908d1a2bdbacef3a2d8109e62556cb3c5f95e4aa23b71 WatchSource:0}: Error finding container ebfea7637599075033b908d1a2bdbacef3a2d8109e62556cb3c5f95e4aa23b71: Status 404 returned error can't find the container with id ebfea7637599075033b908d1a2bdbacef3a2d8109e62556cb3c5f95e4aa23b71
Nov 04 01:45:00.913303 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:00.913279    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"]
Nov 04 01:45:00.915624 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:45:00.915595    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9432b7_2ac9_4187_b43e_3c385d86c090.slice/crio-c5a3eb9c008272c0faf91c8af07baba1b610c2053a9d655c50c6e0265af14a7e WatchSource:0}: Error finding container c5a3eb9c008272c0faf91c8af07baba1b610c2053a9d655c50c6e0265af14a7e: Status 404 returned error can't find the container with id c5a3eb9c008272c0faf91c8af07baba1b610c2053a9d655c50c6e0265af14a7e
Nov 04 01:45:01.148856 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:01.148820    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt" event={"ID":"fb9432b7-2ac9-4187-b43e-3c385d86c090","Type":"ContainerStarted","Data":"c5a3eb9c008272c0faf91c8af07baba1b610c2053a9d655c50c6e0265af14a7e"}
Nov 04 01:45:01.150258 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:01.150229    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24" event={"ID":"7bb82c7b-5009-48c7-bfa2-cef74ee89f66","Type":"ContainerStarted","Data":"ebfea7637599075033b908d1a2bdbacef3a2d8109e62556cb3c5f95e4aa23b71"}
Nov 04 01:45:02.157765 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:02.157729    5572 generic.go:356] "Generic (PLEG): container finished" podID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerID="55a77d2f0b393fb51c5a5e1476ce8b5a843fcce9d5818ed9dbca15b7f61f6f68" exitCode=60
Nov 04 01:45:02.158168 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:02.157780    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt" event={"ID":"fb9432b7-2ac9-4187-b43e-3c385d86c090","Type":"ContainerDied","Data":"55a77d2f0b393fb51c5a5e1476ce8b5a843fcce9d5818ed9dbca15b7f61f6f68"}
Nov 04 01:45:02.158168 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:02.158057    5572 scope.go:122] "RemoveContainer" containerID="55a77d2f0b393fb51c5a5e1476ce8b5a843fcce9d5818ed9dbca15b7f61f6f68"
Nov 04 01:45:02.159819 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:02.159799    5572 generic.go:356] "Generic (PLEG): container finished" podID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerID="7652a750203e9b4591ef880656fc1b98f07c3c2ea049f9e7c453d5a1beec7580" exitCode=60
Nov 04 01:45:02.159927 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:02.159831    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24" event={"ID":"7bb82c7b-5009-48c7-bfa2-cef74ee89f66","Type":"ContainerDied","Data":"7652a750203e9b4591ef880656fc1b98f07c3c2ea049f9e7c453d5a1beec7580"}
Nov 04 01:45:02.160102 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:02.160084    5572 scope.go:122] "RemoveContainer" containerID="7652a750203e9b4591ef880656fc1b98f07c3c2ea049f9e7c453d5a1beec7580"
Nov 04 01:45:03.166500 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:03.166463    5572 generic.go:356] "Generic (PLEG): container finished" podID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerID="3371c38589d4857c7b9c7c686bd21e81412ad8eb7331d890248c1a1ff8f13f0f" exitCode=60
Nov 04 01:45:03.167021 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:03.166511    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt" event={"ID":"fb9432b7-2ac9-4187-b43e-3c385d86c090","Type":"ContainerDied","Data":"3371c38589d4857c7b9c7c686bd21e81412ad8eb7331d890248c1a1ff8f13f0f"}
Nov 04 01:45:03.167021 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:03.166580    5572 scope.go:122] "RemoveContainer" containerID="55a77d2f0b393fb51c5a5e1476ce8b5a843fcce9d5818ed9dbca15b7f61f6f68"
Nov 04 01:45:03.167021 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:03.166859    5572 scope.go:122] "RemoveContainer" containerID="3371c38589d4857c7b9c7c686bd21e81412ad8eb7331d890248c1a1ff8f13f0f"
Nov 04 01:45:03.167171 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:45:03.167143    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt_odh-ai-gateway-infra(fb9432b7-2ac9-4187-b43e-3c385d86c090)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090"
Nov 04 01:45:03.168565 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:03.168524    5572 generic.go:356] "Generic (PLEG): container finished" podID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerID="cc0721865dd03768c7a03412b0f585778bdb23ff18ce50f1281448e2e6c6c12f" exitCode=60
Nov 04 01:45:03.168565 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:03.168563    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24" event={"ID":"7bb82c7b-5009-48c7-bfa2-cef74ee89f66","Type":"ContainerDied","Data":"cc0721865dd03768c7a03412b0f585778bdb23ff18ce50f1281448e2e6c6c12f"}
Nov 04 01:45:03.168808 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:03.168794    5572 scope.go:122] "RemoveContainer" containerID="cc0721865dd03768c7a03412b0f585778bdb23ff18ce50f1281448e2e6c6c12f"
Nov 04 01:45:03.169002 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:45:03.168986    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895945-hjg24_odh-ai-gateway-infra(7bb82c7b-5009-48c7-bfa2-cef74ee89f66)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66"
Nov 04 01:45:03.178029 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:03.178009    5572 scope.go:122] "RemoveContainer" containerID="7652a750203e9b4591ef880656fc1b98f07c3c2ea049f9e7c453d5a1beec7580"
Nov 04 01:45:03.218690 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:03.218625    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:04.175738 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:04.175713    5572 scope.go:122] "RemoveContainer" containerID="3371c38589d4857c7b9c7c686bd21e81412ad8eb7331d890248c1a1ff8f13f0f"
Nov 04 01:45:04.176200 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:45:04.175957    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt_odh-ai-gateway-infra(fb9432b7-2ac9-4187-b43e-3c385d86c090)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090"
Nov 04 01:45:04.177415 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:04.177395    5572 scope.go:122] "RemoveContainer" containerID="cc0721865dd03768c7a03412b0f585778bdb23ff18ce50f1281448e2e6c6c12f"
Nov 04 01:45:04.177623 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:45:04.177606    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895945-hjg24_odh-ai-gateway-infra(7bb82c7b-5009-48c7-bfa2-cef74ee89f66)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66"
Nov 04 01:45:08.312332 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:08.312290    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:13.198591 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:45:13.198547    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:45:13.401154 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:13.401119    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:14.815909 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:14.815875    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:14.966687 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:14.966647    5572 scope.go:122] "RemoveContainer" containerID="3371c38589d4857c7b9c7c686bd21e81412ad8eb7331d890248c1a1ff8f13f0f"
Nov 04 01:45:14.966857 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:14.966757    5572 scope.go:122] "RemoveContainer" containerID="cc0721865dd03768c7a03412b0f585778bdb23ff18ce50f1281448e2e6c6c12f"
Nov 04 01:45:16.238309 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:16.238276    5572 generic.go:356] "Generic (PLEG): container finished" podID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerID="a6afe0035478a722efc990434408ca2f7c2559cd9a55c8827afcb512f1bcff82" exitCode=60
Nov 04 01:45:16.238747 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:16.238346    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt" event={"ID":"fb9432b7-2ac9-4187-b43e-3c385d86c090","Type":"ContainerDied","Data":"a6afe0035478a722efc990434408ca2f7c2559cd9a55c8827afcb512f1bcff82"}
Nov 04 01:45:16.238747 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:16.238409    5572 scope.go:122] "RemoveContainer" containerID="3371c38589d4857c7b9c7c686bd21e81412ad8eb7331d890248c1a1ff8f13f0f"
Nov 04 01:45:16.238846 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:16.238813    5572 scope.go:122] "RemoveContainer" containerID="a6afe0035478a722efc990434408ca2f7c2559cd9a55c8827afcb512f1bcff82"
Nov 04 01:45:16.239105 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:45:16.239082    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt_odh-ai-gateway-infra(fb9432b7-2ac9-4187-b43e-3c385d86c090)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090"
Nov 04 01:45:16.240555 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:16.240508    5572 generic.go:356] "Generic (PLEG): container finished" podID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerID="d988490972457e2f0dac3a909d92740fa3952166a01e6ed27fba483fe305ea6d" exitCode=60
Nov 04 01:45:16.240681 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:16.240572    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24" event={"ID":"7bb82c7b-5009-48c7-bfa2-cef74ee89f66","Type":"ContainerDied","Data":"d988490972457e2f0dac3a909d92740fa3952166a01e6ed27fba483fe305ea6d"}
Nov 04 01:45:16.240888 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:16.240874    5572 scope.go:122] "RemoveContainer" containerID="d988490972457e2f0dac3a909d92740fa3952166a01e6ed27fba483fe305ea6d"
Nov 04 01:45:16.241090 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:45:16.241072    5572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29895945-hjg24_odh-ai-gateway-infra(7bb82c7b-5009-48c7-bfa2-cef74ee89f66)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66"
Nov 04 01:45:16.249776 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:16.249752    5572 scope.go:122] "RemoveContainer" containerID="cc0721865dd03768c7a03412b0f585778bdb23ff18ce50f1281448e2e6c6c12f"
Nov 04 01:45:17.356061 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.356026    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"]
Nov 04 01:45:17.463944 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.463917    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"]
Nov 04 01:45:17.484865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.484837    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"
Nov 04 01:45:17.513364 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.513332    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb9432b7-2ac9-4187-b43e-3c385d86c090-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb9432b7-2ac9-4187-b43e-3c385d86c090-maas-api-service-ca\") pod \"fb9432b7-2ac9-4187-b43e-3c385d86c090\" (UID: \"fb9432b7-2ac9-4187-b43e-3c385d86c090\") "
Nov 04 01:45:17.513527 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.513504    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb9432b7-2ac9-4187-b43e-3c385d86c090-kube-api-access-87r2f\" (UniqueName: \"kubernetes.io/projected/fb9432b7-2ac9-4187-b43e-3c385d86c090-kube-api-access-87r2f\") pod \"fb9432b7-2ac9-4187-b43e-3c385d86c090\" (UID: \"fb9432b7-2ac9-4187-b43e-3c385d86c090\") "
Nov 04 01:45:17.513773 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.513745    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb9432b7-2ac9-4187-b43e-3c385d86c090-maas-api-service-ca" pod "fb9432b7-2ac9-4187-b43e-3c385d86c090" (UID: "fb9432b7-2ac9-4187-b43e-3c385d86c090"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:45:17.515835 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.515803    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb9432b7-2ac9-4187-b43e-3c385d86c090-kube-api-access-87r2f" pod "fb9432b7-2ac9-4187-b43e-3c385d86c090" (UID: "fb9432b7-2ac9-4187-b43e-3c385d86c090"). InnerVolumeSpecName "kube-api-access-87r2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:45:17.600021 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.599999    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"
Nov 04 01:45:17.615005 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.614931    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-maas-api-service-ca\") pod \"7bb82c7b-5009-48c7-bfa2-cef74ee89f66\" (UID: \"7bb82c7b-5009-48c7-bfa2-cef74ee89f66\") "
Nov 04 01:45:17.615180 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.615040    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-kube-api-access-5jn4b\" (UniqueName: \"kubernetes.io/projected/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-kube-api-access-5jn4b\") pod \"7bb82c7b-5009-48c7-bfa2-cef74ee89f66\" (UID: \"7bb82c7b-5009-48c7-bfa2-cef74ee89f66\") "
Nov 04 01:45:17.615255 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.615214    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87r2f\" (UniqueName: \"kubernetes.io/projected/fb9432b7-2ac9-4187-b43e-3c385d86c090-kube-api-access-87r2f\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:45:17.615255 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.615225    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb9432b7-2ac9-4187-b43e-3c385d86c090-maas-api-service-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:45:17.615255 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.615242    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-maas-api-service-ca" pod "7bb82c7b-5009-48c7-bfa2-cef74ee89f66" (UID: "7bb82c7b-5009-48c7-bfa2-cef74ee89f66"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:45:17.617042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.617018    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-kube-api-access-5jn4b" pod "7bb82c7b-5009-48c7-bfa2-cef74ee89f66" (UID: "7bb82c7b-5009-48c7-bfa2-cef74ee89f66"). InnerVolumeSpecName "kube-api-access-5jn4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:45:17.716870 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.716823    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-maas-api-service-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:45:17.716870 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:17.716865    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jn4b\" (UniqueName: \"kubernetes.io/projected/7bb82c7b-5009-48c7-bfa2-cef74ee89f66-kube-api-access-5jn4b\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:45:18.255257 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.255230    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"
Nov 04 01:45:18.255457 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.255266    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt" event={"ID":"fb9432b7-2ac9-4187-b43e-3c385d86c090","Type":"ContainerDied","Data":"c5a3eb9c008272c0faf91c8af07baba1b610c2053a9d655c50c6e0265af14a7e"}
Nov 04 01:45:18.255457 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.255320    5572 scope.go:122] "RemoveContainer" containerID="a6afe0035478a722efc990434408ca2f7c2559cd9a55c8827afcb512f1bcff82"
Nov 04 01:45:18.256809 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.256785    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24" event={"ID":"7bb82c7b-5009-48c7-bfa2-cef74ee89f66","Type":"ContainerDied","Data":"ebfea7637599075033b908d1a2bdbacef3a2d8109e62556cb3c5f95e4aa23b71"}
Nov 04 01:45:18.256892 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.256822    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"
Nov 04 01:45:18.265486 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.265464    5572 scope.go:122] "RemoveContainer" containerID="d988490972457e2f0dac3a909d92740fa3952166a01e6ed27fba483fe305ea6d"
Nov 04 01:45:18.422878 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.422842    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"]
Nov 04 01:45:18.428963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.428935    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895945-hjg24"]
Nov 04 01:45:18.517853 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.517779    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:18.534311 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.534280    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"]
Nov 04 01:45:18.538488 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.538463    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-b1047d-29895945-n2bvt"]
Nov 04 01:45:18.880735 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.880652    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:18.971814 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.971781    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" path="/var/lib/kubelet/pods/7bb82c7b-5009-48c7-bfa2-cef74ee89f66/volumes"
Nov 04 01:45:18.972192 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:18.972179    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090" path="/var/lib/kubelet/pods/fb9432b7-2ac9-4187-b43e-3c385d86c090/volumes"
Nov 04 01:45:19.416217 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:19.416178    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:23.609454 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:23.609421    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:28.693225 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:28.693190    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:33.697905 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:33.697872    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:38.806975 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:38.806925    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:43.198112 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:45:43.198076    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:45:43.886773 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:43.886741    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:48.994716 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:48.994682    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:54.086995 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:54.086961    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:45:59.106255 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:45:59.106222    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:04.196601 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:04.196566    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:07.340704 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:07.340669    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:07.486912 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:07.486881    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:09.306380 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:09.306336    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:13.008586 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:13.008552    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"]
Nov 04 01:46:13.009421 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:13.009329    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerName="istio-proxy" containerID="cri-o://87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3" gracePeriod=30
Nov 04 01:46:13.198267 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:46:13.198228    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:46:14.316890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:14.316855    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:15.155481 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:15.155454    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:16.506609 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:16.506573    5572 patch_prober.go:29] interesting pod/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 01:46:16.506998 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:16.506644    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 01:46:18.267171 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.267146    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:46:18.392557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392454    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-certs\") pod \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") "
Nov 04 01:46:18.392557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392494    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-envoy\") pod \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") "
Nov 04 01:46:18.392797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392562    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-credential-socket\") pod \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") "
Nov 04 01:46:18.392797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392620    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-socket\") pod \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") "
Nov 04 01:46:18.392797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392674    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istiod-ca-cert\") pod \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") "
Nov 04 01:46:18.392797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392708    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-podinfo\") pod \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") "
Nov 04 01:46:18.392797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392744    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-token\" (UniqueName: \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-token\") pod \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") "
Nov 04 01:46:18.393071 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392785    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-certs" pod "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" (UID: "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:18.393071 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392791    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-kube-api-access-hprk7\" (UniqueName: \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-kube-api-access-hprk7\") pod \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") "
Nov 04 01:46:18.393071 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392927    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-socket" pod "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" (UID: "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:18.393071 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392939    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-credential-socket" pod "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" (UID: "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:18.393071 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.392946    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-data\") pod \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\" (UID: \"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48\") "
Nov 04 01:46:18.393317 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.393143    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-data" pod "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" (UID: "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:18.393406 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.393383    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:18.393467 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.393406    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istiod-ca-cert" pod "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" (UID: "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:46:18.393467 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.393412    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:18.393467 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.393441    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:18.393467 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.393454    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:18.394984 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.394955    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-podinfo" pod "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" (UID: "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:46:18.395093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.395042    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-token" pod "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" (UID: "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:18.395136 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.395115    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-envoy" pod "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" (UID: "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:18.395185 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.395171    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-kube-api-access-hprk7" pod "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" (UID: "1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48"). InnerVolumeSpecName "kube-api-access-hprk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:18.493955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.493921    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:18.493955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.493954    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:18.494162 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.493967    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:18.494162 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.493980    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hprk7\" (UniqueName: \"kubernetes.io/projected/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-kube-api-access-hprk7\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:18.494162 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.493995    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:18.567804 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.567771    5572 generic.go:356] "Generic (PLEG): container finished" podID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerID="87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3" exitCode=0
Nov 04 01:46:18.568002 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.567833    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"
Nov 04 01:46:18.568002 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.567857    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" event={"ID":"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48","Type":"ContainerDied","Data":"87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3"}
Nov 04 01:46:18.568002 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.567930    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z" event={"ID":"1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48","Type":"ContainerDied","Data":"19421961fdb34f6ac1cf45c2926a979ee3129ff08bb1ddfce375cc534b7f9db6"}
Nov 04 01:46:18.568002 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.567960    5572 scope.go:122] "RemoveContainer" containerID="87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3"
Nov 04 01:46:18.578047 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.578025    5572 scope.go:122] "RemoveContainer" containerID="87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3"
Nov 04 01:46:18.578360 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:46:18.578339    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3\": container with ID starting with 87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3 not found: ID does not exist" containerID="87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3"
Nov 04 01:46:18.578466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.578373    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3"} err="failed to get container status \"87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3\": rpc error: code = NotFound desc = could not find container \"87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3\": container with ID starting with 87ece01140990c5da160bf9c2881d370833375946b9b8102133289e17af06ef3 not found: ID does not exist"
Nov 04 01:46:18.736877 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.736842    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"]
Nov 04 01:46:18.741269 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.741237    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-a96a99-openshift-default-6ccb446cf5-w9v9z"]
Nov 04 01:46:18.971972 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:18.971928    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" path="/var/lib/kubelet/pods/1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48/volumes"
Nov 04 01:46:19.216834 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:19.216767    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:19.402522 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:19.402431    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:19.769506 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:19.769457    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:24.496776 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:24.496743    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:29.585649 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:29.585613    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:32.905110 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:32.905071    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"]
Nov 04 01:46:32.905583 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:32.905274    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy" containerID="cri-o://a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5" gracePeriod=30
Nov 04 01:46:32.917012 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:32.916985    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"]
Nov 04 01:46:32.917226 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:32.917203    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerName="istio-proxy" containerID="cri-o://7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c" gracePeriod=30
Nov 04 01:46:34.658404 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:34.658357    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:37.073308 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:37.073270    5572 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5db77fbd9f-98jdc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 01:46:37.073723 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:37.073338    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 01:46:38.169711 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.169685    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:46:38.194053 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.194030    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:46:38.280768 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.280735    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-envoy\") pod \"a176b23d-38c8-4048-98ec-9bcdef3e4215\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") "
Nov 04 01:46:38.280768 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.280778    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-certs\") pod \"51640a89-0c3e-46c8-8ba4-47903cafa26f\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") "
Nov 04 01:46:38.281042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.280821    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-kube-api-access-d659w\" (UniqueName: \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-kube-api-access-d659w\") pod \"a176b23d-38c8-4048-98ec-9bcdef3e4215\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") "
Nov 04 01:46:38.281042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.280858    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-credential-socket\") pod \"a176b23d-38c8-4048-98ec-9bcdef3e4215\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") "
Nov 04 01:46:38.281042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.280913    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a176b23d-38c8-4048-98ec-9bcdef3e4215-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a176b23d-38c8-4048-98ec-9bcdef3e4215-istiod-ca-cert\") pod \"a176b23d-38c8-4048-98ec-9bcdef3e4215\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") "
Nov 04 01:46:38.281042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.280954    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-token\" (UniqueName: \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-token\") pod \"51640a89-0c3e-46c8-8ba4-47903cafa26f\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") "
Nov 04 01:46:38.281042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.280997    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-podinfo\") pod \"a176b23d-38c8-4048-98ec-9bcdef3e4215\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") "
Nov 04 01:46:38.281042 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281038    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-kube-api-access-pghm4\" (UniqueName: \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-kube-api-access-pghm4\") pod \"51640a89-0c3e-46c8-8ba4-47903cafa26f\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") "
Nov 04 01:46:38.281348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281065    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-certs\") pod \"a176b23d-38c8-4048-98ec-9bcdef3e4215\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") "
Nov 04 01:46:38.281348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281094    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-socket\") pod \"a176b23d-38c8-4048-98ec-9bcdef3e4215\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") "
Nov 04 01:46:38.281348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281146    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-token\" (UniqueName: \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-token\") pod \"a176b23d-38c8-4048-98ec-9bcdef3e4215\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") "
Nov 04 01:46:38.281348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281177    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-envoy\") pod \"51640a89-0c3e-46c8-8ba4-47903cafa26f\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") "
Nov 04 01:46:38.281348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281219    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-podinfo\") pod \"51640a89-0c3e-46c8-8ba4-47903cafa26f\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") "
Nov 04 01:46:38.281348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281258    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-socket\") pod \"51640a89-0c3e-46c8-8ba4-47903cafa26f\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") "
Nov 04 01:46:38.281348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281291    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-data\") pod \"a176b23d-38c8-4048-98ec-9bcdef3e4215\" (UID: \"a176b23d-38c8-4048-98ec-9bcdef3e4215\") "
Nov 04 01:46:38.281348 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281323    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-credential-socket\") pod \"51640a89-0c3e-46c8-8ba4-47903cafa26f\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") "
Nov 04 01:46:38.281797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281337    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a176b23d-38c8-4048-98ec-9bcdef3e4215-istiod-ca-cert" pod "a176b23d-38c8-4048-98ec-9bcdef3e4215" (UID: "a176b23d-38c8-4048-98ec-9bcdef3e4215"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:46:38.281797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281187    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-credential-socket" pod "a176b23d-38c8-4048-98ec-9bcdef3e4215" (UID: "a176b23d-38c8-4048-98ec-9bcdef3e4215"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.281797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281387    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-data\") pod \"51640a89-0c3e-46c8-8ba4-47903cafa26f\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") "
Nov 04 01:46:38.281797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281413    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-certs" pod "51640a89-0c3e-46c8-8ba4-47903cafa26f" (UID: "51640a89-0c3e-46c8-8ba4-47903cafa26f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.281797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281417    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/51640a89-0c3e-46c8-8ba4-47903cafa26f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51640a89-0c3e-46c8-8ba4-47903cafa26f-istiod-ca-cert\") pod \"51640a89-0c3e-46c8-8ba4-47903cafa26f\" (UID: \"51640a89-0c3e-46c8-8ba4-47903cafa26f\") "
Nov 04 01:46:38.281797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281603    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-certs" pod "a176b23d-38c8-4048-98ec-9bcdef3e4215" (UID: "a176b23d-38c8-4048-98ec-9bcdef3e4215"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.281797 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281782    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-socket" pod "a176b23d-38c8-4048-98ec-9bcdef3e4215" (UID: "a176b23d-38c8-4048-98ec-9bcdef3e4215"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.282166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281801    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51640a89-0c3e-46c8-8ba4-47903cafa26f-istiod-ca-cert" pod "51640a89-0c3e-46c8-8ba4-47903cafa26f" (UID: "51640a89-0c3e-46c8-8ba4-47903cafa26f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:46:38.282166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281958    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.282166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281976    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.282166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281992    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51640a89-0c3e-46c8-8ba4-47903cafa26f-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.282166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.282006    5572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.282166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.282020    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.282166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.282035    5572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a176b23d-38c8-4048-98ec-9bcdef3e4215-istiod-ca-cert\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.282166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281974    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-socket" pod "51640a89-0c3e-46c8-8ba4-47903cafa26f" (UID: "51640a89-0c3e-46c8-8ba4-47903cafa26f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.282166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.281998    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-credential-socket" pod "51640a89-0c3e-46c8-8ba4-47903cafa26f" (UID: "51640a89-0c3e-46c8-8ba4-47903cafa26f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.282579 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.282193    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-data" pod "a176b23d-38c8-4048-98ec-9bcdef3e4215" (UID: "a176b23d-38c8-4048-98ec-9bcdef3e4215"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.282579 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.282258    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-data" pod "51640a89-0c3e-46c8-8ba4-47903cafa26f" (UID: "51640a89-0c3e-46c8-8ba4-47903cafa26f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.283507 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.283481    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-kube-api-access-d659w" pod "a176b23d-38c8-4048-98ec-9bcdef3e4215" (UID: "a176b23d-38c8-4048-98ec-9bcdef3e4215"). InnerVolumeSpecName "kube-api-access-d659w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:38.283816 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.283780    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-envoy" pod "a176b23d-38c8-4048-98ec-9bcdef3e4215" (UID: "a176b23d-38c8-4048-98ec-9bcdef3e4215"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.283972 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.283946    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-token" pod "a176b23d-38c8-4048-98ec-9bcdef3e4215" (UID: "a176b23d-38c8-4048-98ec-9bcdef3e4215"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:38.284073 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.284025    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-kube-api-access-pghm4" pod "51640a89-0c3e-46c8-8ba4-47903cafa26f" (UID: "51640a89-0c3e-46c8-8ba4-47903cafa26f"). InnerVolumeSpecName "kube-api-access-pghm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:38.284198 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.284172    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-token" pod "51640a89-0c3e-46c8-8ba4-47903cafa26f" (UID: "51640a89-0c3e-46c8-8ba4-47903cafa26f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:38.284484 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.284461    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-podinfo" pod "a176b23d-38c8-4048-98ec-9bcdef3e4215" (UID: "a176b23d-38c8-4048-98ec-9bcdef3e4215"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:46:38.284484 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.284470    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-podinfo" pod "51640a89-0c3e-46c8-8ba4-47903cafa26f" (UID: "51640a89-0c3e-46c8-8ba4-47903cafa26f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 01:46:38.284726 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.284707    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-envoy" pod "51640a89-0c3e-46c8-8ba4-47903cafa26f" (UID: "51640a89-0c3e-46c8-8ba4-47903cafa26f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:46:38.383109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383077    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.383109 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383108    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.383296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383119    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pghm4\" (UniqueName: \"kubernetes.io/projected/51640a89-0c3e-46c8-8ba4-47903cafa26f-kube-api-access-pghm4\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.383296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383129    5572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-token\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.383296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383138    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.383296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383147    5572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-podinfo\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.383296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383155    5572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-workload-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.383296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383163    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.383296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383171    5572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-credential-socket\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.383296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383180    5572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51640a89-0c3e-46c8-8ba4-47903cafa26f-istio-data\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.383296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383188    5572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a176b23d-38c8-4048-98ec-9bcdef3e4215-istio-envoy\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.383296 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.383211    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d659w\" (UniqueName: \"kubernetes.io/projected/a176b23d-38c8-4048-98ec-9bcdef3e4215-kube-api-access-d659w\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:38.676355 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.676317    5572 generic.go:356] "Generic (PLEG): container finished" podID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerID="a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5" exitCode=0
Nov 04 01:46:38.676576 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.676364    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"
Nov 04 01:46:38.676576 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.676404    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" event={"ID":"a176b23d-38c8-4048-98ec-9bcdef3e4215","Type":"ContainerDied","Data":"a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5"}
Nov 04 01:46:38.676576 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.676460    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc" event={"ID":"a176b23d-38c8-4048-98ec-9bcdef3e4215","Type":"ContainerDied","Data":"7d59d5a71ca7492adf5a66635c50cb8ab2d604442ae3a005adb66115567f8b9c"}
Nov 04 01:46:38.676576 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.676491    5572 scope.go:122] "RemoveContainer" containerID="a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5"
Nov 04 01:46:38.678336 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.678309    5572 generic.go:356] "Generic (PLEG): container finished" podID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerID="7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c" exitCode=0
Nov 04 01:46:38.678472 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.678428    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" event={"ID":"51640a89-0c3e-46c8-8ba4-47903cafa26f","Type":"ContainerDied","Data":"7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c"}
Nov 04 01:46:38.678566 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.678472    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv" event={"ID":"51640a89-0c3e-46c8-8ba4-47903cafa26f","Type":"ContainerDied","Data":"34835a5921c30734653eb151125a8e9b552c8075e4cdeffc82ed47baa7853cff"}
Nov 04 01:46:38.678626 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.678572    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"
Nov 04 01:46:38.689690 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.689671    5572 scope.go:122] "RemoveContainer" containerID="a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5"
Nov 04 01:46:38.690140 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:46:38.690004    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5\": container with ID starting with a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5 not found: ID does not exist" containerID="a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5"
Nov 04 01:46:38.690140 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.690038    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5"} err="failed to get container status \"a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5\": rpc error: code = NotFound desc = could not find container \"a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5\": container with ID starting with a92a539fe4e92cd956e68c15feea3dad981c1a7678080a9043ab3b4fd33cdec5 not found: ID does not exist"
Nov 04 01:46:38.690140 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.690063    5572 scope.go:122] "RemoveContainer" containerID="7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c"
Nov 04 01:46:38.698713 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.698696    5572 scope.go:122] "RemoveContainer" containerID="7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c"
Nov 04 01:46:38.698991 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:46:38.698967    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c\": container with ID starting with 7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c not found: ID does not exist" containerID="7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c"
Nov 04 01:46:38.699107 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.698994    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c"} err="failed to get container status \"7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c\": rpc error: code = NotFound desc = could not find container \"7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c\": container with ID starting with 7c6316adc7a25d41e2ea34cdb57342d89db86cfd87f04db0a3dbcacdaceee59c not found: ID does not exist"
Nov 04 01:46:38.847645 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.847611    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"]
Nov 04 01:46:38.851704 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.851679    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-98jdc"]
Nov 04 01:46:38.963968 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.963933    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"]
Nov 04 01:46:38.972510 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.972478    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" path="/var/lib/kubelet/pods/a176b23d-38c8-4048-98ec-9bcdef3e4215/volumes"
Nov 04 01:46:38.972776 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:38.972763    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5db77fbd9f-2lkmv"]
Nov 04 01:46:39.716825 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:39.716769    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:40.977779 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:40.977744    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" path="/var/lib/kubelet/pods/51640a89-0c3e-46c8-8ba4-47903cafa26f/volumes"
Nov 04 01:46:43.198241 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:46:43.198205    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:46:44.148655 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.148625    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"]
Nov 04 01:46:44.149017 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149000    5572 cpu_manager.go:414] "containerMap: removing container" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerName="cleanup"
Nov 04 01:46:44.149060 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149018    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerName="cleanup"
Nov 04 01:46:44.149060 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149031    5572 cpu_manager.go:414] "containerMap: removing container" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerName="cleanup"
Nov 04 01:46:44.149060 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149036    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerName="cleanup"
Nov 04 01:46:44.149060 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149042    5572 cpu_manager.go:414] "containerMap: removing container" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerName="cleanup"
Nov 04 01:46:44.149060 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149047    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerName="cleanup"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149069    5572 cpu_manager.go:414] "containerMap: removing container" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerName="istio-proxy"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149074    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerName="istio-proxy"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149079    5572 cpu_manager.go:414] "containerMap: removing container" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149084    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149092    5572 cpu_manager.go:414] "containerMap: removing container" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerName="istio-proxy"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149097    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerName="istio-proxy"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149113    5572 cpu_manager.go:414] "containerMap: removing container" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerName="cleanup"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149118    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerName="cleanup"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149169    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b8c5f71-e3b2-4ee8-8bae-4749bf27dc48" containerName="istio-proxy"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149177    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="a176b23d-38c8-4048-98ec-9bcdef3e4215" containerName="istio-proxy"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149183    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="51640a89-0c3e-46c8-8ba4-47903cafa26f" containerName="istio-proxy"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149191    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerName="cleanup"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149196    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerName="cleanup"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149202    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerName="cleanup"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149207    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerName="cleanup"
Nov 04 01:46:44.149211 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.149213    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerName="cleanup"
Nov 04 01:46:44.152460 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.152442    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:44.207146 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.207109    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"]
Nov 04 01:46:44.237090 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.237050    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-xks-ca\") pod \"maas-api-revoke-sub-904649cf-jqgpl\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:44.237268 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.237096    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-904649cf-jqgpl\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:44.237268 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.237220    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7zr7\" (UniqueName: \"kubernetes.io/projected/146c41dc-fd6b-4a25-9fb1-14fb6684f225-kube-api-access-n7zr7\") pod \"maas-api-revoke-sub-904649cf-jqgpl\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:44.256870 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.256836    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 01:46:44.257036 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.256894    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-w799x\""
Nov 04 01:46:44.337839 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.337810    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-xks-ca\") pod \"maas-api-revoke-sub-904649cf-jqgpl\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:44.338049 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.337848    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-904649cf-jqgpl\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:44.338049 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.337904    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7zr7\" (UniqueName: \"kubernetes.io/projected/146c41dc-fd6b-4a25-9fb1-14fb6684f225-kube-api-access-n7zr7\") pod \"maas-api-revoke-sub-904649cf-jqgpl\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:44.338577 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.338527    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-904649cf-jqgpl\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:44.340193 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.340171    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-xks-ca\") pod \"maas-api-revoke-sub-904649cf-jqgpl\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:44.400339 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.400269    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7zr7\" (UniqueName: \"kubernetes.io/projected/146c41dc-fd6b-4a25-9fb1-14fb6684f225-kube-api-access-n7zr7\") pod \"maas-api-revoke-sub-904649cf-jqgpl\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:44.464712 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.464678    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:44.833693 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:46:44.833651    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146c41dc_fd6b_4a25_9fb1_14fb6684f225.slice/crio-858e89463cf469e7afa16f948a6a36bbc035c433103c4cb2a08cfdf8c62eda8d WatchSource:0}: Error finding container 858e89463cf469e7afa16f948a6a36bbc035c433103c4cb2a08cfdf8c62eda8d: Status 404 returned error can't find the container with id 858e89463cf469e7afa16f948a6a36bbc035c433103c4cb2a08cfdf8c62eda8d
Nov 04 01:46:44.836049 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.836025    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"]
Nov 04 01:46:44.901894 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:44.901859    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:45.721762 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:45.721723    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl" event={"ID":"146c41dc-fd6b-4a25-9fb1-14fb6684f225","Type":"ContainerStarted","Data":"09d3143b1ff86982d12ea47a2a40c208e69b7631964dbb9013537f4164a878c6"}
Nov 04 01:46:45.722141 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:45.721789    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl" event={"ID":"146c41dc-fd6b-4a25-9fb1-14fb6684f225","Type":"ContainerStarted","Data":"858e89463cf469e7afa16f948a6a36bbc035c433103c4cb2a08cfdf8c62eda8d"}
Nov 04 01:46:45.841483 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:45.841427    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl" podStartSLOduration=1.84141332 podStartE2EDuration="1.84141332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:46:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:46:45.840194416 +0000 UTC m=+2136.990402175" watchObservedRunningTime="2026-11-04 01:46:45.84141332 +0000 UTC m=+2136.991621080"
Nov 04 01:46:46.729222 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:46.729183    5572 generic.go:356] "Generic (PLEG): container finished" podID="146c41dc-fd6b-4a25-9fb1-14fb6684f225" containerID="09d3143b1ff86982d12ea47a2a40c208e69b7631964dbb9013537f4164a878c6" exitCode=0
Nov 04 01:46:46.729667 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:46.729232    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl" event={"ID":"146c41dc-fd6b-4a25-9fb1-14fb6684f225","Type":"ContainerDied","Data":"09d3143b1ff86982d12ea47a2a40c208e69b7631964dbb9013537f4164a878c6"}
Nov 04 01:46:47.867805 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:47.867781    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:47.969306 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:47.969275    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/146c41dc-fd6b-4a25-9fb1-14fb6684f225-kube-api-access-n7zr7\" (UniqueName: \"kubernetes.io/projected/146c41dc-fd6b-4a25-9fb1-14fb6684f225-kube-api-access-n7zr7\") pod \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") "
Nov 04 01:46:47.969306 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:47.969310    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-openshift-ca\") pod \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") "
Nov 04 01:46:47.969575 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:47.969388    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-xks-ca\") pod \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\" (UID: \"146c41dc-fd6b-4a25-9fb1-14fb6684f225\") "
Nov 04 01:46:47.969774 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:47.969748    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-openshift-ca" pod "146c41dc-fd6b-4a25-9fb1-14fb6684f225" (UID: "146c41dc-fd6b-4a25-9fb1-14fb6684f225"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:46:47.971336 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:47.971316    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/146c41dc-fd6b-4a25-9fb1-14fb6684f225-kube-api-access-n7zr7" pod "146c41dc-fd6b-4a25-9fb1-14fb6684f225" (UID: "146c41dc-fd6b-4a25-9fb1-14fb6684f225"). InnerVolumeSpecName "kube-api-access-n7zr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:46:47.971476 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:47.971460    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-xks-ca" pod "146c41dc-fd6b-4a25-9fb1-14fb6684f225" (UID: "146c41dc-fd6b-4a25-9fb1-14fb6684f225"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:46:48.070380 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:48.070299    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7zr7\" (UniqueName: \"kubernetes.io/projected/146c41dc-fd6b-4a25-9fb1-14fb6684f225-kube-api-access-n7zr7\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:48.070380 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:48.070331    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-openshift-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:48.070380 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:48.070345    5572 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/146c41dc-fd6b-4a25-9fb1-14fb6684f225-maas-api-xks-ca\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:46:48.740451 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:48.740423    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl"
Nov 04 01:46:48.740622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:48.740466    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-904649cf-jqgpl" event={"ID":"146c41dc-fd6b-4a25-9fb1-14fb6684f225","Type":"ContainerDied","Data":"858e89463cf469e7afa16f948a6a36bbc035c433103c4cb2a08cfdf8c62eda8d"}
Nov 04 01:46:48.740622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:48.740514    5572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="858e89463cf469e7afa16f948a6a36bbc035c433103c4cb2a08cfdf8c62eda8d"
Nov 04 01:46:50.002420 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:50.002390    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:55.003494 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:55.003463    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:57.409087 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:57.409049    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:57.554241 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:57.554209    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:46:57.899963 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:46:57.899931    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:00.011207 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:00.011175    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:05.226670 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:05.226627    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:10.300090 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:10.300051    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:13.199948 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:47:13.199910    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:47:15.124792 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:15.124758    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:15.355908 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:15.355848    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:15.511949 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:15.511914    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:19.571523 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:19.571431    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:19.771103 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:19.771070    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:20.393970 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:20.393936    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:25.494900 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:25.494863    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:25.678028 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:25.677992    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:25.822469 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:25.822366    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:25.979719 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:25.979675    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:30.251840 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:30.251808    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:31.845444 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:31.845414    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:32.185169 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:32.185078    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:37.281850 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:37.281812    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:37.575019 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:37.574936    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:37.729127 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:37.729096    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:39.228849 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:39.228816    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:39.918355 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:39.918324    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:40.807838 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:40.807806    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:42.803717 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:42.803684    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:43.199900 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:47:43.199864    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:47:46.627370 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:46.627340    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:47.827494 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:47.827459    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:47.975826 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:47.975785    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:48.121568 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:48.121467    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:52.297513 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:52.297416    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:53.302329 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:53.302243    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:57.760605 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:57.760570    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:47:59.611665 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:47:59.611623    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:04.684391 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:04.684357    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:07.148800 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:07.148770    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:07.294767 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:07.294728    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:08.815728 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:08.815695    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:09.351977 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:09.351923    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:09.869023 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:09.868965    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:10.019692 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:10.019660    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:13.198419 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:48:13.198383    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:48:14.836212 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:14.836176    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"]
Nov 04 01:48:14.990833 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:14.990785    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:15.510423 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:15.510371    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:15.861065 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:15.860960    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:17.044688 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:17.044657    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:19.914404 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:19.914351    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:20.463821 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:20.463779    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:20.611870 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:20.611833    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:23.292444 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:23.292410    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:23.418006 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:23.417971    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"]
Nov 04 01:48:23.799937 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:23.799897    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:23.957958 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:23.957926    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:25.651962 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:25.651923    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:25.800637 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:25.800606    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:25.948026 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:25.948000    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:28.418912 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:28.418861    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94" podUID="903a47a6-57b7-43f4-b347-a13ec55e8ba1" containerName="payload-processing" containerID="cri-o://e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f" gracePeriod=25
Nov 04 01:48:28.668623 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:28.668597    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:48:28.786445 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:28.786412    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/903a47a6-57b7-43f4-b347-a13ec55e8ba1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/903a47a6-57b7-43f4-b347-a13ec55e8ba1-plugins-config-volume\") pod \"903a47a6-57b7-43f4-b347-a13ec55e8ba1\" (UID: \"903a47a6-57b7-43f4-b347-a13ec55e8ba1\") "
Nov 04 01:48:28.786650 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:28.786606    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/903a47a6-57b7-43f4-b347-a13ec55e8ba1-kube-api-access-d26x4\" (UniqueName: \"kubernetes.io/projected/903a47a6-57b7-43f4-b347-a13ec55e8ba1-kube-api-access-d26x4\") pod \"903a47a6-57b7-43f4-b347-a13ec55e8ba1\" (UID: \"903a47a6-57b7-43f4-b347-a13ec55e8ba1\") "
Nov 04 01:48:28.786879 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:28.786856    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/903a47a6-57b7-43f4-b347-a13ec55e8ba1-plugins-config-volume" pod "903a47a6-57b7-43f4-b347-a13ec55e8ba1" (UID: "903a47a6-57b7-43f4-b347-a13ec55e8ba1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 01:48:28.786944 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:28.786932    5572 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/903a47a6-57b7-43f4-b347-a13ec55e8ba1-plugins-config-volume\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:28.788929 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:28.788899    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903a47a6-57b7-43f4-b347-a13ec55e8ba1-kube-api-access-d26x4" pod "903a47a6-57b7-43f4-b347-a13ec55e8ba1" (UID: "903a47a6-57b7-43f4-b347-a13ec55e8ba1"). InnerVolumeSpecName "kube-api-access-d26x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:48:28.888310 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:28.888280    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d26x4\" (UniqueName: \"kubernetes.io/projected/903a47a6-57b7-43f4-b347-a13ec55e8ba1-kube-api-access-d26x4\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:28.965373 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:28.965335    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:29.240835 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:29.240794    5572 generic.go:356] "Generic (PLEG): container finished" podID="903a47a6-57b7-43f4-b347-a13ec55e8ba1" containerID="e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f" exitCode=0
Nov 04 01:48:29.240835 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:29.240833    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"
Nov 04 01:48:29.241048 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:29.240878    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94" event={"ID":"903a47a6-57b7-43f4-b347-a13ec55e8ba1","Type":"ContainerDied","Data":"e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f"}
Nov 04 01:48:29.241048 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:29.240927    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94" event={"ID":"903a47a6-57b7-43f4-b347-a13ec55e8ba1","Type":"ContainerDied","Data":"ef1a545ec2e001b599b86daa92724be7809247d42f020419281fb05fc77d1454"}
Nov 04 01:48:29.241048 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:29.240950    5572 scope.go:122] "RemoveContainer" containerID="e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f"
Nov 04 01:48:29.249465 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:29.249434    5572 scope.go:122] "RemoveContainer" containerID="e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f"
Nov 04 01:48:29.249780 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:48:29.249760    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f\": container with ID starting with e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f not found: ID does not exist" containerID="e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f"
Nov 04 01:48:29.249855 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:29.249790    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f"} err="failed to get container status \"e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f\": rpc error: code = NotFound desc = could not find container \"e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f\": container with ID starting with e0ff89d2e049a1a80381065159fd411ed9e9de51c262af5070a05c513842b36f not found: ID does not exist"
Nov 04 01:48:29.412953 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:29.412921    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"]
Nov 04 01:48:29.464244 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:29.464211    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a96a99-757ff68588-jfr94"]
Nov 04 01:48:29.856290 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:29.856251    5572 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb" podUID="c1f9e7c3-e9e5-45fa-9674-24a429878844" containerName="main" containerID="cri-o://8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9" gracePeriod=45
Nov 04 01:48:29.935756 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:29.935722    5572 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb" podUID="c1f9e7c3-e9e5-45fa-9674-24a429878844" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": dial tcp 10.133.0.57:8000: connect: connection refused"
Nov 04 01:48:30.106483 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.106421    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:48:30.199581 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.199518    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-dshm\") pod \"c1f9e7c3-e9e5-45fa-9674-24a429878844\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") "
Nov 04 01:48:30.199775 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.199605    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1f9e7c3-e9e5-45fa-9674-24a429878844-kube-api-access-8npk2\" (UniqueName: \"kubernetes.io/projected/c1f9e7c3-e9e5-45fa-9674-24a429878844-kube-api-access-8npk2\") pod \"c1f9e7c3-e9e5-45fa-9674-24a429878844\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") "
Nov 04 01:48:30.199775 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.199636    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-model-cache\") pod \"c1f9e7c3-e9e5-45fa-9674-24a429878844\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") "
Nov 04 01:48:30.199775 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.199675    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c1f9e7c3-e9e5-45fa-9674-24a429878844-tls-certs\" (UniqueName: \"kubernetes.io/secret/c1f9e7c3-e9e5-45fa-9674-24a429878844-tls-certs\") pod \"c1f9e7c3-e9e5-45fa-9674-24a429878844\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") "
Nov 04 01:48:30.199775 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.199727    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-home\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-home\") pod \"c1f9e7c3-e9e5-45fa-9674-24a429878844\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") "
Nov 04 01:48:30.200010 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.199817    5572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-tmp-dir\") pod \"c1f9e7c3-e9e5-45fa-9674-24a429878844\" (UID: \"c1f9e7c3-e9e5-45fa-9674-24a429878844\") "
Nov 04 01:48:30.200010 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.199941    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-model-cache" pod "c1f9e7c3-e9e5-45fa-9674-24a429878844" (UID: "c1f9e7c3-e9e5-45fa-9674-24a429878844"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.200112 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.200015    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-home" pod "c1f9e7c3-e9e5-45fa-9674-24a429878844" (UID: "c1f9e7c3-e9e5-45fa-9674-24a429878844"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.200112 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.200073    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-tmp-dir" pod "c1f9e7c3-e9e5-45fa-9674-24a429878844" (UID: "c1f9e7c3-e9e5-45fa-9674-24a429878844"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.200221 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.200154    5572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-tmp-dir\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.200221 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.200169    5572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-model-cache\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.200221 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.200180    5572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-home\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.201932 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.201902    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1f9e7c3-e9e5-45fa-9674-24a429878844-tls-certs" pod "c1f9e7c3-e9e5-45fa-9674-24a429878844" (UID: "c1f9e7c3-e9e5-45fa-9674-24a429878844"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 01:48:30.201932 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.201913    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-dshm" pod "c1f9e7c3-e9e5-45fa-9674-24a429878844" (UID: "c1f9e7c3-e9e5-45fa-9674-24a429878844"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 01:48:30.202093 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.201919    5572 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1f9e7c3-e9e5-45fa-9674-24a429878844-kube-api-access-8npk2" pod "c1f9e7c3-e9e5-45fa-9674-24a429878844" (UID: "c1f9e7c3-e9e5-45fa-9674-24a429878844"). InnerVolumeSpecName "kube-api-access-8npk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 01:48:30.247393 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.247353    5572 generic.go:356] "Generic (PLEG): container finished" podID="c1f9e7c3-e9e5-45fa-9674-24a429878844" containerID="8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9" exitCode=0
Nov 04 01:48:30.247557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.247398    5572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"
Nov 04 01:48:30.247557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.247428    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb" event={"ID":"c1f9e7c3-e9e5-45fa-9674-24a429878844","Type":"ContainerDied","Data":"8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9"}
Nov 04 01:48:30.247557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.247472    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb" event={"ID":"c1f9e7c3-e9e5-45fa-9674-24a429878844","Type":"ContainerDied","Data":"9b8f1c27e3980bce8d7d94f29b016f3d771987e99d116be099042fe97eb41185"}
Nov 04 01:48:30.247557 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.247488    5572 scope.go:122] "RemoveContainer" containerID="8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9"
Nov 04 01:48:30.258689 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.258664    5572 scope.go:122] "RemoveContainer" containerID="8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9"
Nov 04 01:48:30.258936 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:48:30.258913    5572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9\": container with ID starting with 8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9 not found: ID does not exist" containerID="8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9"
Nov 04 01:48:30.258990 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.258945    5572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9"} err="failed to get container status \"8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9\": rpc error: code = NotFound desc = could not find container \"8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9\": container with ID starting with 8f50f79970b6b7501140ac4efd79cf0bd643c84b1cc40832977b1be538e629a9 not found: ID does not exist"
Nov 04 01:48:30.301185 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.301148    5572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1f9e7c3-e9e5-45fa-9674-24a429878844-tls-certs\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.301185 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.301179    5572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1f9e7c3-e9e5-45fa-9674-24a429878844-dshm\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.301185 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.301190    5572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8npk2\" (UniqueName: \"kubernetes.io/projected/c1f9e7c3-e9e5-45fa-9674-24a429878844-kube-api-access-8npk2\") on node \"ip-10-0-128-142.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 01:48:30.393490 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.393415    5572 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"]
Nov 04 01:48:30.399012 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.398985    5572 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-a96a99/distinct-w0-a96a99-kserve-775d96bf9b-ls9qb"]
Nov 04 01:48:30.971821 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.971791    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="903a47a6-57b7-43f4-b347-a13ec55e8ba1" path="/var/lib/kubelet/pods/903a47a6-57b7-43f4-b347-a13ec55e8ba1/volumes"
Nov 04 01:48:30.972228 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:30.972174    5572 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1f9e7c3-e9e5-45fa-9674-24a429878844" path="/var/lib/kubelet/pods/c1f9e7c3-e9e5-45fa-9674-24a429878844/volumes"
Nov 04 01:48:34.381111 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:34.381070    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:34.707040 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:34.707001    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:35.649166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:35.649131    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:36.185156 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:36.185116    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:40.395659 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:40.395625    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:40.581504 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:40.581468    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:43.199168 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:48:43.199128    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:48:49.465020 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:49.464973    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:51.979441 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:51.979412    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:52.135679 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:52.135645    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:52.680113 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:52.680081    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:55.295208 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:55.295175    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:55.836791 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:55.836745    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:57.494375 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:57.494343    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-4sws9_0baa384c-8887-4f98-a48c-bbc5dcdbdd7b/manager/0.log"
Nov 04 01:48:58.969747 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:58.969716    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:59.131631 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:59.131573    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:48:59.613283 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:48:59.613249    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-n977w_9462b966-29b4-41aa-bc08-6a28930960eb/manager/0.log"
Nov 04 01:49:01.064835 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:01.064803    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-9vstw_84f236fc-de75-4d71-b3a0-90edd2769871/manager/0.log"
Nov 04 01:49:01.309277 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:01.309244    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-d5rzd_cdf41f43-9778-4459-bc1f-642932346788/manager/0.log"
Nov 04 01:49:01.571612 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:01.571581    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-jhr6j_ba3793ec-759f-4c7b-8720-38062921a84c/manager/0.log"
Nov 04 01:49:01.903955 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:01.903876    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557bcb748c-j5ss5_b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d/manager/1.log"
Nov 04 01:49:02.200026 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:02.200001    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-znvc4_4821f02c-3b08-49a1-a920-a382799ea98c/server/0.log"
Nov 04 01:49:02.436578 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:02.436514    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-pxmvp_549a02b6-e1d7-4149-a87d-e27e305e9371/manager/0.log"
Nov 04 01:49:02.687956 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:02.687884    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-lcrv9_2656018a-6a83-4de6-89fe-1790533d3472/proxy/0.log"
Nov 04 01:49:03.352081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:03.352052    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557bcb748c-j5ss5_b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d/manager/0.log"
Nov 04 01:49:13.198885 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:49:13.198850    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:49:16.236482 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:16.236442    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:49:20.250205 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:20.250168    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:49:40.599408 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:40.599379    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-9vstw_84f236fc-de75-4d71-b3a0-90edd2769871/manager/0.log"
Nov 04 01:49:40.901383 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:40.901295    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-d5rzd_cdf41f43-9778-4459-bc1f-642932346788/manager/0.log"
Nov 04 01:49:41.234068 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:41.234027    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-jhr6j_ba3793ec-759f-4c7b-8720-38062921a84c/manager/0.log"
Nov 04 01:49:41.578401 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:41.578320    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557bcb748c-j5ss5_b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d/manager/1.log"
Nov 04 01:49:41.879412 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:41.879338    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-znvc4_4821f02c-3b08-49a1-a920-a382799ea98c/server/0.log"
Nov 04 01:49:42.119542 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:42.119498    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-pxmvp_549a02b6-e1d7-4149-a87d-e27e305e9371/manager/0.log"
Nov 04 01:49:42.390081 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:42.390053    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-lcrv9_2656018a-6a83-4de6-89fe-1790533d3472/proxy/0.log"
Nov 04 01:49:43.109847 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:43.109812    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557bcb748c-j5ss5_b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d/manager/0.log"
Nov 04 01:49:43.198469 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:49:43.198432    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:49:44.405497 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:44.405463    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-904649cf-jqgpl_146c41dc-fd6b-4a25-9fb1-14fb6684f225/revoke-keys/0.log"
Nov 04 01:49:44.868591 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:44.868560    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-786hw_6cc63a3a-db58-4a8b-bed4-3d7007f21e89/postgres/0.log"
Nov 04 01:49:47.321795 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:47.321765    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-4sws9_0baa384c-8887-4f98-a48c-bbc5dcdbdd7b/manager/0.log"
Nov 04 01:49:49.190220 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:49.190188    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-n977w_9462b966-29b4-41aa-bc08-6a28930960eb/manager/0.log"
Nov 04 01:49:50.250890 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:50.250857    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl_4bdd25f7-153c-428e-b2ce-c5ae2457bb04/istio-proxy/0.log"
Nov 04 01:49:51.748866 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:49:51.748832    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5db77fbd9f-fn6tt_c7b8b30e-582c-4fe9-a096-022b7305e123/istio-proxy/0.log"
Nov 04 01:50:13.198827 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:50:13.198794    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:50:16.516463 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.516430    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:50:16.601033 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.600992    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pfwh8/must-gather-z67f8"]
Nov 04 01:50:16.601574 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601555    5572 cpu_manager.go:414] "containerMap: removing container" podUID="146c41dc-fd6b-4a25-9fb1-14fb6684f225" containerName="revoke-keys"
Nov 04 01:50:16.601622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601577    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="146c41dc-fd6b-4a25-9fb1-14fb6684f225" containerName="revoke-keys"
Nov 04 01:50:16.601622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601604    5572 cpu_manager.go:414] "containerMap: removing container" podUID="c1f9e7c3-e9e5-45fa-9674-24a429878844" containerName="main"
Nov 04 01:50:16.601622 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601612    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1f9e7c3-e9e5-45fa-9674-24a429878844" containerName="main"
Nov 04 01:50:16.601717 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601643    5572 cpu_manager.go:414] "containerMap: removing container" podUID="903a47a6-57b7-43f4-b347-a13ec55e8ba1" containerName="payload-processing"
Nov 04 01:50:16.601717 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601651    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="903a47a6-57b7-43f4-b347-a13ec55e8ba1" containerName="payload-processing"
Nov 04 01:50:16.601717 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601675    5572 cpu_manager.go:414] "containerMap: removing container" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerName="cleanup"
Nov 04 01:50:16.601717 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601682    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb9432b7-2ac9-4187-b43e-3c385d86c090" containerName="cleanup"
Nov 04 01:50:16.601717 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601693    5572 cpu_manager.go:414] "containerMap: removing container" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerName="cleanup"
Nov 04 01:50:16.601717 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601700    5572 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerName="cleanup"
Nov 04 01:50:16.601893 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601781    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="903a47a6-57b7-43f4-b347-a13ec55e8ba1" containerName="payload-processing"
Nov 04 01:50:16.601893 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601794    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="7bb82c7b-5009-48c7-bfa2-cef74ee89f66" containerName="cleanup"
Nov 04 01:50:16.601893 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601805    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="146c41dc-fd6b-4a25-9fb1-14fb6684f225" containerName="revoke-keys"
Nov 04 01:50:16.601893 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.601815    5572 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1f9e7c3-e9e5-45fa-9674-24a429878844" containerName="main"
Nov 04 01:50:16.605590 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.605565    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfwh8/must-gather-z67f8"
Nov 04 01:50:16.652029 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.651994    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kssgc\" (UniqueName: \"kubernetes.io/projected/bd3da167-091a-429c-a0b6-acd4e9820a52-kube-api-access-kssgc\") pod \"must-gather-z67f8\" (UID: \"bd3da167-091a-429c-a0b6-acd4e9820a52\") " pod="openshift-must-gather-pfwh8/must-gather-z67f8"
Nov 04 01:50:16.652185 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.652146    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bd3da167-091a-429c-a0b6-acd4e9820a52-must-gather-output\") pod \"must-gather-z67f8\" (UID: \"bd3da167-091a-429c-a0b6-acd4e9820a52\") " pod="openshift-must-gather-pfwh8/must-gather-z67f8"
Nov 04 01:50:16.658721 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.658688    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfwh8/must-gather-z67f8"]
Nov 04 01:50:16.671719 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.671685    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:50:16.706709 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.706672    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pfwh8\"/\"openshift-service-ca.crt\""
Nov 04 01:50:16.706709 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.706694    5572 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pfwh8\"/\"kube-root-ca.crt\""
Nov 04 01:50:16.710631 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.710612    5572 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pfwh8\"/\"default-dockercfg-btrqg\""
Nov 04 01:50:16.753189 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.753154    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bd3da167-091a-429c-a0b6-acd4e9820a52-must-gather-output\") pod \"must-gather-z67f8\" (UID: \"bd3da167-091a-429c-a0b6-acd4e9820a52\") " pod="openshift-must-gather-pfwh8/must-gather-z67f8"
Nov 04 01:50:16.753359 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.753216    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kssgc\" (UniqueName: \"kubernetes.io/projected/bd3da167-091a-429c-a0b6-acd4e9820a52-kube-api-access-kssgc\") pod \"must-gather-z67f8\" (UID: \"bd3da167-091a-429c-a0b6-acd4e9820a52\") " pod="openshift-must-gather-pfwh8/must-gather-z67f8"
Nov 04 01:50:16.753580 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.753559    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bd3da167-091a-429c-a0b6-acd4e9820a52-must-gather-output\") pod \"must-gather-z67f8\" (UID: \"bd3da167-091a-429c-a0b6-acd4e9820a52\") " pod="openshift-must-gather-pfwh8/must-gather-z67f8"
Nov 04 01:50:16.817664 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.817599    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kssgc\" (UniqueName: \"kubernetes.io/projected/bd3da167-091a-429c-a0b6-acd4e9820a52-kube-api-access-kssgc\") pod \"must-gather-z67f8\" (UID: \"bd3da167-091a-429c-a0b6-acd4e9820a52\") " pod="openshift-must-gather-pfwh8/must-gather-z67f8"
Nov 04 01:50:16.920776 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:16.920743    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfwh8/must-gather-z67f8"
Nov 04 01:50:17.294151 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:50:17.294110    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd3da167_091a_429c_a0b6_acd4e9820a52.slice/crio-2cd8e8edbf6db6803aba55e3c7ff865cb09681df5d6cb6f50961b37694594a3f WatchSource:0}: Error finding container 2cd8e8edbf6db6803aba55e3c7ff865cb09681df5d6cb6f50961b37694594a3f: Status 404 returned error can't find the container with id 2cd8e8edbf6db6803aba55e3c7ff865cb09681df5d6cb6f50961b37694594a3f
Nov 04 01:50:17.296483 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:17.296465    5572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 01:50:17.296654 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:17.296631    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfwh8/must-gather-z67f8"]
Nov 04 01:50:17.790105 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:17.790072    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfwh8/must-gather-z67f8" event={"ID":"bd3da167-091a-429c-a0b6-acd4e9820a52","Type":"ContainerStarted","Data":"2cd8e8edbf6db6803aba55e3c7ff865cb09681df5d6cb6f50961b37694594a3f"}
Nov 04 01:50:19.803026 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:19.802985    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfwh8/must-gather-z67f8" event={"ID":"bd3da167-091a-429c-a0b6-acd4e9820a52","Type":"ContainerStarted","Data":"0012778feb1268ae71ada2ab6d1cbda1bf4e554fc61a05a71d1eb617d5a3ac34"}
Nov 04 01:50:19.803445 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:19.803041    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfwh8/must-gather-z67f8" event={"ID":"bd3da167-091a-429c-a0b6-acd4e9820a52","Type":"ContainerStarted","Data":"db0a45841ffcccefceccc7918af0b12c8169a33a78d6a7d43226f259b378d6e2"}
Nov 04 01:50:19.923734 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:19.923682    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-pfwh8/must-gather-z67f8" podStartSLOduration=2.378621653 podStartE2EDuration="3.923669903s" totalImagesPullingTime="1.54504825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 01:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:50:19.920973672 +0000 UTC m=+2351.071181431" watchObservedRunningTime="2026-11-04 01:50:19.923669903 +0000 UTC m=+2351.073877662"
Nov 04 01:50:20.610355 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:20.610316    5572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log" limit=1024
Nov 04 01:50:26.732553 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:26.731119    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c5jls_41d83d70-c53d-4e05-9ef0-54918d176ee0/global-pull-secret-syncer/0.log"
Nov 04 01:50:28.249086 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:28.249029    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-9vstw_84f236fc-de75-4d71-b3a0-90edd2769871/manager/0.log"
Nov 04 01:50:28.491318 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:28.491285    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-d5rzd_cdf41f43-9778-4459-bc1f-642932346788/manager/0.log"
Nov 04 01:50:28.876809 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:28.876767    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-jhr6j_ba3793ec-759f-4c7b-8720-38062921a84c/manager/0.log"
Nov 04 01:50:28.992783 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:28.992746    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557bcb748c-j5ss5_b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d/manager/0.log"
Nov 04 01:50:29.064221 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:29.064164    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557bcb748c-j5ss5_b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d/manager/1.log"
Nov 04 01:50:29.183603 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:29.179285    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-znvc4_4821f02c-3b08-49a1-a920-a382799ea98c/server/0.log"
Nov 04 01:50:29.371438 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:29.369491    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gpw4g_a1b6756a-77d7-4a73-9900-9a739b6c3a21/konnectivity-agent/0.log"
Nov 04 01:50:30.009567 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:30.009331    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-pxmvp_549a02b6-e1d7-4149-a87d-e27e305e9371/manager/0.log"
Nov 04 01:50:30.127556 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:30.124236    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-lcrv9_2656018a-6a83-4de6-89fe-1790533d3472/proxy/0.log"
Nov 04 01:50:30.776235 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:30.776193    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-142.us-west-2.compute.internal_a2c9bab5e4ee3b4b58012399d0a10eff/haproxy/0.log"
Nov 04 01:50:33.137277 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:33.137243    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-9vstw_84f236fc-de75-4d71-b3a0-90edd2769871/manager/0.log"
Nov 04 01:50:33.381556 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:33.380951    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-d5rzd_cdf41f43-9778-4459-bc1f-642932346788/manager/0.log"
Nov 04 01:50:33.692389 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:33.692358    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-jhr6j_ba3793ec-759f-4c7b-8720-38062921a84c/manager/0.log"
Nov 04 01:50:33.856747 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:33.856717    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557bcb748c-j5ss5_b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d/manager/0.log"
Nov 04 01:50:33.929662 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:33.929613    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557bcb748c-j5ss5_b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d/manager/1.log"
Nov 04 01:50:34.047466 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:34.047376    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-znvc4_4821f02c-3b08-49a1-a920-a382799ea98c/server/0.log"
Nov 04 01:50:34.850327 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:34.850293    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-pxmvp_549a02b6-e1d7-4149-a87d-e27e305e9371/manager/0.log"
Nov 04 01:50:34.990076 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:34.990044    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-lcrv9_2656018a-6a83-4de6-89fe-1790533d3472/proxy/0.log"
Nov 04 01:50:35.607550 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:35.607516    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-4sws9_0baa384c-8887-4f98-a48c-bbc5dcdbdd7b/manager/0.log"
Nov 04 01:50:36.093706 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.093668    5572 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"]
Nov 04 01:50:36.099231 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.099203    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.151986 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.151947    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"]
Nov 04 01:50:36.212564 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.212506    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-proc\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.212735 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.212623    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-lib-modules\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.212735 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.212701    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97g2m\" (UniqueName: \"kubernetes.io/projected/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-kube-api-access-97g2m\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.212816 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.212733    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-podres\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.212869 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.212832    5572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-sys\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.314166 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.314129    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-sys\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.314349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.314209    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-proc\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.314349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.314241    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-lib-modules\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.314349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.314254    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-sys\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.314349 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.314329    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-lib-modules\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.314512 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.314355    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97g2m\" (UniqueName: \"kubernetes.io/projected/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-kube-api-access-97g2m\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.314512 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.314391    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-proc\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.314512 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.314394    5572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-podres\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.314512 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.314442    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-podres\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.377610 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.377543    5572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97g2m\" (UniqueName: \"kubernetes.io/projected/0595f08e-388a-4a2a-a1f5-f36ca1c657d8-kube-api-access-97g2m\") pod \"perf-node-gather-daemonset-gwqtx\" (UID: \"0595f08e-388a-4a2a-a1f5-f36ca1c657d8\") " pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.418193 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.418157    5572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:36.792250 ip-10-0-128-142 kubenswrapper[5572]: W1104 01:50:36.792213    5572 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0595f08e_388a_4a2a_a1f5_f36ca1c657d8.slice/crio-72a78aff6f6d1f3303149f5d233392ce6ad292b26868715e280d9179282d041a WatchSource:0}: Error finding container 72a78aff6f6d1f3303149f5d233392ce6ad292b26868715e280d9179282d041a: Status 404 returned error can't find the container with id 72a78aff6f6d1f3303149f5d233392ce6ad292b26868715e280d9179282d041a
Nov 04 01:50:36.794785 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.794725    5572 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"]
Nov 04 01:50:36.947811 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.947772    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx" event={"ID":"0595f08e-388a-4a2a-a1f5-f36ca1c657d8","Type":"ContainerStarted","Data":"c03a637abbd3542c6c67b71fe62e5870f840097fd66cbff478471b7f3d484a03"}
Nov 04 01:50:36.948006 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.947831    5572 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx" event={"ID":"0595f08e-388a-4a2a-a1f5-f36ca1c657d8","Type":"ContainerStarted","Data":"72a78aff6f6d1f3303149f5d233392ce6ad292b26868715e280d9179282d041a"}
Nov 04 01:50:36.948006 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:36.947854    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:37.068437 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:37.068319    5572 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx" podStartSLOduration=1.068301672 podStartE2EDuration="1.068301672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 01:50:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 01:50:37.067919327 +0000 UTC m=+2368.218127081" watchObservedRunningTime="2026-11-04 01:50:37.068301672 +0000 UTC m=+2368.218509432"
Nov 04 01:50:38.064966 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:38.064937    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-9vstw_84f236fc-de75-4d71-b3a0-90edd2769871/manager/0.log"
Nov 04 01:50:38.134390 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:38.134349    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-n977w_9462b966-29b4-41aa-bc08-6a28930960eb/manager/0.log"
Nov 04 01:50:38.301409 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:38.301376    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-d5rzd_cdf41f43-9778-4459-bc1f-642932346788/manager/0.log"
Nov 04 01:50:38.634581 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:38.634526    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-jhr6j_ba3793ec-759f-4c7b-8720-38062921a84c/manager/0.log"
Nov 04 01:50:38.800089 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:38.800055    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557bcb748c-j5ss5_b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d/manager/0.log"
Nov 04 01:50:38.867344 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:38.867307    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-557bcb748c-j5ss5_b1980d6a-2a7c-4042-882f-3f5ee4e9ad8d/manager/1.log"
Nov 04 01:50:38.984395 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:38.984370    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-znvc4_4821f02c-3b08-49a1-a920-a382799ea98c/server/0.log"
Nov 04 01:50:39.678314 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:39.678272    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-pxmvp_549a02b6-e1d7-4149-a87d-e27e305e9371/manager/0.log"
Nov 04 01:50:39.818258 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:39.818231    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-lcrv9_2656018a-6a83-4de6-89fe-1790533d3472/proxy/0.log"
Nov 04 01:50:42.962970 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:42.962938    5572 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pfwh8/perf-node-gather-daemonset-gwqtx"
Nov 04 01:50:43.043463 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:43.043431    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6c786f9b57m5fpl_4bdd25f7-153c-428e-b2ce-c5ae2457bb04/istio-proxy/0.log"
Nov 04 01:50:43.198263 ip-10-0-128-142 kubenswrapper[5572]: E1104 01:50:43.198229    5572 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-pnhc2" containerName="extractor"
Nov 04 01:50:44.943946 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:44.943918    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5db77fbd9f-fn6tt_c7b8b30e-582c-4fe9-a096-022b7305e123/istio-proxy/0.log"
Nov 04 01:50:46.107865 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:46.107829    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-v7gwr_45b64324-82f2-4075-80e1-50255e083d70/monitoring-plugin/0.log"
Nov 04 01:50:49.329053 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:49.329021    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vp26r_cceb3236-3f5d-4711-86f2-6d13d8e2b92b/node-exporter/0.log"
Nov 04 01:50:49.658365 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:49.658294    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-4sws9_0baa384c-8887-4f98-a48c-bbc5dcdbdd7b/manager/0.log"
Nov 04 01:50:49.766905 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:49.766877    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vp26r_cceb3236-3f5d-4711-86f2-6d13d8e2b92b/kube-rbac-proxy/0.log"
Nov 04 01:50:50.203512 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:50.203478    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vp26r_cceb3236-3f5d-4711-86f2-6d13d8e2b92b/init-textfile/0.log"
Nov 04 01:50:51.041138 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:51.041097    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-n977w_9462b966-29b4-41aa-bc08-6a28930960eb/manager/0.log"
Nov 04 01:50:51.994014 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:51.993989    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4539d83a-2619-4cc4-9323-e573091c2e15/prometheus/0.log"
Nov 04 01:50:52.432401 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:52.432331    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4539d83a-2619-4cc4-9323-e573091c2e15/config-reloader/0.log"
Nov 04 01:50:52.885002 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:52.884975    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4539d83a-2619-4cc4-9323-e573091c2e15/thanos-sidecar/0.log"
Nov 04 01:50:53.329385 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:53.329355    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4539d83a-2619-4cc4-9323-e573091c2e15/kube-rbac-proxy-web/0.log"
Nov 04 01:50:53.777386 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:53.777359    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4539d83a-2619-4cc4-9323-e573091c2e15/kube-rbac-proxy/0.log"
Nov 04 01:50:54.249810 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:54.249781    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4539d83a-2619-4cc4-9323-e573091c2e15/kube-rbac-proxy-thanos/0.log"
Nov 04 01:50:54.692878 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:54.692852    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4539d83a-2619-4cc4-9323-e573091c2e15/init-config-reloader/0.log"
Nov 04 01:50:55.152943 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:55.152874    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-4nf8k_bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3/prometheus-operator/0.log"
Nov 04 01:50:55.590517 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:55.590490    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-4nf8k_bc24cc4d-f739-4d7c-b32c-a134c5ca3ca3/kube-rbac-proxy/0.log"
Nov 04 01:50:56.520033 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:56.520005    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c54ddf549-f2j28_a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/telemeter-client/0.log"
Nov 04 01:50:56.991418 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:56.991388    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c54ddf549-f2j28_a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/reload/0.log"
Nov 04 01:50:57.431733 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:57.431651    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c54ddf549-f2j28_a7adfcf1-0fc4-4e7f-a94f-5cfaebcf397e/kube-rbac-proxy/0.log"
Nov 04 01:50:57.882155 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:57.882120    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4b759ddc-s75m9_34189a58-fb9a-4726-9160-6b3e765770ed/thanos-query/0.log"
Nov 04 01:50:58.340996 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:58.340968    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4b759ddc-s75m9_34189a58-fb9a-4726-9160-6b3e765770ed/kube-rbac-proxy-web/0.log"
Nov 04 01:50:58.784753 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:58.784727    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4b759ddc-s75m9_34189a58-fb9a-4726-9160-6b3e765770ed/kube-rbac-proxy/0.log"
Nov 04 01:50:59.235206 ip-10-0-128-142 kubenswrapper[5572]: I1104 01:50:59.235170    5572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4b759ddc-s75m9_34189a58-fb9a-4726-9160-6b3e765770ed/prom-label-proxy/0.log"