Nov 04 05:27:42.886811 ip-10-0-141-135 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 05:27:43.261713 ip-10-0-141-135 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:27:43.261713 ip-10-0-141-135 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 05:27:43.261713 ip-10-0-141-135 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:27:43.261713 ip-10-0-141-135 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:27:43.266656 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266570    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:43.266656 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266655    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:43.266656 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266660    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266664    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266667    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266670    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266673    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266676    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266679    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266682    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266685    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266687    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266690    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266693    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266695    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266698    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266701    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266703    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266706    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266708    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266712    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:43.266752 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266715    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266718    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266721    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266723    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266726    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266729    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266731    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266734    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266736    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266739    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266742    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266744    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266747    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266749    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266753    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266756    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266760    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266763    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266766    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266769    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:43.267193 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266772    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266775    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266778    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266780    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266783    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266786    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266809    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266812    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266817    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266822    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266826    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266828    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266832    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266834    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266837    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266840    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266844    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266848    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266851    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:43.267679 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266855    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266858    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266861    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266864    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266866    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266869    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266872    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266875    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266878    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266881    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266883    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266886    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266889    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266891    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266894    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266897    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266900    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266903    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266906    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266908    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:43.268126 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266911    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266914    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266917    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266919    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266922    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266924    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266927    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266929    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266932    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266935    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266937    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266940    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266943    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266946    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266948    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266951    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266953    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266956    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266959    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266962    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:43.268611 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266964    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266968    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266971    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266973    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266976    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.266979    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267786    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267793    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267796    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267799    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267802    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267805    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267807    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267810    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267813    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267816    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267819    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267821    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267824    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:43.269089 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267826    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267829    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267832    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267834    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267837    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267840    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267843    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267846    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267848    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267851    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267856    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267859    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267861    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267864    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267867    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267869    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267872    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267874    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267877    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267879    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:43.269555 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267882    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267885    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267887    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267890    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267893    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267895    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267898    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267901    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267903    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267906    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267908    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267911    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267913    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267916    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267918    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267921    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267923    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267926    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267930    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267932    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:43.270035 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267935    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267937    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267941    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267944    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267946    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267949    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267952    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267954    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267957    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267960    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267962    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267964    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267967    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267971    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267975    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267978    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267981    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267984    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267986    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:43.270532 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267989    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267993    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267996    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.267999    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268002    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268006    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268010    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268014    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268018    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268020    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268023    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268026    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268029    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268032    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268034    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268038    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268041    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268043    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268046    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:43.270995 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268048    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268051    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268054    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268057    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268059    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268062    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268064    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268067    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268070    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268073    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268075    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268078    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268081    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268083    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268086    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268652    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268659    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268663    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268666    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268670    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:43.271467 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268673    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268675    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268679    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268681    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268684    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268686    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268689    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268691    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268695    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268697    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268700    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268703    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268706    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268708    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268711    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268714    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268716    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268719    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268721    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268724    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:43.271960 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268726    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268729    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268731    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268734    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268736    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268739    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268742    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268745    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268747    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268750    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268752    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268755    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268759    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268762    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268765    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268769    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268772    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268776    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:43.272439 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268779    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268782    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268785    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268788    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268790    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268793    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268796    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268799    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268801    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268804    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268807    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268809    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268812    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268815    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268817    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268820    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268822    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268825    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268827    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268831    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:43.272901 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268834    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268836    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268840    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268842    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268845    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268848    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268850    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268853    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268855    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268857    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268860    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268863    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268865    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268867    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268870    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268872    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268875    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268877    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268880    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268882    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:43.273366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268885    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268888    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268890    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268893    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268895    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268898    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268900    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268903    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268905    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268908    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268910    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268915    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268917    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268920    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268923    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268926    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268928    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268932    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268934    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:43.273845 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268937    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268939    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268942    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.268944    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269034    2579 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269042    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269051    2579 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269059    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269066    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269070    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269080    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269084    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269087    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269090    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269094    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269098    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269101    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269105    2579 flags.go:64] FLAG: --cgroup-root=""
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269108    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269112    2579 flags.go:64] FLAG: --client-ca-file=""
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269115    2579 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269118    2579 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269123    2579 flags.go:64] FLAG: --cluster-domain=""
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269126    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 05:27:43.274429 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269131    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269135    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269138    2579 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269144    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269147    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269151    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269154    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269158    2579 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269161    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269164    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269168    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269171    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269175    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269179    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269182    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269185    2579 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269188    2579 flags.go:64] FLAG: --enable-server="true"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269191    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269196    2579 flags.go:64] FLAG: --event-burst="100"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269206    2579 flags.go:64] FLAG: --event-qps="50"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269220    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269224    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269227    2579 flags.go:64] FLAG: --eviction-hard=""
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269232    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 05:27:43.274998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269235    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269238    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269241    2579 flags.go:64] FLAG: --eviction-soft=""
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269244    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269247    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269250    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269253    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269256    2579 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269261    2579 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269263    2579 flags.go:64] FLAG: --feature-gates=""
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269268    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269272    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269276    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269279    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269283    2579 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269287    2579 flags.go:64] FLAG: --help="false"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269290    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269293    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269296    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269299    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269303    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269306    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269309    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 05:27:43.275748 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269312    2579 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269315    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269318    2579 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269321    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269324    2579 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269327    2579 flags.go:64] FLAG: --kube-reserved=""
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269330    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269333    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269337    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269341    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269344    2579 flags.go:64] FLAG: --lock-file=""
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269347    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269350    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269353    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269359    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269361    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269365    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269369    2579 flags.go:64] FLAG: --logging-format="text"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269372    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269376    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269381    2579 flags.go:64] FLAG: --manifest-url=""
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269384    2579 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269389    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269393    2579 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269398    2579 flags.go:64] FLAG: --max-pods="110"
Nov 04 05:27:43.276292 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269401    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269404    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269407    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269411    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269414    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269417    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269420    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269428    2579 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269431    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269434    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269437    2579 flags.go:64] FLAG: --pod-cidr=""
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269440    2579 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269443    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269447    2579 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269450    2579 flags.go:64] FLAG: --port="10250"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269453    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269456    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-084f2a1523833e1cc"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269459    2579 flags.go:64] FLAG: --qos-reserved=""
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269462    2579 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269466    2579 flags.go:64] FLAG: --register-node="true"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269469    2579 flags.go:64] FLAG: --register-with-taints=""
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269472    2579 flags.go:64] FLAG: --registry-burst="10"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269475    2579 flags.go:64] FLAG: --registry-qps="5"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269478    2579 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269483    2579 flags.go:64] FLAG: --reserved-memory=""
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269487    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 05:27:43.277104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269490    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269494    2579 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269510    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269513    2579 flags.go:64] FLAG: --runonce="false"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269517    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269520    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269523    2579 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269527    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269530    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269533    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269536    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269539    2579 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269542    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269546    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269549    2579 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269551    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269555    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269558    2579 flags.go:64] FLAG: --system-cgroups=""
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269561    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269566    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269569    2579 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269572    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269577    2579 flags.go:64] FLAG: --tls-min-version=""
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269580    2579 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269583    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 05:27:43.278024 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269586    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269589    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269592    2579 flags.go:64] FLAG: --v="2"
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269597    2579 flags.go:64] FLAG: --version="false"
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269601    2579 flags.go:64] FLAG: --vmodule=""
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269607    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.269611    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269750    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269754    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269757    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269761    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269763    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269766    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269769    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269773    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269776    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269779    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269781    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269784    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269787    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269789    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:43.278632 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269792    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269795    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269797    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269800    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269803    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269805    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269808    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269811    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269813    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269816    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269819    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269821    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269824    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269827    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269829    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269832    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269835    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269838    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269841    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:43.279131 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269845    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269847    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269850    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269852    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269855    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269858    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269861    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269864    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269867    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269869    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269872    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269877    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269881    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269884    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269886    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269889    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269893    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269895    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269898    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:43.279646 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269900    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269903    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269905    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269908    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269911    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269913    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269916    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269918    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269921    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269923    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269928    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269930    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269933    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269937    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269939    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269942    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269945    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269948    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269950    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269953    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:43.280100 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269956    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269959    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269962    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269964    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269967    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269970    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269973    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269975    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269978    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269980    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269983    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269986    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269988    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269991    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269994    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269996    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.269999    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270001    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270004    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270007    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:43.280586 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270009    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270012    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270016    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270018    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270021    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270026    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270030    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270034    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270037    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270039    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270042    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270045    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270048    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270051    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.270080    2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:27:43.281055 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270116    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270120    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270124    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270127    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270130    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270132    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270135    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270137    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270140    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270143    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270145    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270148    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270151    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270153    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270156    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270158    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270161    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270164    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270167    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270170    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:43.281405 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270173    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270177    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270180    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270185    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270188    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270191    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270193    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270196    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270198    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270201    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270203    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270206    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270209    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270212    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270215    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270217    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270220    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270222    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270225    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270228    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:43.281979 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270230    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270233    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270235    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270238    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270241    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270243    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270246    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270248    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270251    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270254    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270257    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270260    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270263    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270265    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270268    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270272    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270275    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270278    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270280    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270283    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:43.282458 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270285    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270288    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270291    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270293    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270296    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270299    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270301    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270304    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270307    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270309    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270311    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270314    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270317    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270319    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270323    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270326    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270329    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270332    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270335    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:43.282937 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270338    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270347    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270350    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270353    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270357    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270360    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270362    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270365    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270369    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270372    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270376    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270378    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270381    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270383    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270386    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270389    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270391    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270394    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270396    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270405    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:43.283373 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270408    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270411    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270414    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270416    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270419    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270421    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.270424    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.278193    2579 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.278213    2579 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.278232    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.278237    2579 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278313    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278323    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278327    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278333    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278336    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278346    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278350    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278354    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:43.283911 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278357    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278360    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278362    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278365    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278368    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278371    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278373    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278376    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278379    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278381    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278384    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278386    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278389    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278391    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278394    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278397    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278399    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278402    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278404    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:43.284355 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278408    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278412    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278415    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278417    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278420    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278422    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278425    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278428    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278431    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278433    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278436    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278438    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278441    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278443    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278446    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278448    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278452    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278457    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278460    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:43.284828 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278463    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278466    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278468    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278471    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278474    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278476    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278479    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278482    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278485    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278487    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278490    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278492    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278495    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278514    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278519    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278522    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278525    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278528    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278531    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278534    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:43.285328 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278537    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278539    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278542    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278545    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278547    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278550    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278552    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278555    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278558    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278560    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278563    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278565    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278568    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278572    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278574    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278577    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278579    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278582    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278585    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278587    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:43.285814 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278590    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278592    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278595    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278599    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278603    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278606    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278610    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278613    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278615    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278618    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278622    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278624    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278627    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278629    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278632    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278635    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278638    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278641    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278643    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:43.286287 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278646    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.278677    2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278831    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278836    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278840    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278843    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278846    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278849    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278852    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278855    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278857    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278860    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278863    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278865    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278868    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278870    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:43.286746 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278873    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278876    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278879    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278881    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278884    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278887    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278891    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278895    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278898    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278901    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278903    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278906    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278908    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278911    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278913    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278916    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278919    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278921    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278924    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278926    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:43.287112 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278929    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278931    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278934    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278937    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278940    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278943    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278946    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278948    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278951    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278954    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278956    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278959    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278962    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278965    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278967    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278970    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278973    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278976    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278979    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278981    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:43.287691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278984    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278986    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278989    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278991    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278994    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278996    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.278999    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279002    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279004    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279007    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279009    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279012    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279015    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279017    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279019    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279022    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279024    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279028    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279030    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279033    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:43.288163 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279035    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279038    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279040    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279043    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279046    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279048    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279051    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279053    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279056    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279059    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279061    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279064    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279067    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279069    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279072    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279075    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279078    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279082    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279085    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:43.288669 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279088    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279090    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279093    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279095    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279098    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279101    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279104    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279106    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279109    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279111    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279114    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279117    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279120    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.279142    2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279175    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:27:43.289123 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279179    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279182    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279184    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279187    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279190    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279193    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279195    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279198    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279201    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279204    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279207    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279209    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279212    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279214    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279217    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279220    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279223    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279226    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279228    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279231    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:27:43.289468 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279234    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279236    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279239    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279241    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279244    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279247    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279249    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279265    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279268    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279272    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279274    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279277    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279280    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279283    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279285    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279288    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279291    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279294    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279297    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279300    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:27:43.289951 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279303    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279305    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279308    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279311    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279314    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279316    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279319    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279322    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279324    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279327    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279330    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279332    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279335    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279337    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279340    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279342    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279345    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279348    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279351    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279354    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:27:43.290443 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279357    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279360    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279364    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279366    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279369    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279372    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279375    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279379    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279383    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279386    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279389    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279392    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279394    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279397    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279400    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279402    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279405    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279408    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279410    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:27:43.290925 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279413    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279415    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279418    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279420    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279423    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279425    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279428    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279430    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279433    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279436    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279438    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279440    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279444    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279447    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279449    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279452    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279455    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279458    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279460    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279463    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:27:43.291366 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279465    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279468    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279470    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279473    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279477    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:43.279481    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.279561    2579 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.284821    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.285881    2579 server.go:1014] "Starting client certificate rotation"
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.285984    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.286023    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.287829    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:27:43.291950 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.289019    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:27:43.298434 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.298416    2579 log.go:25] "Validated CRI v1 runtime API"
Nov 04 05:27:43.303304 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.303286    2579 log.go:25] "Validated CRI v1 image API"
Nov 04 05:27:43.304199 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.304176    2579 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 05:27:43.308118 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.308099    2579 fs.go:135] Filesystem UUIDs: map[2b01b889-4a31-4b46-93df-ab13e369ebb6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a1d93fbe-de53-4cb5-a61a-08fc0ee6045f:/dev/nvme0n1p4]
Nov 04 05:27:43.308179 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.308117    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 04 05:27:43.315355 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.315331    2579 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 05:27:43.315863 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.315745    2579 manager.go:217] Machine: {Timestamp:2026-11-04 05:27:43.314410188 +0000 UTC m=+0.315585430 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093919 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d414b5817758eb0dc343a9ed85890 SystemUUID:ec2d414b-5817-758e-b0dc-343a9ed85890 BootID:28d59e38-60ed-44dd-9fe5-59a8064c87cb Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fe:53:47:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fe:53:47:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:c5:21:5f:d0:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 05:27:43.315863 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.315863    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 05:27:43.316008 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.315995    2579 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 05:27:43.318491 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.318459    2579 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 05:27:43.318644 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.318493    2579 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-135.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 05:27:43.318686 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.318648    2579 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 05:27:43.318686 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.318655    2579 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 05:27:43.318743 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.318694    2579 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:27:43.318743 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.318710    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:27:43.319298 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.319288    2579 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 05:27:43.322669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.322656    2579 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 05:27:43.322798 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.322788    2579 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 05:27:43.322846 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.322823    2579 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 05:27:43.322846 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.322833    2579 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 05:27:43.322846 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.322844    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 05:27:43.322952 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.322854    2579 kubelet.go:405] "Adding apiserver pod source"
Nov 04 05:27:43.322952 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.322861    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 05:27:43.323315 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.323302    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:27:43.326035 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.326015    2579 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 05:27:43.329984 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.329968    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:27:43.330790 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.330776    2579 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 05:27:43.330837 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.330808    2579 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 05:27:43.331363 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.331349    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 05:27:43.331414 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.331372    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 05:27:43.331414 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.331382    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 05:27:43.331414 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.331390    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 05:27:43.331414 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.331402    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 05:27:43.331414 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.331410    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 05:27:43.331977 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.331957    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 05:27:43.331977 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.331971    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 05:27:43.332070 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.331992    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 05:27:43.332070 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.331999    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 05:27:43.332070 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.332018    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 05:27:43.332070 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.332033    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 05:27:43.332672 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.332649    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 05:27:43.332672 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.332662    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 05:27:43.334698 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.334669    2579 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-135.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 04 05:27:43.334767 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.334717    2579 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 04 05:27:43.334767 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.334747    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-135.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 04 05:27:43.336432 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.336418    2579 server.go:1263] "Started kubelet"
Nov 04 05:27:43.336540 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.336477    2579 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 05:27:43.336607 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.336558    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 05:27:43.336640 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.336634    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 05:27:43.337348 ip-10-0-141-135 systemd[1]: Started Kubernetes Kubelet.
Nov 04 05:27:43.337694 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.337646    2579 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 05:27:43.338942 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.338927    2579 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 05:27:43.343271 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.343254    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 05:27:43.343849 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.343832    2579 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 05:27:43.345170 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.345132    2579 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 05:27:43.345239 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.345174    2579 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 05:27:43.345295 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.345273    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 05:27:43.345345 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.345311    2579 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 05:27:43.345345 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.345317    2579 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 05:27:43.345530 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.345491    2579 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 04 05:27:43.345669 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.345653    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:43.346285 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.345266    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-135.us-east-2.compute.internal.18e4c05e69e52a45  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-135.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-135.us-east-2.compute.internal,},FirstTimestamp:2026-11-04 05:27:43.336385093 +0000 UTC m=+0.337560334,LastTimestamp:2026-11-04 05:27:43.336385093 +0000 UTC m=+0.337560334,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-135.us-east-2.compute.internal,}"
Nov 04 05:27:43.346617 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.346597    2579 factory.go:55] Registering systemd factory
Nov 04 05:27:43.346672 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.346619    2579 factory.go:223] Registration of the systemd container factory successfully
Nov 04 05:27:43.346931 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.346917    2579 factory.go:153] Registering CRI-O factory
Nov 04 05:27:43.346998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.346935    2579 factory.go:223] Registration of the crio container factory successfully
Nov 04 05:27:43.346998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.346988    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 05:27:43.347092 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.347008    2579 factory.go:103] Registering Raw factory
Nov 04 05:27:43.347092 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.347022    2579 manager.go:1199] Started watching for new ooms in manager
Nov 04 05:27:43.347826 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.347811    2579 manager.go:319] Starting recovery of all containers
Nov 04 05:27:43.352645 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.352609    2579 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-135.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 04 05:27:43.354553 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.354531    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lwgn7"
Nov 04 05:27:43.356807 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.356781    2579 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Nov 04 05:27:43.359844 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.359825    2579 manager.go:324] Recovery completed
Nov 04 05:27:43.362138 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.362115    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lwgn7"
Nov 04 05:27:43.363912 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.363898    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:27:43.366023 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.365998    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:27:43.366105 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.366036    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:27:43.366105 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.366051    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:27:43.366698 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.366681    2579 cpu_manager.go:226] "Starting" policy="none"
Nov 04 05:27:43.366698 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.366695    2579 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 05:27:43.366813 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.366713    2579 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 05:27:43.366813 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.366686    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:27:43.367461 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.367446    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:27:43.367539 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.367472    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:27:43.367539 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.367483    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:27:43.368251 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.368181    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-135.us-east-2.compute.internal.18e4c05e6ba95537  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-135.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-135.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-135.us-east-2.compute.internal,},FirstTimestamp:2026-11-04 05:27:43.366018359 +0000 UTC m=+0.367193606,LastTimestamp:2026-11-04 05:27:43.366018359 +0000 UTC m=+0.367193606,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-135.us-east-2.compute.internal,}"
Nov 04 05:27:43.368852 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.368839    2579 policy_none.go:50] "Start"
Nov 04 05:27:43.368898 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.368858    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 05:27:43.368898 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.368871    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 05:27:43.370970 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.370957    2579 policy_none.go:44] "Start"
Nov 04 05:27:43.395200 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.395163    2579 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 05:27:43.398031 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.398013    2579 manager.go:341] "Starting Device Plugin manager"
Nov 04 05:27:43.398154 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.398049    2579 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 05:27:43.398154 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.398060    2579 server.go:87] "Starting device plugin registration server"
Nov 04 05:27:43.398376 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.398361    2579 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 05:27:43.398441 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.398376    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 05:27:43.398485 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.398473    2579 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 05:27:43.398595 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.398574    2579 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 05:27:43.398595 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.398589    2579 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 05:27:43.399180 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.399161    2579 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 05:27:43.399260 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.399213    2579 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:43.502869 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.498716    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:27:43.502869 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.499819    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:27:43.502869 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.499852    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:27:43.502869 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.499866    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:27:43.502869 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.499902    2579 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.508902 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.508878    2579 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.509044 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.508911    2579 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-135.us-east-2.compute.internal\": node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:43.544897 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.544820    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:43.642485 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.642450    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 05:27:43.643769 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.643750    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 05:27:43.643859 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.643778    2579 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 05:27:43.643859 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.643805    2579 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 05:27:43.644576 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.643855    2579 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 04 05:27:43.644884 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.644869    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:43.648111 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.648085    2579 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:43.745258 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.745214    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:43.745403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.745260    2579 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"]
Nov 04 05:27:43.745403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.745336    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:27:43.746302 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.746286    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:27:43.746401 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.746315    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:27:43.746401 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.746327    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:27:43.747566 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.747534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.747566 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.747558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.748652 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.748640    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:27:43.748825 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.748811    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.748855 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.748850    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:27:43.749481 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.749467    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:27:43.749540 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.749495    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:27:43.749540 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.749467    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:27:43.749540 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.749517    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:27:43.749618 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.749540    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:27:43.749618 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.749552    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:27:43.751700 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.751685    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.751779 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.751710    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:27:43.752901 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.752885    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:27:43.752973 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.752911    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:27:43.752973 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.752923    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:27:43.786518 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.786483    2579 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found" node="ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.789194 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.789172    2579 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found" node="ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.845425 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.845308    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:43.848647 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.848618    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.848719 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.848659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebe8f4db5b3dfd0d97b0792740b3bd94-config\") pod \"kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"ebe8f4db5b3dfd0d97b0792740b3bd94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.848719 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.848677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.848809 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.848737    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.848859 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.848804    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.945847 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:43.945812    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:43.948998 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.948978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebe8f4db5b3dfd0d97b0792740b3bd94-config\") pod \"kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"ebe8f4db5b3dfd0d97b0792740b3bd94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:43.949075 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:43.949028    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebe8f4db5b3dfd0d97b0792740b3bd94-config\") pod \"kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"ebe8f4db5b3dfd0d97b0792740b3bd94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:44.046291 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:44.046265    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:44.089567 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.089545    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:44.091661 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.091639    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:44.147385 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:44.147198    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:44.174619 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.174586    2579 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:44.247761 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:44.247724    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:44.285956 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.285932    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 04 05:27:44.286369 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.286090    2579 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 05:27:44.286369 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.286119    2579 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 05:27:44.348715 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:44.348624    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:44.366557 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.366474    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 05:22:43 +0000 UTC" deadline="2028-05-20 08:57:38.695471101 +0000 UTC"
Nov 04 05:27:44.366557 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.366552    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13515h29m54.32892189s"
Nov 04 05:27:44.448856 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:44.448821    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:44.549180 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:44.549154    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:44.601634 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.601560    2579 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:44.649420 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:44.649390    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-135.us-east-2.compute.internal\" not found"
Nov 04 05:27:44.686909 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.686875    2579 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:44.745934 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.745902    2579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:44.755644 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.755621    2579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:27:44.756588 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.756574    2579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:27:44.766738 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.766718    2579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:27:44.824863 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:44.824827    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe8f4db5b3dfd0d97b0792740b3bd94.slice/crio-17efbc26e040d5667feb2d499ec602a82c750e45c8683ab733c12cff67a9ebde WatchSource:0}: Error finding container 17efbc26e040d5667feb2d499ec602a82c750e45c8683ab733c12cff67a9ebde: Status 404 returned error can't find the container with id 17efbc26e040d5667feb2d499ec602a82c750e45c8683ab733c12cff67a9ebde
Nov 04 05:27:44.825142 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:44.825120    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f0772ea75929fd9b2f469477c18173.slice/crio-ee14ead0ff77f12b2d5e183a04800b066977cb4ea36f2a9f64a8d038250da35b WatchSource:0}: Error finding container ee14ead0ff77f12b2d5e183a04800b066977cb4ea36f2a9f64a8d038250da35b: Status 404 returned error can't find the container with id ee14ead0ff77f12b2d5e183a04800b066977cb4ea36f2a9f64a8d038250da35b
Nov 04 05:27:44.830428 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:44.830409    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:27:45.323414 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.323374    2579 apiserver.go:52] "Watching apiserver"
Nov 04 05:27:45.331270 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.331245    2579 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 05:27:45.331588 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.331571    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-9hlsm","openshift-multus/multus-additional-cni-plugins-tw2sv","kube-system/konnectivity-agent-bcklp","openshift-network-diagnostics/network-check-target-j5vrf","openshift-network-operator/iptables-alerter-xffhq","kube-system/global-pull-secret-syncer-tgz7l","kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d","openshift-dns/node-resolver-zgr4j","openshift-image-registry/node-ca-j2n64","openshift-multus/network-metrics-daemon-lbx9s","openshift-ovn-kubernetes/ovnkube-node-vk7hk","openshift-cluster-node-tuning-operator/tuned-55msn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"]
Nov 04 05:27:45.335390 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.335368    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:27:45.337552 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.337528    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.338996 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.338973    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 05:27:45.339115 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.339045    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 05:27:45.339115 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.339052    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xrb2c\""
Nov 04 05:27:45.339115 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.339097    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 05:27:45.339785 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.339767    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:27:45.340415 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.340394    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:27:45.340415 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.340403    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7x6ks\""
Nov 04 05:27:45.340589 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.340458    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 05:27:45.341812 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.341797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:45.341888 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.341856    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:27:45.343054 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.342812    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 05:27:45.343054 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.342860    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-4fjpb\""
Nov 04 05:27:45.343054 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.342946    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 05:27:45.344233 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.344218    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 04 05:27:45.344338 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.344325    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:27:45.346438 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.346423    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:45.346539 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.346475    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:27:45.348516 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.348491    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:27:45.352452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.352429    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.354869 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.354847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-kubelet-config\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:45.354977 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.354880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8dd81a50-cf93-4c73-a2cf-793fee04c292-serviceca\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:27:45.354977 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.354905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-systemd\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.354977 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.354931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-modprobe-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.354977 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.354950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.355097 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.354987    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-run\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355097 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2h2s\" (UniqueName: \"kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s\") pod \"network-check-target-j5vrf\" (UID: \"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9\") " pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:45.355097 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-dbus\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:45.355097 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-conf\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355210 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-konnectivity-ca\") pod \"konnectivity-agent-bcklp\" (UID: \"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb\") " pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:27:45.355210 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355114    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-iptables-alerter-script\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:27:45.355210 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355138    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355210 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-tuned\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355210 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-host-slash\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:27:45.355210 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355187    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvtkt\" (UniqueName: \"kubernetes.io/projected/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-kube-api-access-nvtkt\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:27:45.355210 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-kubernetes\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355216    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-tmp\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kvnm\" (UniqueName: \"kubernetes.io/projected/589feb32-bcd4-4ab3-810a-0210968dc7b6-kube-api-access-8kvnm\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355244    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cnbc\" (UniqueName: \"kubernetes.io/projected/8dd81a50-cf93-4c73-a2cf-793fee04c292-kube-api-access-9cnbc\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:27:45.355403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-lib-modules\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:45.355403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysconfig\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-sys\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355343    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-var-lib-kubelet\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-host\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.355403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-agent-certs\") pod \"konnectivity-agent-bcklp\" (UID: \"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb\") " pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:27:45.355403 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.355386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dd81a50-cf93-4c73-a2cf-793fee04c292-host\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:27:45.357226 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.357204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.358796 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.358777    2579 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 05:27:45.359411 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.359395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:45.359513 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.359457    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:27:45.361900 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.361761    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.370687 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.370663    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c25sg"
Nov 04 05:27:45.377229 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.377206    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c25sg"
Nov 04 05:27:45.439331 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.439297    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 05:27:45.439978 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.439953    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 05:27:45.440127 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.440026    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 05:27:45.440127 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.440036    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-67qcf\""
Nov 04 05:27:45.440127 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.440078    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:27:45.443160 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443128    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 05:27:45.443278 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443168    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 05:27:45.443278 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443190    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 05:27:45.443278 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443226    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 05:27:45.443435 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443354    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 05:27:45.443483 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443432    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 05:27:45.443483 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443445    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 05:27:45.443597 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443539    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fwwlp\""
Nov 04 05:27:45.443597 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443546    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 05:27:45.443597 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443596    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 05:27:45.443735 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443607    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 05:27:45.443735 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443614    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-chnwp\""
Nov 04 05:27:45.443735 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443650    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m8rqh\""
Nov 04 05:27:45.443735 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443656    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 05:27:45.443735 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443704    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 05:27:45.443735 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443708    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 05:27:45.444013 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.443756    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 05:27:45.444695 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.444672    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rpj2j\""
Nov 04 05:27:45.444777 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.444748    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 05:27:45.444836 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.444814    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qlwsz\""
Nov 04 05:27:45.445661 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.445646    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 05:27:45.446339 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.446317    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 05:27:45.455632 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.455581    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-cnibin\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.455632 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.455632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-hostroot\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.455861 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.455659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-var-lib-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.455861 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.455742    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-conf\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.455861 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.455810    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-konnectivity-ca\") pod \"konnectivity-agent-bcklp\" (UID: \"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb\") " pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:27:45.455989 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.455900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-iptables-alerter-script\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:27:45.455989 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.455935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s78z2\" (UniqueName: \"kubernetes.io/projected/526ed430-5c81-45f1-885d-2211b36b7745-kube-api-access-s78z2\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.455989 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.455963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.456165 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.455988    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-netd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.456165 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.455987    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-conf\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.456165 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.456165 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsgh7\" (UniqueName: \"kubernetes.io/projected/6deb7716-c3cc-4944-99bf-dd904746d24c-kube-api-access-hsgh7\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.456165 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456140    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.456165 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-kubernetes\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-tmp\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kvnm\" (UniqueName: \"kubernetes.io/projected/589feb32-bcd4-4ab3-810a-0210968dc7b6-kube-api-access-8kvnm\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456216    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-kubernetes\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnbc\" (UniqueName: \"kubernetes.io/projected/8dd81a50-cf93-4c73-a2cf-793fee04c292-kube-api-access-9cnbc\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-system-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-cni-binary-copy\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-node-log\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-lib-modules\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456388    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456401    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-konnectivity-ca\") pod \"konnectivity-agent-bcklp\" (UID: \"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb\") " pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysconfig\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.456450 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-sys\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456466    2579 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-var-lib-kubelet\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456572    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-iptables-alerter-script\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456626    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-sys\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456632    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-host\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-agent-certs\") pod \"konnectivity-agent-bcklp\" (UID: \"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb\") " pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456691    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-lib-modules\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456730    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysconfig\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-socket-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456783    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-var-lib-kubelet\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456820    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456836    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-host\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456941    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.456971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8dd81a50-cf93-4c73-a2cf-793fee04c292-serviceca\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-cnibin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.457066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-multus\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-conf-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-etc-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-ovn\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6deb7716-c3cc-4944-99bf-dd904746d24c-ovn-node-metrics-cert\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457173    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9pjr\" (UniqueName: \"kubernetes.io/projected/bdfef95a-7674-41dd-b03e-9055b658a2aa-kube-api-access-s9pjr\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-netns\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-run\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h2s\" (UniqueName: \"kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s\") pod \"network-check-target-j5vrf\" (UID: \"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9\") " pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwc9w\" (UniqueName: \"kubernetes.io/projected/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-kube-api-access-xwc9w\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-bin\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-script-lib\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457339    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457363    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-device-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457384    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfzfb\" (UniqueName: \"kubernetes.io/projected/05890613-c051-4133-b1c6-7b282670a076-kube-api-access-bfzfb\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.457669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-config\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-tuned\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-host-slash\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457497    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvtkt\" (UniqueName: \"kubernetes.io/projected/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-kube-api-access-nvtkt\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-binary-copy\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-multus-daemon-config\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-bin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e02ac97f-6e15-4540-8b31-a7208f55217a-tmp-dir\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.457977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-socket-dir-parent\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-k8s-cni-cncf-io\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458055    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-etc-kubernetes\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e02ac97f-6e15-4540-8b31-a7208f55217a-hosts-file\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-slash\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458133    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-netns\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-env-overrides\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.458273 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-kubelet\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.458305    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458338    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-host-slash\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.458394    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret podName:9ba6f7a7-c835-4c2b-8e17-32015f629d52 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:45.958361961 +0000 UTC m=+2.959537206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret") pod "global-pull-secret-syncer-tgz7l" (UID: "9ba6f7a7-c835-4c2b-8e17-32015f629d52") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dd81a50-cf93-4c73-a2cf-793fee04c292-host\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458608    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458633    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8dd81a50-cf93-4c73-a2cf-793fee04c292-serviceca\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-log-socket\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458700    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dd81a50-cf93-4c73-a2cf-793fee04c292-host\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-kubelet-config\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458747    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-run\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-sys-fs\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-multus-certs\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458834    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-kubelet-config\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-systemd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-systemd\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.458993    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-systemd\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.459099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.459020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-registration-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.459892 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.459062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qsq4\" (UniqueName: \"kubernetes.io/projected/e02ac97f-6e15-4540-8b31-a7208f55217a-kube-api-access-6qsq4\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:27:45.459892 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.459110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-kubelet\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.459892 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.459146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-systemd-units\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.459892 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.459191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-modprobe-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.459892 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.459233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-dbus\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:45.459892 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.459262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-system-cni-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.459892 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.459423    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-modprobe-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.459892 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.459535    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-dbus\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:45.460715 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.460690    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-tuned\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.460842 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.460794    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-tmp\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.461226 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.461206    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-agent-certs\") pod \"konnectivity-agent-bcklp\" (UID: \"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb\") " pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:27:45.465179 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.465154    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnbc\" (UniqueName: \"kubernetes.io/projected/8dd81a50-cf93-4c73-a2cf-793fee04c292-kube-api-access-9cnbc\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:27:45.466686 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.466662    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:27:45.466686 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.466690    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:27:45.466861 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.466704    2579 projected.go:196] Error preparing data for projected volume kube-api-access-f2h2s for pod openshift-network-diagnostics/network-check-target-j5vrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:45.466861 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.466746    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kvnm\" (UniqueName: \"kubernetes.io/projected/589feb32-bcd4-4ab3-810a-0210968dc7b6-kube-api-access-8kvnm\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.466861 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.466768    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s podName:8f67d95f-5402-4ef6-96ac-8df95ee8bfa9 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:45.966750662 +0000 UTC m=+2.967925904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f2h2s" (UniqueName: "kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s") pod "network-check-target-j5vrf" (UID: "8f67d95f-5402-4ef6-96ac-8df95ee8bfa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:45.468551 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.468524    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvtkt\" (UniqueName: \"kubernetes.io/projected/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-kube-api-access-nvtkt\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:27:45.560317 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560280    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwc9w\" (UniqueName: \"kubernetes.io/projected/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-kube-api-access-xwc9w\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:45.560317 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-bin\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.560591 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-script-lib\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.560591 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560436    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-bin\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.560591 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.560591 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-device-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.560797 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560656    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-device-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.560797 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560681    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.560797 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfzfb\" (UniqueName: \"kubernetes.io/projected/05890613-c051-4133-b1c6-7b282670a076-kube-api-access-bfzfb\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.560797 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.560972 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-config\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.560972 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-binary-copy\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.560972 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-multus-daemon-config\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.560972 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560949    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-bin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561157 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.560973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e02ac97f-6e15-4540-8b31-a7208f55217a-tmp-dir\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:27:45.561157 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-socket-dir-parent\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561157 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-k8s-cni-cncf-io\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561157 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561093    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-script-lib\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561157 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-etc-kubernetes\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561391 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e02ac97f-6e15-4540-8b31-a7208f55217a-hosts-file\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:27:45.561391 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-slash\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561391 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-netns\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561391 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561218    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-bin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561391 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-env-overrides\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561391 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-kubelet\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561391 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561391 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-log-socket\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561391 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-sys-fs\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.561391 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-multus-certs\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561391 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561366    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e02ac97f-6e15-4540-8b31-a7208f55217a-tmp-dir\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561387    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-systemd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-registration-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qsq4\" (UniqueName: \"kubernetes.io/projected/e02ac97f-6e15-4540-8b31-a7208f55217a-kube-api-access-6qsq4\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-kubelet\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561494    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-systemd-units\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-system-cni-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-cnibin\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-hostroot\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-var-lib-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561638    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-multus-daemon-config\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561642    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s78z2\" (UniqueName: \"kubernetes.io/projected/526ed430-5c81-45f1-885d-2211b36b7745-kube-api-access-s78z2\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-netd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561709    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-multus-certs\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561716    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-config\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561756    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-k8s-cni-cncf-io\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.561932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561768    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-socket-dir-parent\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561768    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561795    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561794    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-etc-kubernetes\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsgh7\" (UniqueName: \"kubernetes.io/projected/6deb7716-c3cc-4944-99bf-dd904746d24c-kube-api-access-hsgh7\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561851    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e02ac97f-6e15-4540-8b31-a7208f55217a-hosts-file\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-system-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-cni-binary-copy\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561895    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-binary-copy\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-node-log\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561938    2579 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561968    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-sys-fs\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561969    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-socket-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562034    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-kubelet\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.562746 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562039    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-systemd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562092    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-registration-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-cnibin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562149    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-system-cni-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562189    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-env-overrides\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562195    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-cnibin\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561998    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-log-socket\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562242    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-slash\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562255    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-hostroot\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562292    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562316    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-node-log\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562338    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.561904    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-netns\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562403    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-socket-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562479    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-var-lib-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.563547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562517    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562550    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-system-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-multus\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-conf-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562591    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-systemd-units\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-etc-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-ovn\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562629    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-kubelet\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6deb7716-c3cc-4944-99bf-dd904746d24c-ovn-node-metrics-cert\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pjr\" (UniqueName: \"kubernetes.io/projected/bdfef95a-7674-41dd-b03e-9055b658a2aa-kube-api-access-s9pjr\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-netns\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562684    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-netd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.562747    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.562796    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs podName:d413c3c9-fece-4d7c-a6ea-7691c035a5ad nodeName:}" failed. No retries permitted until 2026-11-04 05:27:46.062784457 +0000 UTC m=+3.063959686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs") pod "network-metrics-daemon-lbx9s" (UID: "d413c3c9-fece-4d7c-a6ea-7691c035a5ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562797    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-etc-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562815    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-cni-binary-copy\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.564288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562823    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-ovn\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.565095 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562815    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.565095 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562869    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-conf-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.565095 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562892    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-multus\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.565095 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562924    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-cnibin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.565095 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.562961    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-netns\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.565095 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.563254    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.565095 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.565057    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6deb7716-c3cc-4944-99bf-dd904746d24c-ovn-node-metrics-cert\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.568754 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.568728    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwc9w\" (UniqueName: \"kubernetes.io/projected/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-kube-api-access-xwc9w\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:45.568997 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.568975    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfzfb\" (UniqueName: \"kubernetes.io/projected/05890613-c051-4133-b1c6-7b282670a076-kube-api-access-bfzfb\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.571098 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.571033    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s78z2\" (UniqueName: \"kubernetes.io/projected/526ed430-5c81-45f1-885d-2211b36b7745-kube-api-access-s78z2\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.571098 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.571076    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qsq4\" (UniqueName: \"kubernetes.io/projected/e02ac97f-6e15-4540-8b31-a7208f55217a-kube-api-access-6qsq4\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:27:45.572524 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.572489    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9pjr\" (UniqueName: \"kubernetes.io/projected/bdfef95a-7674-41dd-b03e-9055b658a2aa-kube-api-access-s9pjr\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.573287 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.573265    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsgh7\" (UniqueName: \"kubernetes.io/projected/6deb7716-c3cc-4944-99bf-dd904746d24c-kube-api-access-hsgh7\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.647698 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.647622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:27:45.651265 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.651207    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal" event={"ID":"ebe8f4db5b3dfd0d97b0792740b3bd94","Type":"ContainerStarted","Data":"17efbc26e040d5667feb2d499ec602a82c750e45c8683ab733c12cff67a9ebde"}
Nov 04 05:27:45.653720 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.653665    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal" event={"ID":"48f0772ea75929fd9b2f469477c18173","Type":"ContainerStarted","Data":"ee14ead0ff77f12b2d5e183a04800b066977cb4ea36f2a9f64a8d038250da35b"}
Nov 04 05:27:45.654847 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.654822    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:27:45.659529 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:45.659479    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd81a50_cf93_4c73_a2cf_793fee04c292.slice/crio-29ea7d2a945583be0f6dfbe90e0b19ddc87598195c636666daac6fb3f474b1cd WatchSource:0}: Error finding container 29ea7d2a945583be0f6dfbe90e0b19ddc87598195c636666daac6fb3f474b1cd: Status 404 returned error can't find the container with id 29ea7d2a945583be0f6dfbe90e0b19ddc87598195c636666daac6fb3f474b1cd
Nov 04 05:27:45.661370 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.661352    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:27:45.667975 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.667953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:27:45.674227 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.674202    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:27:45.675948 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:45.675920    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed3306b_cf7a_4c8a_9d8d_8a9db2bc64bb.slice/crio-c75189a2c0081033b372c565fb204c9dd763b97442c719ea56f9c2f24d2576c2 WatchSource:0}: Error finding container c75189a2c0081033b372c565fb204c9dd763b97442c719ea56f9c2f24d2576c2: Status 404 returned error can't find the container with id c75189a2c0081033b372c565fb204c9dd763b97442c719ea56f9c2f24d2576c2
Nov 04 05:27:45.683288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.683262    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:27:45.684054 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:45.684020    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e45fa7b_edf2_4c01_ac71_76ca9c425f7e.slice/crio-5ad90056adb69d8d50ab24ad3c92f3f24de8ac45c0500cbdee16a725cbcd43a3 WatchSource:0}: Error finding container 5ad90056adb69d8d50ab24ad3c92f3f24de8ac45c0500cbdee16a725cbcd43a3: Status 404 returned error can't find the container with id 5ad90056adb69d8d50ab24ad3c92f3f24de8ac45c0500cbdee16a725cbcd43a3
Nov 04 05:27:45.695364 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.695265    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9hlsm"
Nov 04 05:27:45.699582 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:45.699553    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdfef95a_7674_41dd_b03e_9055b658a2aa.slice/crio-6a00e0f307bc93fe9a39ff6fd0669fe41cb629c9570ac117fbfe6998299e93a8 WatchSource:0}: Error finding container 6a00e0f307bc93fe9a39ff6fd0669fe41cb629c9570ac117fbfe6998299e93a8: Status 404 returned error can't find the container with id 6a00e0f307bc93fe9a39ff6fd0669fe41cb629c9570ac117fbfe6998299e93a8
Nov 04 05:27:45.703346 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.702359    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:27:45.708065 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:45.708028    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05890613_c051_4133_b1c6_7b282670a076.slice/crio-076805bd92baf3feafb1f5fa5ccf49b568fd5fd946b28e6655616f540ef20e4e WatchSource:0}: Error finding container 076805bd92baf3feafb1f5fa5ccf49b568fd5fd946b28e6655616f540ef20e4e: Status 404 returned error can't find the container with id 076805bd92baf3feafb1f5fa5ccf49b568fd5fd946b28e6655616f540ef20e4e
Nov 04 05:27:45.717697 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.717676    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:27:45.720655 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:45.720617    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526ed430_5c81_45f1_885d_2211b36b7745.slice/crio-d3639527eac29c5593bdf5febf4603ebc7a296dd62e22b4f47c0e6e256e291d6 WatchSource:0}: Error finding container d3639527eac29c5593bdf5febf4603ebc7a296dd62e22b4f47c0e6e256e291d6: Status 404 returned error can't find the container with id d3639527eac29c5593bdf5febf4603ebc7a296dd62e22b4f47c0e6e256e291d6
Nov 04 05:27:45.730133 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:27:45.730108    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6deb7716_c3cc_4944_99bf_dd904746d24c.slice/crio-0b9d81f7f61e4bedb94a59a960d03046280a8a7bb3d68bc67902feb655c6f399 WatchSource:0}: Error finding container 0b9d81f7f61e4bedb94a59a960d03046280a8a7bb3d68bc67902feb655c6f399: Status 404 returned error can't find the container with id 0b9d81f7f61e4bedb94a59a960d03046280a8a7bb3d68bc67902feb655c6f399
Nov 04 05:27:45.966305 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:45.966211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:45.966535 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.966376    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:45.966535 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:45.966452    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret podName:9ba6f7a7-c835-4c2b-8e17-32015f629d52 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:46.966431327 +0000 UTC m=+3.967606570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret") pod "global-pull-secret-syncer-tgz7l" (UID: "9ba6f7a7-c835-4c2b-8e17-32015f629d52") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:46.057265 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.057230    2579 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:27:46.067519 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.067478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:46.067691 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.067537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h2s\" (UniqueName: \"kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s\") pod \"network-check-target-j5vrf\" (UID: \"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9\") " pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:46.067691 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:46.067617    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:46.067691 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:46.067647    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:27:46.067691 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:46.067661    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:27:46.067691 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:46.067674    2579 projected.go:196] Error preparing data for projected volume kube-api-access-f2h2s for pod openshift-network-diagnostics/network-check-target-j5vrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:46.067691 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:46.067688    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs podName:d413c3c9-fece-4d7c-a6ea-7691c035a5ad nodeName:}" failed. No retries permitted until 2026-11-04 05:27:47.067668969 +0000 UTC m=+4.068844208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs") pod "network-metrics-daemon-lbx9s" (UID: "d413c3c9-fece-4d7c-a6ea-7691c035a5ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:46.067958 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:46.067708    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s podName:8f67d95f-5402-4ef6-96ac-8df95ee8bfa9 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:47.067698644 +0000 UTC m=+4.068873882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f2h2s" (UniqueName: "kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s") pod "network-check-target-j5vrf" (UID: "8f67d95f-5402-4ef6-96ac-8df95ee8bfa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:46.380412 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.380288    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:22:45 +0000 UTC" deadline="2028-07-28 03:32:00.11361848 +0000 UTC"
Nov 04 05:27:46.380412 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.380411    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15166h4m13.733268417s"
Nov 04 05:27:46.645036 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.644167    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:46.645036 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:46.644309    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:27:46.661655 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.661614    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9hlsm" event={"ID":"05890613-c051-4133-b1c6-7b282670a076","Type":"ContainerStarted","Data":"076805bd92baf3feafb1f5fa5ccf49b568fd5fd946b28e6655616f540ef20e4e"}
Nov 04 05:27:46.672804 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.672740    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zgr4j" event={"ID":"e02ac97f-6e15-4540-8b31-a7208f55217a","Type":"ContainerStarted","Data":"26bba77d4e6bff4b6e7259abc73bcc68cbfed187a2d6892f88719f76247ac350"}
Nov 04 05:27:46.680337 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.680265    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xffhq" event={"ID":"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e","Type":"ContainerStarted","Data":"5ad90056adb69d8d50ab24ad3c92f3f24de8ac45c0500cbdee16a725cbcd43a3"}
Nov 04 05:27:46.684481 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.684428    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bcklp" event={"ID":"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb","Type":"ContainerStarted","Data":"c75189a2c0081033b372c565fb204c9dd763b97442c719ea56f9c2f24d2576c2"}
Nov 04 05:27:46.709604 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.709552    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" event={"ID":"526ed430-5c81-45f1-885d-2211b36b7745","Type":"ContainerStarted","Data":"d3639527eac29c5593bdf5febf4603ebc7a296dd62e22b4f47c0e6e256e291d6"}
Nov 04 05:27:46.722519 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.717778    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d" event={"ID":"bdfef95a-7674-41dd-b03e-9055b658a2aa","Type":"ContainerStarted","Data":"6a00e0f307bc93fe9a39ff6fd0669fe41cb629c9570ac117fbfe6998299e93a8"}
Nov 04 05:27:46.725442 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.725404    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-55msn" event={"ID":"589feb32-bcd4-4ab3-810a-0210968dc7b6","Type":"ContainerStarted","Data":"d52ae5c7f74940438909ce11d4c9ffcfad62c62d80d5d28a44b2c01647e2199d"}
Nov 04 05:27:46.726897 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.726863    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j2n64" event={"ID":"8dd81a50-cf93-4c73-a2cf-793fee04c292","Type":"ContainerStarted","Data":"29ea7d2a945583be0f6dfbe90e0b19ddc87598195c636666daac6fb3f474b1cd"}
Nov 04 05:27:46.729367 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.729338    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk" event={"ID":"6deb7716-c3cc-4944-99bf-dd904746d24c","Type":"ContainerStarted","Data":"0b9d81f7f61e4bedb94a59a960d03046280a8a7bb3d68bc67902feb655c6f399"}
Nov 04 05:27:46.975968 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:46.975886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:46.976135 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:46.976092    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:46.976187 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:46.976156    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret podName:9ba6f7a7-c835-4c2b-8e17-32015f629d52 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:48.97613836 +0000 UTC m=+5.977313604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret") pod "global-pull-secret-syncer-tgz7l" (UID: "9ba6f7a7-c835-4c2b-8e17-32015f629d52") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:47.077562 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:47.077056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:47.077562 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:47.077119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h2s\" (UniqueName: \"kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s\") pod \"network-check-target-j5vrf\" (UID: \"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9\") " pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:47.077562 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:47.077282    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:27:47.077562 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:47.077299    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:27:47.077562 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:47.077308    2579 projected.go:196] Error preparing data for projected volume kube-api-access-f2h2s for pod openshift-network-diagnostics/network-check-target-j5vrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:47.077562 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:47.077358    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s podName:8f67d95f-5402-4ef6-96ac-8df95ee8bfa9 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:49.077340541 +0000 UTC m=+6.078515773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f2h2s" (UniqueName: "kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s") pod "network-check-target-j5vrf" (UID: "8f67d95f-5402-4ef6-96ac-8df95ee8bfa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:47.078012 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:47.077727    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:47.078012 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:47.077777    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs podName:d413c3c9-fece-4d7c-a6ea-7691c035a5ad nodeName:}" failed. No retries permitted until 2026-11-04 05:27:49.077762226 +0000 UTC m=+6.078937458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs") pod "network-metrics-daemon-lbx9s" (UID: "d413c3c9-fece-4d7c-a6ea-7691c035a5ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:47.381647 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:47.381579    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:22:45 +0000 UTC" deadline="2028-07-02 19:42:29.917881848 +0000 UTC"
Nov 04 05:27:47.381647 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:47.381615    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14558h14m42.53627083s"
Nov 04 05:27:47.647161 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:47.646721    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:47.647161 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:47.646849    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:27:47.647372 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:47.647330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:47.647451 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:47.647418    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:27:47.743415 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:47.743377    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal" event={"ID":"ebe8f4db5b3dfd0d97b0792740b3bd94","Type":"ContainerStarted","Data":"853857e488a116939e24cc6de1a56da4523b7307f1ee83fbd424400fc7e4263b"}
Nov 04 05:27:48.645812 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:48.645045    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:48.645812 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:48.645422    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:27:48.755562 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:48.754093    2579 generic.go:356] "Generic (PLEG): container finished" podID="48f0772ea75929fd9b2f469477c18173" containerID="9bea241eeb8bc3e67a7c5006c3946f46c91999cd72fe98bfdade99cb81fc2eb9" exitCode=0
Nov 04 05:27:48.755562 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:48.755263    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal" event={"ID":"48f0772ea75929fd9b2f469477c18173","Type":"ContainerDied","Data":"9bea241eeb8bc3e67a7c5006c3946f46c91999cd72fe98bfdade99cb81fc2eb9"}
Nov 04 05:27:48.772526 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:48.772398    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal" podStartSLOduration=4.772384732 podStartE2EDuration="4.772384732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:27:47.759067252 +0000 UTC m=+4.760242500" watchObservedRunningTime="2026-11-04 05:27:48.772384732 +0000 UTC m=+5.773559983"
Nov 04 05:27:48.998838 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:48.998748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:48.999007 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:48.998951    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:48.999070 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:48.999014    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret podName:9ba6f7a7-c835-4c2b-8e17-32015f629d52 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:52.998996988 +0000 UTC m=+10.000172223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret") pod "global-pull-secret-syncer-tgz7l" (UID: "9ba6f7a7-c835-4c2b-8e17-32015f629d52") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:49.100789 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:49.099967    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:49.100789 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:49.100022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h2s\" (UniqueName: \"kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s\") pod \"network-check-target-j5vrf\" (UID: \"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9\") " pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:49.100789 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:49.100167    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:27:49.100789 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:49.100189    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:27:49.100789 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:49.100202    2579 projected.go:196] Error preparing data for projected volume kube-api-access-f2h2s for pod openshift-network-diagnostics/network-check-target-j5vrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:49.100789 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:49.100263    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s podName:8f67d95f-5402-4ef6-96ac-8df95ee8bfa9 nodeName:}" failed. No retries permitted until 2026-11-04 05:27:53.100246017 +0000 UTC m=+10.101421251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f2h2s" (UniqueName: "kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s") pod "network-check-target-j5vrf" (UID: "8f67d95f-5402-4ef6-96ac-8df95ee8bfa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:49.100789 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:49.100694    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:49.100789 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:49.100747    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs podName:d413c3c9-fece-4d7c-a6ea-7691c035a5ad nodeName:}" failed. No retries permitted until 2026-11-04 05:27:53.100731041 +0000 UTC m=+10.101906277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs") pod "network-metrics-daemon-lbx9s" (UID: "d413c3c9-fece-4d7c-a6ea-7691c035a5ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:49.648171 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:49.647405    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:49.648171 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:49.647553    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:27:49.648171 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:49.648004    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:49.648171 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:49.648112    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:27:49.761445 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:49.760759    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal" event={"ID":"48f0772ea75929fd9b2f469477c18173","Type":"ContainerStarted","Data":"6933e177cc569eef69f06405cfb047db3270bc960a4da033277fbca4a3e53909"}
Nov 04 05:27:49.766394 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:49.765696    2579 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="cb282f6c7a1b1b2217daaa2f19853cf2e8020760c05c11638a272e31d08e674e" exitCode=0
Nov 04 05:27:49.766394 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:49.765742    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" event={"ID":"526ed430-5c81-45f1-885d-2211b36b7745","Type":"ContainerDied","Data":"cb282f6c7a1b1b2217daaa2f19853cf2e8020760c05c11638a272e31d08e674e"}
Nov 04 05:27:49.776819 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:49.776255    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal" podStartSLOduration=5.776241197 podStartE2EDuration="5.776241197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:27:49.775389998 +0000 UTC m=+6.776565249" watchObservedRunningTime="2026-11-04 05:27:49.776241197 +0000 UTC m=+6.777416438"
Nov 04 05:27:50.644761 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:50.644246    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:50.644761 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:50.644374    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:27:50.784786 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:50.784466    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bcklp" event={"ID":"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb","Type":"ContainerStarted","Data":"92dacb4762a85405de87078a7a176e2f779925460b3dcdb21bc80d38c0de0a89"}
Nov 04 05:27:51.648243 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:51.648212    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:51.648381 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:51.648355    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:27:51.648765 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:51.648746    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:51.648859 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:51.648841    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:27:51.775897 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:51.775814    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d" event={"ID":"bdfef95a-7674-41dd-b03e-9055b658a2aa","Type":"ContainerStarted","Data":"17b7fa767087165abf0794f2f0b2ed049717d28888a1fd33bfebced9f7ab5627"}
Nov 04 05:27:51.782028 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:51.782001    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j2n64" event={"ID":"8dd81a50-cf93-4c73-a2cf-793fee04c292","Type":"ContainerStarted","Data":"1db8123a026edc0340ee43f30c84d1b208d06cb81c40d2e8b4028d0e04137ba4"}
Nov 04 05:27:51.797744 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:51.796546    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bcklp" podStartSLOduration=4.526761498 podStartE2EDuration="8.796526058s" totalImagesPullingTime="4.26976456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:27:50.799393531 +0000 UTC m=+7.800568787" watchObservedRunningTime="2026-11-04 05:27:51.796526058 +0000 UTC m=+8.797701310"
Nov 04 05:27:51.797744 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:51.797112    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j2n64" podStartSLOduration=3.55872432 podStartE2EDuration="8.797098063s" totalImagesPullingTime="5.238373743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:27:51.795039692 +0000 UTC m=+8.796214945" watchObservedRunningTime="2026-11-04 05:27:51.797098063 +0000 UTC m=+8.798273316"
Nov 04 05:27:52.644684 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:52.644648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:52.644867 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:52.644799    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:27:53.032420 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:53.032380    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:53.032898 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:53.032553    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:53.032898 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:53.032626    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret podName:9ba6f7a7-c835-4c2b-8e17-32015f629d52 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:01.032606623 +0000 UTC m=+18.033781856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret") pod "global-pull-secret-syncer-tgz7l" (UID: "9ba6f7a7-c835-4c2b-8e17-32015f629d52") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:27:53.133419 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:53.133384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:53.133594 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:53.133430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h2s\" (UniqueName: \"kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s\") pod \"network-check-target-j5vrf\" (UID: \"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9\") " pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:53.133594 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:53.133581    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:27:53.133710 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:53.133600    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:27:53.133710 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:53.133612    2579 projected.go:196] Error preparing data for projected volume kube-api-access-f2h2s for pod openshift-network-diagnostics/network-check-target-j5vrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:53.133710 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:53.133673    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s podName:8f67d95f-5402-4ef6-96ac-8df95ee8bfa9 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:01.133652382 +0000 UTC m=+18.134827624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f2h2s" (UniqueName: "kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s") pod "network-check-target-j5vrf" (UID: "8f67d95f-5402-4ef6-96ac-8df95ee8bfa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:27:53.134132 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:53.134103    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:53.134256 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:53.134167    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs podName:d413c3c9-fece-4d7c-a6ea-7691c035a5ad nodeName:}" failed. No retries permitted until 2026-11-04 05:28:01.1341481 +0000 UTC m=+18.135323329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs") pod "network-metrics-daemon-lbx9s" (UID: "d413c3c9-fece-4d7c-a6ea-7691c035a5ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:27:53.340251 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:53.340204    2579 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 05:27:53.408525 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:53.406593    2579 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T05:27:53.340228579Z","UUID":"3aed31d2-6de8-492c-81d0-a31f8beceb3d","Handler":null,"Name":"","Endpoint":""}
Nov 04 05:27:53.409781 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:53.409328    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 05:27:53.409781 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:53.409361    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 05:27:53.647029 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:53.644043    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:53.647029 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:53.644184    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:27:53.647029 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:53.644576    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:53.647029 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:53.644672    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:27:53.789392 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:53.789356    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d" event={"ID":"bdfef95a-7674-41dd-b03e-9055b658a2aa","Type":"ContainerStarted","Data":"851d3def20961f97d31dce5adc806a2245e0f285b8378d6e8b29ea67cd054855"}
Nov 04 05:27:54.478694 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:54.478658    2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:27:54.479807 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:54.479777    2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:27:54.645529 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:54.645271    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:54.645696 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:54.645643    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:27:54.794526 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:54.794428    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9hlsm" event={"ID":"05890613-c051-4133-b1c6-7b282670a076","Type":"ContainerStarted","Data":"ee52325392150726b50c0a5f62909b016900a309b975639c4e740129b8b50764"}
Nov 04 05:27:54.797755 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:54.797718    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zgr4j" event={"ID":"e02ac97f-6e15-4540-8b31-a7208f55217a","Type":"ContainerStarted","Data":"8adfb9f8e0fc6a8eae0264eb7d30b2d79ff6861006a6c7a6bcf57fcebf4c3e78"}
Nov 04 05:27:54.802880 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:54.802850    2579 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="b92e285cb54d937808ed63a569ea059c876c1d95d2571324f155d5fcf3d74067" exitCode=0
Nov 04 05:27:54.803167 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:54.803140    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" event={"ID":"526ed430-5c81-45f1-885d-2211b36b7745","Type":"ContainerDied","Data":"b92e285cb54d937808ed63a569ea059c876c1d95d2571324f155d5fcf3d74067"}
Nov 04 05:27:54.806669 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:54.806639    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d" event={"ID":"bdfef95a-7674-41dd-b03e-9055b658a2aa","Type":"ContainerStarted","Data":"ee8bc138f55bbf4cd8aea847dd5c9d17c3749097e7b7fa8cd673d8f365ae5b5a"}
Nov 04 05:27:54.836800 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:54.836751    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-9hlsm" podStartSLOduration=3.56191558 podStartE2EDuration="11.836734579s" totalImagesPullingTime="8.274818999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:27:54.817053728 +0000 UTC m=+11.818228980" watchObservedRunningTime="2026-11-04 05:27:54.836734579 +0000 UTC m=+11.837909831"
Nov 04 05:27:54.837194 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:54.837157    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-zgr4j" podStartSLOduration=3.9005983029999998 podStartE2EDuration="11.837148668s" totalImagesPullingTime="7.936550365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:27:54.836623955 +0000 UTC m=+11.837799208" watchObservedRunningTime="2026-11-04 05:27:54.837148668 +0000 UTC m=+11.838323918"
Nov 04 05:27:54.868932 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:54.868869    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d" podStartSLOduration=3.417128548 podStartE2EDuration="11.8688524s" totalImagesPullingTime="8.451723852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:27:54.868183792 +0000 UTC m=+11.869359043" watchObservedRunningTime="2026-11-04 05:27:54.8688524 +0000 UTC m=+11.870027654"
Nov 04 05:27:55.644781 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:55.644694    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:55.644781 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:55.644721    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:55.645310 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:55.644821    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:27:55.645310 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:55.644920    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:27:55.811632 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:55.811561    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" event={"ID":"526ed430-5c81-45f1-885d-2211b36b7745","Type":"ContainerStarted","Data":"35046300d13ea2dbffc3bd6648b402d065492f99f895f48ad79134f2537656c9"}
Nov 04 05:27:55.820362 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:55.820329    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xffhq" event={"ID":"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e","Type":"ContainerStarted","Data":"006f6915dca8d45d7673faaf9bbfe0721ed568cd1610274f27d4973dbb0d1368"}
Nov 04 05:27:55.846431 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:55.846367    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xffhq" podStartSLOduration=4.641668118 podStartE2EDuration="12.846348431s" totalImagesPullingTime="8.204680313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:27:55.846079775 +0000 UTC m=+12.847255030" watchObservedRunningTime="2026-11-04 05:27:55.846348431 +0000 UTC m=+12.847523682"
Nov 04 05:27:56.644284 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:56.644245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:56.644448 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:56.644393    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:27:56.829224 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:56.829119    2579 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="35046300d13ea2dbffc3bd6648b402d065492f99f895f48ad79134f2537656c9" exitCode=0
Nov 04 05:27:56.829224 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:56.829177    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" event={"ID":"526ed430-5c81-45f1-885d-2211b36b7745","Type":"ContainerDied","Data":"35046300d13ea2dbffc3bd6648b402d065492f99f895f48ad79134f2537656c9"}
Nov 04 05:27:56.829902 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:56.829271    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" event={"ID":"526ed430-5c81-45f1-885d-2211b36b7745","Type":"ContainerStarted","Data":"43244479121fdd3ff34d435547a84a50718234da039f36a79fa4baf6f49f6c40"}
Nov 04 05:27:56.831169 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:56.831139    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-55msn" event={"ID":"589feb32-bcd4-4ab3-810a-0210968dc7b6","Type":"ContainerStarted","Data":"19a029bf263ad38b78a79dc829938e63ad712c644990c77ffc46994771a40b3e"}
Nov 04 05:27:56.863140 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:56.863090    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-55msn" podStartSLOduration=3.404846369 podStartE2EDuration="13.863075203s" totalImagesPullingTime="10.458228834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:27:56.862580681 +0000 UTC m=+13.863755933" watchObservedRunningTime="2026-11-04 05:27:56.863075203 +0000 UTC m=+13.864250454"
Nov 04 05:27:57.644131 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:57.644097    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:57.644323 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:57.644145    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:57.644323 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:57.644263    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:27:57.644429 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:57.644402    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:27:57.836673 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:57.836639    2579 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="43244479121fdd3ff34d435547a84a50718234da039f36a79fa4baf6f49f6c40" exitCode=0
Nov 04 05:27:57.837276 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:57.836741    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" event={"ID":"526ed430-5c81-45f1-885d-2211b36b7745","Type":"ContainerDied","Data":"43244479121fdd3ff34d435547a84a50718234da039f36a79fa4baf6f49f6c40"}
Nov 04 05:27:58.644017 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:58.643983    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:27:58.644218 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:58.644117    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:27:59.644889 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:59.644850    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:27:59.645440 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:59.644896    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:27:59.645440 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:59.645029    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:27:59.645440 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:27:59.645159    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:27:59.845067 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:27:59.844783    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" event={"ID":"526ed430-5c81-45f1-885d-2211b36b7745","Type":"ContainerStarted","Data":"412d7e8bcbd7fc3851485fb2e6e7fc03f029607a38921d6df7c0ea0b56bc2a0a"}
Nov 04 05:28:00.644210 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:00.644182    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:00.644382 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:00.644285    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:28:00.850115 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:00.850026    2579 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="412d7e8bcbd7fc3851485fb2e6e7fc03f029607a38921d6df7c0ea0b56bc2a0a" exitCode=0
Nov 04 05:28:00.850614 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:00.850122    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" event={"ID":"526ed430-5c81-45f1-885d-2211b36b7745","Type":"ContainerDied","Data":"412d7e8bcbd7fc3851485fb2e6e7fc03f029607a38921d6df7c0ea0b56bc2a0a"}
Nov 04 05:28:00.853094 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:00.852949    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:28:00.853548 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:00.853494    2579 generic.go:356] "Generic (PLEG): container finished" podID="6deb7716-c3cc-4944-99bf-dd904746d24c" containerID="d3c02ea075cd7a8e5e3dfbd9e3fa55493d9193cf1e12db71b6013695441617b0" exitCode=1
Nov 04 05:28:00.853548 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:00.853524    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk" event={"ID":"6deb7716-c3cc-4944-99bf-dd904746d24c","Type":"ContainerStarted","Data":"d6a62218e6344ef86f30c30b86bf027357c0e2f04b122619cfb5e6c60428f685"}
Nov 04 05:28:00.853692 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:00.853588    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk" event={"ID":"6deb7716-c3cc-4944-99bf-dd904746d24c","Type":"ContainerStarted","Data":"d88fb0f4eca8d3bce90cbdb63154558a3835f7fdc45fe685b5a3a492b9831573"}
Nov 04 05:28:00.853692 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:00.853619    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk" event={"ID":"6deb7716-c3cc-4944-99bf-dd904746d24c","Type":"ContainerStarted","Data":"185f8454cab3ca337ce7eb130cf85a5f4f26952fc90e2c70641bb04f2a934fa6"}
Nov 04 05:28:00.853692 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:00.853652    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk" event={"ID":"6deb7716-c3cc-4944-99bf-dd904746d24c","Type":"ContainerStarted","Data":"d2974f950685c0243a5b1a36b53d7393859bd72c27564c4231f6e6387df12848"}
Nov 04 05:28:00.853692 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:00.853680    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk" event={"ID":"6deb7716-c3cc-4944-99bf-dd904746d24c","Type":"ContainerDied","Data":"d3c02ea075cd7a8e5e3dfbd9e3fa55493d9193cf1e12db71b6013695441617b0"}
Nov 04 05:28:00.853806 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:00.853716    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk" event={"ID":"6deb7716-c3cc-4944-99bf-dd904746d24c","Type":"ContainerStarted","Data":"5b46a67da22e703a10b39870abdc30a5f3fcaab03f20896bf62f8c97bff9ce05"}
Nov 04 05:28:01.093707 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:01.093654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:01.093913 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:01.093808    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 05:28:01.093913 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:01.093876    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret podName:9ba6f7a7-c835-4c2b-8e17-32015f629d52 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:17.093861856 +0000 UTC m=+34.095037085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret") pod "global-pull-secret-syncer-tgz7l" (UID: "9ba6f7a7-c835-4c2b-8e17-32015f629d52") : object "kube-system"/"original-pull-secret" not registered
Nov 04 05:28:01.194318 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:01.194281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:01.194533 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:01.194328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h2s\" (UniqueName: \"kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s\") pod \"network-check-target-j5vrf\" (UID: \"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9\") " pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:01.194533 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:01.194431    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:28:01.194533 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:01.194458    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 05:28:01.194533 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:01.194473    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 05:28:01.194533 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:01.194485    2579 projected.go:196] Error preparing data for projected volume kube-api-access-f2h2s for pod openshift-network-diagnostics/network-check-target-j5vrf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:28:01.194533 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:01.194516    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs podName:d413c3c9-fece-4d7c-a6ea-7691c035a5ad nodeName:}" failed. No retries permitted until 2026-11-04 05:28:17.194484997 +0000 UTC m=+34.195660227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs") pod "network-metrics-daemon-lbx9s" (UID: "d413c3c9-fece-4d7c-a6ea-7691c035a5ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 05:28:01.194749 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:01.194552    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s podName:8f67d95f-5402-4ef6-96ac-8df95ee8bfa9 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:17.194537287 +0000 UTC m=+34.195712519 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f2h2s" (UniqueName: "kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s") pod "network-check-target-j5vrf" (UID: "8f67d95f-5402-4ef6-96ac-8df95ee8bfa9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 05:28:01.644369 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:01.644274    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:01.644532 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:01.644277    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:01.644532 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:01.644389    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:28:01.644532 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:01.644462    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:28:01.858814 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:01.858778    2579 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="6ac01b63932cce8f7fe4a79c5936ac6a385036a26620a09da2ed59fe4e118c81" exitCode=0
Nov 04 05:28:01.858814 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:01.858817    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" event={"ID":"526ed430-5c81-45f1-885d-2211b36b7745","Type":"ContainerDied","Data":"6ac01b63932cce8f7fe4a79c5936ac6a385036a26620a09da2ed59fe4e118c81"}
Nov 04 05:28:02.644220 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:02.644192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:02.644338 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:02.644297    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:28:02.863913 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:02.863873    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" event={"ID":"526ed430-5c81-45f1-885d-2211b36b7745","Type":"ContainerStarted","Data":"f3f2677f873f420f9991571877b33bc7bdaea9f948b6de60813929d93697f272"}
Nov 04 05:28:02.866911 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:02.866847    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:28:02.867173 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:02.867151    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk" event={"ID":"6deb7716-c3cc-4944-99bf-dd904746d24c","Type":"ContainerStarted","Data":"b006099fe38c49cbe393db4e0150cfed2dbf8c5497299c74d9634c169325eb43"}
Nov 04 05:28:02.884967 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:02.884919    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tw2sv" podStartSLOduration=9.082203672 podStartE2EDuration="19.884907997s" totalImagesPullingTime="10.802704325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:02.883256792 +0000 UTC m=+19.884432037" watchObservedRunningTime="2026-11-04 05:28:02.884907997 +0000 UTC m=+19.886083247"
Nov 04 05:28:03.645127 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:03.645087    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:03.645327 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:03.645248    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:28:03.645327 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:03.645283    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:03.645446 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:03.645342    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:28:04.644139 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:04.644101    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:04.644650 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:04.644205    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:28:04.878118 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:04.878092    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:28:04.878531 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:04.878485    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk" event={"ID":"6deb7716-c3cc-4944-99bf-dd904746d24c","Type":"ContainerStarted","Data":"90a06e2481fae7d44887d50f02e675467e13e25b32d6015c3000cf2caf0b81e1"}
Nov 04 05:28:04.878761 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:04.878737    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:04.879321 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:04.878906    2579 scope.go:122] "RemoveContainer" containerID="d3c02ea075cd7a8e5e3dfbd9e3fa55493d9193cf1e12db71b6013695441617b0"
Nov 04 05:28:04.897828 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:04.897675    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:05.644756 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:05.644713    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:05.644756 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:05.644768    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:05.645486 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:05.644888    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:28:05.645486 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:05.645010    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:28:05.884405 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:05.884375    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:28:05.884763 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:05.884742    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk" event={"ID":"6deb7716-c3cc-4944-99bf-dd904746d24c","Type":"ContainerStarted","Data":"065f717c9ef0ccf61efb745b076d9a9282965a550006afdb87aefe3c1c3e355a"}
Nov 04 05:28:05.884966 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:05.884947    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:05.885018 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:05.885011    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:05.900392 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:05.900332    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:05.911251 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:05.911207    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk" podStartSLOduration=8.446218262 podStartE2EDuration="22.911192867s" totalImagesPullingTime="14.464974605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:05.910685418 +0000 UTC m=+22.911860669" watchObservedRunningTime="2026-11-04 05:28:05.911192867 +0000 UTC m=+22.912368144"
Nov 04 05:28:06.562762 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:06.562734    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tgz7l"]
Nov 04 05:28:06.563010 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:06.562846    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:06.563010 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:06.562930    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:28:06.566931 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:06.566901    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j5vrf"]
Nov 04 05:28:06.567063 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:06.567018    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:06.567063 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:06.567053    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lbx9s"]
Nov 04 05:28:06.567138 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:06.567130    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:06.567212 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:06.567195    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:28:06.567250 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:06.567120    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:28:07.644311 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:07.644279    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:07.644701 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:07.644388    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:28:08.644628 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:08.644584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:08.644628 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:08.644623    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:08.645100 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:08.644704    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:28:08.645100 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:08.644816    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:28:09.644775 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:09.644739    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:09.645196 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:09.644857    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:28:10.644340 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:10.644306    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:10.644521 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:10.644307    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:10.644521 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:10.644414    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:28:10.644521 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:10.644481    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:28:11.644227 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:11.644137    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:11.644671 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:11.644254    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:28:12.645066 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:12.645022    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:12.645472 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:12.645130    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5vrf" podUID="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9"
Nov 04 05:28:12.645472 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:12.645163    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:12.645472 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:12.645216    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tgz7l" podUID="9ba6f7a7-c835-4c2b-8e17-32015f629d52"
Nov 04 05:28:13.645181 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.644948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:13.645664 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:13.645201    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lbx9s" podUID="d413c3c9-fece-4d7c-a6ea-7691c035a5ad"
Nov 04 05:28:13.835064 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.835033    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeReady"
Nov 04 05:28:13.835233 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.835155    2579 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 04 05:28:13.867274 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.867239    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sh897"]
Nov 04 05:28:13.874562 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.874536    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2z628"]
Nov 04 05:28:13.874742 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.874712    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sh897"
Nov 04 05:28:13.878241 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.878218    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bsk42"]
Nov 04 05:28:13.878352 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.878329    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-2z628"
Nov 04 05:28:13.880520 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.880488    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d8999f8d7-rwnj7"]
Nov 04 05:28:13.880620 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.880567    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-bsk42"
Nov 04 05:28:13.882665 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.882650    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7"]
Nov 04 05:28:13.882782 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.882766    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:13.885941 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.885920    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"]
Nov 04 05:28:13.886039 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.886011    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7"
Nov 04 05:28:13.888362 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.888298    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Nov 04 05:28:13.888362 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.888322    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Nov 04 05:28:13.889454 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.889433    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"]
Nov 04 05:28:13.895345 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.891927    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:13.895345 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.893077    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 04 05:28:13.895345 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.893128    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Nov 04 05:28:13.895345 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.893230    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 04 05:28:13.895345 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.893302    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Nov 04 05:28:13.895772 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.895755    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"]
Nov 04 05:28:13.898700 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.898676    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Nov 04 05:28:13.903929 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.903900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:13.907602 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.907568    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"]
Nov 04 05:28:13.907704 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.907661    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:13.919440 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.919410    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"]
Nov 04 05:28:13.919603 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.919577    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:13.923992 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.923970    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77865897f5-8m6ds"]
Nov 04 05:28:13.924109 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.924100    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:13.926772 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.926751    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-5skd7"]
Nov 04 05:28:13.926884 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.926865    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:13.930875 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.930856    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"]
Nov 04 05:28:13.930995 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.930972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:13.935776 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.935757    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc"]
Nov 04 05:28:13.935909 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.935874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:13.939436 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.939417    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-588d496878-vbp7s"]
Nov 04 05:28:13.939567 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.939552    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc"
Nov 04 05:28:13.942691 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.942671    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sh897"]
Nov 04 05:28:13.942789 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.942701    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2z628"]
Nov 04 05:28:13.942789 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.942717    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bsk42"]
Nov 04 05:28:13.942789 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.942737    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7"]
Nov 04 05:28:13.942789 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.942758    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"]
Nov 04 05:28:13.942789 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.942780    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"]
Nov 04 05:28:13.942935 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.942801    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d8999f8d7-rwnj7"]
Nov 04 05:28:13.942935 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.942801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:13.942935 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.942820    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77865897f5-8m6ds"]
Nov 04 05:28:13.942935 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.942835    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"]
Nov 04 05:28:13.942935 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.942860    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qfz8d"]
Nov 04 05:28:13.946684 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.946661    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dqblv"]
Nov 04 05:28:13.946839 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.946821    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:13.949931 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.949912    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588d496878-vbp7s"]
Nov 04 05:28:13.950035 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.949947    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"]
Nov 04 05:28:13.950035 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.949978    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"]
Nov 04 05:28:13.950035 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.950010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:13.950191 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.950039    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"]
Nov 04 05:28:13.950191 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.950063    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dqblv"]
Nov 04 05:28:13.950191 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.950150    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc"]
Nov 04 05:28:13.950191 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.950180    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qfz8d"]
Nov 04 05:28:13.950316 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.950203    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-5skd7"]
Nov 04 05:28:13.984282 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsfg5\" (UniqueName: \"kubernetes.io/projected/8e7e37c2-a915-457b-a553-b53f25aaba42-kube-api-access-rsfg5\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:13.984399 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:13.984399 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb7nn\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-kube-api-access-fb7nn\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:13.984399 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984379    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xb6m\" (UniqueName: \"kubernetes.io/projected/f20a6d3d-6645-4b3a-af29-0c208025ddda-kube-api-access-6xb6m\") pod \"kas-connection-checker-685895c7c9-2z628\" (UID: \"f20a6d3d-6645-4b3a-af29-0c208025ddda\") " pod="kube-system/kas-connection-checker-685895c7c9-2z628"
Nov 04 05:28:13.984586 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwr2j\" (UniqueName: \"kubernetes.io/projected/08f68bfa-5fe7-4cc2-a833-9f0c72871994-kube-api-access-wwr2j\") pod \"volume-data-source-validator-58c9f5f46d-7gnk7\" (UID: \"08f68bfa-5fe7-4cc2-a833-9f0c72871994\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7"
Nov 04 05:28:13.984586 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984433    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-config\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:13.984586 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/327add5c-5660-46e3-93b6-683b8bee126e-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:13.984586 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-default-certificate\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:13.984586 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984548    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e7e37c2-a915-457b-a553-b53f25aaba42-serving-cert\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:13.984586 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-installation-pull-secrets\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:13.984586 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984581    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-ca-trust-extracted\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:13.984944 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-image-registry-private-configuration\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:13.984944 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmcsd\" (UniqueName: \"kubernetes.io/projected/40a2fd4e-7382-4886-8853-15b7387a53b3-kube-api-access-dmcsd\") pod \"kas-connection-checker-685895c7c9-sh897\" (UID: \"40a2fd4e-7382-4886-8853-15b7387a53b3\") " pod="kube-system/kas-connection-checker-685895c7c9-sh897"
Nov 04 05:28:13.984944 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:13.984944 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39761fca-7780-4800-a367-f827667dc6d7-serving-cert\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:13.984944 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fst49\" (UniqueName: \"kubernetes.io/projected/327add5c-5660-46e3-93b6-683b8bee126e-kube-api-access-fst49\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:13.984944 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984803    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-bound-sa-token\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:13.984944 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgw8h\" (UniqueName: \"kubernetes.io/projected/907d151f-d95c-40e6-95af-4198aec88c33-kube-api-access-wgw8h\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:13.984944 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/327add5c-5660-46e3-93b6-683b8bee126e-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:13.984944 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984867    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-trusted-ca\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:13.984944 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:13.984944 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984940    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:13.985452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-trusted-ca\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:13.985452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.984973    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:13.985452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.985013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh2lg\" (UniqueName: \"kubernetes.io/projected/3024b38f-4b25-45ec-8a49-40a3859ca462-kube-api-access-vh2lg\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:13.985452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.985050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:13.985452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.985070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frjx7\" (UniqueName: \"kubernetes.io/projected/6b1bfba7-f83b-46fc-b06b-2a736bad505f-kube-api-access-frjx7\") pod \"kas-connection-checker-685895c7c9-bsk42\" (UID: \"6b1bfba7-f83b-46fc-b06b-2a736bad505f\") " pod="kube-system/kas-connection-checker-685895c7c9-bsk42"
Nov 04 05:28:13.985452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.985124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/907d151f-d95c-40e6-95af-4198aec88c33-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:13.985452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.985139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-stats-auth\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:13.985452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.985162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39761fca-7780-4800-a367-f827667dc6d7-config\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:13.985452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.985198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-certificates\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:13.985452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.985262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmq6l\" (UniqueName: \"kubernetes.io/projected/810663b6-a5ea-4fef-b237-7caedfbab7f6-kube-api-access-dmq6l\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:13.985452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.985294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp5vz\" (UniqueName: \"kubernetes.io/projected/39761fca-7780-4800-a367-f827667dc6d7-kube-api-access-hp5vz\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:13.988837 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.988818    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:13.988966 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.988960    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:13.989071 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989004    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:13.989127 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989109    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Nov 04 05:28:13.989179 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989135    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 05:28:13.989307 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989287    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Nov 04 05:28:13.989371 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989296    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:13.989564 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989544    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:13.989564 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989553    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:13.989702 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989549    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:13.989801 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989783    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 05:28:13.989933 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989801    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 05:28:13.989933 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989927    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 05:28:13.989933 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989809    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 05:28:13.990085 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.989879    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 05:28:13.990305 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.990288    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:13.990305 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.990300    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Nov 04 05:28:13.990405 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.990340    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Nov 04 05:28:13.990457 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.990419    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 04 05:28:13.990514 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.990488    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:13.991325 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.991310    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 05:28:13.991447 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.991313    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:13.991447 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.991320    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Nov 04 05:28:13.991833 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.991817    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 05:28:13.991949 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:13.991930    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 05:28:14.001329 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.001306    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Nov 04 05:28:14.003021 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.002971    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Nov 04 05:28:14.003105 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.002989    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Nov 04 05:28:14.003105 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.003036    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Nov 04 05:28:14.003105 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.003004    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Nov 04 05:28:14.004315 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.004289    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 04 05:28:14.004430 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.004323    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 04 05:28:14.004430 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.004326    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 05:28:14.004554 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.004430    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 05:28:14.004853 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.004838    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Nov 04 05:28:14.004919 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.004855    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Nov 04 05:28:14.004919 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.004869    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Nov 04 05:28:14.004919 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.004877    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Nov 04 05:28:14.006678 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.006659    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-ggrvl\""
Nov 04 05:28:14.006678 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.006653    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xhrfz\""
Nov 04 05:28:14.006803 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.006664    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qm9rq\""
Nov 04 05:28:14.008544 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.008524    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 04 05:28:14.008624 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.008553    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gqfxb\""
Nov 04 05:28:14.012163 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.012138    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 04 05:28:14.012248 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.012188    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Nov 04 05:28:14.012321 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.012304    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 04 05:28:14.086181 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh2lg\" (UniqueName: \"kubernetes.io/projected/3024b38f-4b25-45ec-8a49-40a3859ca462-kube-api-access-vh2lg\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:14.086181 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:14.086410 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frjx7\" (UniqueName: \"kubernetes.io/projected/6b1bfba7-f83b-46fc-b06b-2a736bad505f-kube-api-access-frjx7\") pod \"kas-connection-checker-685895c7c9-bsk42\" (UID: \"6b1bfba7-f83b-46fc-b06b-2a736bad505f\") " pod="kube-system/kas-connection-checker-685895c7c9-bsk42"
Nov 04 05:28:14.086410 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b21212-89e5-40ce-8bbd-75f93265da0e-ca-trust-extracted\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.086410 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086381    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgqtt\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-kube-api-access-fgqtt\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.086538 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/907d151f-d95c-40e6-95af-4198aec88c33-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:14.086538 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-stats-auth\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:14.086621 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39761fca-7780-4800-a367-f827667dc6d7-config\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:14.086621 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-certificates\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.086621 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-image-registry-private-configuration\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.086759 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.086759 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmq6l\" (UniqueName: \"kubernetes.io/projected/810663b6-a5ea-4fef-b237-7caedfbab7f6-kube-api-access-dmq6l\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:14.086759 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp5vz\" (UniqueName: \"kubernetes.io/projected/39761fca-7780-4800-a367-f827667dc6d7-kube-api-access-hp5vz\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:14.086895 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsfg5\" (UniqueName: \"kubernetes.io/projected/8e7e37c2-a915-457b-a553-b53f25aaba42-kube-api-access-rsfg5\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:14.086895 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7b2d156-2b78-4114-9980-8543ed070a9a-cert\") pod \"ingress-canary-qfz8d\" (UID: \"c7b2d156-2b78-4114-9980-8543ed070a9a\") " pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:14.086895 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:14.086895 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb7nn\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-kube-api-access-fb7nn\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.087069 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:14.087069 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xb6m\" (UniqueName: \"kubernetes.io/projected/f20a6d3d-6645-4b3a-af29-0c208025ddda-kube-api-access-6xb6m\") pod \"kas-connection-checker-685895c7c9-2z628\" (UID: \"f20a6d3d-6645-4b3a-af29-0c208025ddda\") " pod="kube-system/kas-connection-checker-685895c7c9-2z628"
Nov 04 05:28:14.087069 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5794b522-36b9-4e80-b852-deff2905e1c7-serving-cert\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.087069 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.086992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djhql\" (UniqueName: \"kubernetes.io/projected/a2a942cf-93c8-445a-b6b6-cbda93d99210-kube-api-access-djhql\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.087069 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwr2j\" (UniqueName: \"kubernetes.io/projected/08f68bfa-5fe7-4cc2-a833-9f0c72871994-kube-api-access-wwr2j\") pod \"volume-data-source-validator-58c9f5f46d-7gnk7\" (UID: \"08f68bfa-5fe7-4cc2-a833-9f0c72871994\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7"
Nov 04 05:28:14.087069 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-config\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:14.087069 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087058    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:14.087402 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/327add5c-5660-46e3-93b6-683b8bee126e-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:14.087402 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087190    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39761fca-7780-4800-a367-f827667dc6d7-config\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:14.087402 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-tmp\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.087402 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.087402 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.087364    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 05:28:14.087402 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.087695 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087403    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-certificates\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.087695 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.087423    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls podName:810663b6-a5ea-4fef-b237-7caedfbab7f6 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:14.587407303 +0000 UTC m=+31.588582559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-6qps6" (UID: "810663b6-a5ea-4fef-b237-7caedfbab7f6") : secret "samples-operator-tls" not found
Nov 04 05:28:14.087695 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-default-certificate\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:14.087695 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e7e37c2-a915-457b-a553-b53f25aaba42-serving-cert\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:14.087695 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.087655    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-installation-pull-secrets\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.088988 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.088399    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/907d151f-d95c-40e6-95af-4198aec88c33-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:14.088988 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.088513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-snapshots\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.088988 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.088580    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-ca-trust-extracted\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.088988 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.088616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41a1a23a-cfae-43f1-b639-b30b4448ea40-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:14.088988 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.088674    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-config\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:14.088988 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.088827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2a942cf-93c8-445a-b6b6-cbda93d99210-config-volume\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.088988 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.088938    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-ca-trust-extracted\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.088988 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.088941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-image-registry-private-configuration\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.089434 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089006    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmcsd\" (UniqueName: \"kubernetes.io/projected/40a2fd4e-7382-4886-8853-15b7387a53b3-kube-api-access-dmcsd\") pod \"kas-connection-checker-685895c7c9-sh897\" (UID: \"40a2fd4e-7382-4886-8853-15b7387a53b3\") " pod="kube-system/kas-connection-checker-685895c7c9-sh897"
Nov 04 05:28:14.089434 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjz95\" (UniqueName: \"kubernetes.io/projected/ca807b05-9989-4b11-923c-d8f1423fde00-kube-api-access-tjz95\") pod \"network-check-source-6f78d59f99-f8krc\" (UID: \"ca807b05-9989-4b11-923c-d8f1423fde00\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc"
Nov 04 05:28:14.089434 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:14.089434 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-installation-pull-secrets\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.089434 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39761fca-7780-4800-a367-f827667dc6d7-serving-cert\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:14.089714 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089549    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-trusted-ca\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.089714 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089584    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkkfg\" (UniqueName: \"kubernetes.io/projected/5794b522-36b9-4e80-b852-deff2905e1c7-kube-api-access-xkkfg\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.089714 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fst49\" (UniqueName: \"kubernetes.io/projected/327add5c-5660-46e3-93b6-683b8bee126e-kube-api-access-fst49\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:14.089714 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089686    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-bound-sa-token\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.089911 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089758    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqtn\" (UniqueName: \"kubernetes.io/projected/c7b2d156-2b78-4114-9980-8543ed070a9a-kube-api-access-swqtn\") pod \"ingress-canary-qfz8d\" (UID: \"c7b2d156-2b78-4114-9980-8543ed070a9a\") " pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:14.089911 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a942cf-93c8-445a-b6b6-cbda93d99210-tmp-dir\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.089911 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgw8h\" (UniqueName: \"kubernetes.io/projected/907d151f-d95c-40e6-95af-4198aec88c33-kube-api-access-wgw8h\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:14.089911 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089866    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/327add5c-5660-46e3-93b6-683b8bee126e-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:14.089911 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-trusted-ca\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.090149 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-certificates\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.090149 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.089963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-service-ca-bundle\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.090149 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.090006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-bound-sa-token\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.090149 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.090049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.090149 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.090078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:14.090149 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.090109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-trusted-ca\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:14.090406 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.090152    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:14.090406 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.090315    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 04 05:28:14.090602 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.090585    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls podName:907d151f-d95c-40e6-95af-4198aec88c33 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:14.590562926 +0000 UTC m=+31.591738157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxz59" (UID: "907d151f-d95c-40e6-95af-4198aec88c33") : secret "cluster-monitoring-operator-tls" not found
Nov 04 05:28:14.091761 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.091736    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 05:28:14.091991 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.091969    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e7e37c2-a915-457b-a553-b53f25aaba42-serving-cert\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:14.092233 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.092210    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/327add5c-5660-46e3-93b6-683b8bee126e-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:14.092573 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.092556    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-default-certificate\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:14.092692 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.092673    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-stats-auth\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:14.092953 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.092928    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39761fca-7780-4800-a367-f827667dc6d7-serving-cert\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:14.094147 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.094117    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-trusted-ca\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.094275 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.094258    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:14.594230969 +0000 UTC m=+31.595406212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : secret "router-metrics-certs-default" not found
Nov 04 05:28:14.095079 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.095057    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:14.595033685 +0000 UTC m=+31.596208927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : configmap references non-existent config key: service-ca.crt
Nov 04 05:28:14.095188 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.095147    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 05:28:14.095188 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.095159    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77865897f5-8m6ds: secret "image-registry-tls" not found
Nov 04 05:28:14.095303 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.095202    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls podName:12d8c1e7-c045-45ee-90ab-7b26087ec7c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:14.595190184 +0000 UTC m=+31.596365419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls") pod "image-registry-77865897f5-8m6ds" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0") : secret "image-registry-tls" not found
Nov 04 05:28:14.095715 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.095688    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp5vz\" (UniqueName: \"kubernetes.io/projected/39761fca-7780-4800-a367-f827667dc6d7-kube-api-access-hp5vz\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:14.095802 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.095772    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/327add5c-5660-46e3-93b6-683b8bee126e-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:14.096174 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.096147    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh2lg\" (UniqueName: \"kubernetes.io/projected/3024b38f-4b25-45ec-8a49-40a3859ca462-kube-api-access-vh2lg\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:14.096294 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.096274    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frjx7\" (UniqueName: \"kubernetes.io/projected/6b1bfba7-f83b-46fc-b06b-2a736bad505f-kube-api-access-frjx7\") pod \"kas-connection-checker-685895c7c9-bsk42\" (UID: \"6b1bfba7-f83b-46fc-b06b-2a736bad505f\") " pod="kube-system/kas-connection-checker-685895c7c9-bsk42"
Nov 04 05:28:14.097778 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.097302    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-image-registry-private-configuration\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.097778 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.097397    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-trusted-ca\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:14.097778 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.097408    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-installation-pull-secrets\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.100893 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.100827    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xb6m\" (UniqueName: \"kubernetes.io/projected/f20a6d3d-6645-4b3a-af29-0c208025ddda-kube-api-access-6xb6m\") pod \"kas-connection-checker-685895c7c9-2z628\" (UID: \"f20a6d3d-6645-4b3a-af29-0c208025ddda\") " pod="kube-system/kas-connection-checker-685895c7c9-2z628"
Nov 04 05:28:14.101000 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.100878    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmq6l\" (UniqueName: \"kubernetes.io/projected/810663b6-a5ea-4fef-b237-7caedfbab7f6-kube-api-access-dmq6l\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:14.101645 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.101624    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb7nn\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-kube-api-access-fb7nn\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.101792 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.101770    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsfg5\" (UniqueName: \"kubernetes.io/projected/8e7e37c2-a915-457b-a553-b53f25aaba42-kube-api-access-rsfg5\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:14.101849 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.101798    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwr2j\" (UniqueName: \"kubernetes.io/projected/08f68bfa-5fe7-4cc2-a833-9f0c72871994-kube-api-access-wwr2j\") pod \"volume-data-source-validator-58c9f5f46d-7gnk7\" (UID: \"08f68bfa-5fe7-4cc2-a833-9f0c72871994\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7"
Nov 04 05:28:14.103743 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.103287    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgw8h\" (UniqueName: \"kubernetes.io/projected/907d151f-d95c-40e6-95af-4198aec88c33-kube-api-access-wgw8h\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:14.104890 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.104870    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-bound-sa-token\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.105612 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.105593    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fst49\" (UniqueName: \"kubernetes.io/projected/327add5c-5660-46e3-93b6-683b8bee126e-kube-api-access-fst49\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:14.105675 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.105621    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmcsd\" (UniqueName: \"kubernetes.io/projected/40a2fd4e-7382-4886-8853-15b7387a53b3-kube-api-access-dmcsd\") pod \"kas-connection-checker-685895c7c9-sh897\" (UID: \"40a2fd4e-7382-4886-8853-15b7387a53b3\") " pod="kube-system/kas-connection-checker-685895c7c9-sh897"
Nov 04 05:28:14.191054 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-snapshots\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.191054 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41a1a23a-cfae-43f1-b639-b30b4448ea40-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:14.191276 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2a942cf-93c8-445a-b6b6-cbda93d99210-config-volume\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.191276 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjz95\" (UniqueName: \"kubernetes.io/projected/ca807b05-9989-4b11-923c-d8f1423fde00-kube-api-access-tjz95\") pod \"network-check-source-6f78d59f99-f8krc\" (UID: \"ca807b05-9989-4b11-923c-d8f1423fde00\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc"
Nov 04 05:28:14.191276 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-installation-pull-secrets\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.191276 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-trusted-ca\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.191276 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkkfg\" (UniqueName: \"kubernetes.io/projected/5794b522-36b9-4e80-b852-deff2905e1c7-kube-api-access-xkkfg\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.191276 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqtn\" (UniqueName: \"kubernetes.io/projected/c7b2d156-2b78-4114-9980-8543ed070a9a-kube-api-access-swqtn\") pod \"ingress-canary-qfz8d\" (UID: \"c7b2d156-2b78-4114-9980-8543ed070a9a\") " pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:14.191276 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191230    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a942cf-93c8-445a-b6b6-cbda93d99210-tmp-dir\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.191276 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-certificates\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.191709 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191284    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-service-ca-bundle\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.191709 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-bound-sa-token\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.191709 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b21212-89e5-40ce-8bbd-75f93265da0e-ca-trust-extracted\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.191709 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgqtt\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-kube-api-access-fgqtt\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.191709 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-image-registry-private-configuration\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.191709 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.191709 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191583    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7b2d156-2b78-4114-9980-8543ed070a9a-cert\") pod \"ingress-canary-qfz8d\" (UID: \"c7b2d156-2b78-4114-9980-8543ed070a9a\") " pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:14.191709 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:14.191709 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5794b522-36b9-4e80-b852-deff2905e1c7-serving-cert\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.191709 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djhql\" (UniqueName: \"kubernetes.io/projected/a2a942cf-93c8-445a-b6b6-cbda93d99210-kube-api-access-djhql\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.192153 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-tmp\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.192153 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191724    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a942cf-93c8-445a-b6b6-cbda93d99210-tmp-dir\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.192153 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.192153 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191762    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2a942cf-93c8-445a-b6b6-cbda93d99210-config-volume\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.192153 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191780    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-snapshots\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.192153 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191827    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sh897"
Nov 04 05:28:14.192153 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.191877    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 05:28:14.192153 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.191892    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588d496878-vbp7s: secret "image-registry-tls" not found
Nov 04 05:28:14.192153 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.191888    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41a1a23a-cfae-43f1-b639-b30b4448ea40-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:14.192153 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.191951    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls podName:b0b21212-89e5-40ce-8bbd-75f93265da0e nodeName:}" failed. No retries permitted until 2026-11-04 05:28:14.691934171 +0000 UTC m=+31.693109408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls") pod "image-registry-588d496878-vbp7s" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e") : secret "image-registry-tls" not found
Nov 04 05:28:14.192678 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.192628    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-tmp\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.192678 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.192674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.192776 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.192687    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-certificates\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.192830 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.192776    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 04 05:28:14.192830 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.192789    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.192830 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.192822    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert podName:41a1a23a-cfae-43f1-b639-b30b4448ea40 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:14.692807843 +0000 UTC m=+31.693983083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8dsn9" (UID: "41a1a23a-cfae-43f1-b639-b30b4448ea40") : secret "networking-console-plugin-cert" not found
Nov 04 05:28:14.193010 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.192830    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-trusted-ca\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.193010 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.192896    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:28:14.193010 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.192955    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls podName:a2a942cf-93c8-445a-b6b6-cbda93d99210 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:14.692937105 +0000 UTC m=+31.694112353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls") pod "dns-default-dqblv" (UID: "a2a942cf-93c8-445a-b6b6-cbda93d99210") : secret "dns-default-metrics-tls" not found
Nov 04 05:28:14.193010 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.192896    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b21212-89e5-40ce-8bbd-75f93265da0e-ca-trust-extracted\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.193215 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.193195    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-service-ca-bundle\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.194104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.194085    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-installation-pull-secrets\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.194402 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.194385    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-image-registry-private-configuration\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.195167 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.195146    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7b2d156-2b78-4114-9980-8543ed070a9a-cert\") pod \"ingress-canary-qfz8d\" (UID: \"c7b2d156-2b78-4114-9980-8543ed070a9a\") " pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:14.195260 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.195210    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5794b522-36b9-4e80-b852-deff2905e1c7-serving-cert\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.200274 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.200245    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkkfg\" (UniqueName: \"kubernetes.io/projected/5794b522-36b9-4e80-b852-deff2905e1c7-kube-api-access-xkkfg\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.201256 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.201226    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djhql\" (UniqueName: \"kubernetes.io/projected/a2a942cf-93c8-445a-b6b6-cbda93d99210-kube-api-access-djhql\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.201372 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.201308    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjz95\" (UniqueName: \"kubernetes.io/projected/ca807b05-9989-4b11-923c-d8f1423fde00-kube-api-access-tjz95\") pod \"network-check-source-6f78d59f99-f8krc\" (UID: \"ca807b05-9989-4b11-923c-d8f1423fde00\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc"
Nov 04 05:28:14.201618 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.201595    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqtn\" (UniqueName: \"kubernetes.io/projected/c7b2d156-2b78-4114-9980-8543ed070a9a-kube-api-access-swqtn\") pod \"ingress-canary-qfz8d\" (UID: \"c7b2d156-2b78-4114-9980-8543ed070a9a\") " pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:14.202078 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.202059    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-bound-sa-token\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.202557 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.202536    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgqtt\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-kube-api-access-fgqtt\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.207157 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.207143    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-2z628"
Nov 04 05:28:14.222402 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.222382    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-bsk42"
Nov 04 05:28:14.235775 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.235752    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7"
Nov 04 05:28:14.241367 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.241346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:14.248464 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.248441    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:14.254616 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.254589    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc"
Nov 04 05:28:14.260194 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.260175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:14.289781 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.289751    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:14.313383 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.311438    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:14.558784 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.558752    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bsk42"]
Nov 04 05:28:14.560099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.560007    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sh897"]
Nov 04 05:28:14.561360 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.561342    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2z628"]
Nov 04 05:28:14.562321 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.562302    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc"]
Nov 04 05:28:14.562983 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:14.562866    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a2fd4e_7382_4886_8853_15b7387a53b3.slice/crio-3826931ce5087c70a990efc5919fd571a11b46f82aa8339183cb6592ea89428a WatchSource:0}: Error finding container 3826931ce5087c70a990efc5919fd571a11b46f82aa8339183cb6592ea89428a: Status 404 returned error can't find the container with id 3826931ce5087c70a990efc5919fd571a11b46f82aa8339183cb6592ea89428a
Nov 04 05:28:14.563801 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:14.563734    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca807b05_9989_4b11_923c_d8f1423fde00.slice/crio-a5cff6c593e3912eddb60779ac33e7aeaa08d4caa27a06b81d057e789d365c91 WatchSource:0}: Error finding container a5cff6c593e3912eddb60779ac33e7aeaa08d4caa27a06b81d057e789d365c91: Status 404 returned error can't find the container with id a5cff6c593e3912eddb60779ac33e7aeaa08d4caa27a06b81d057e789d365c91
Nov 04 05:28:14.564961 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:14.564712    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1bfba7_f83b_46fc_b06b_2a736bad505f.slice/crio-452a124c08741dc45db45b8b6ca7592d354fa717cfb0853f7803ad8d15fedaae WatchSource:0}: Error finding container 452a124c08741dc45db45b8b6ca7592d354fa717cfb0853f7803ad8d15fedaae: Status 404 returned error can't find the container with id 452a124c08741dc45db45b8b6ca7592d354fa717cfb0853f7803ad8d15fedaae
Nov 04 05:28:14.567469 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:14.567446    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20a6d3d_6645_4b3a_af29_0c208025ddda.slice/crio-946d6e6572267dde46d428f8a74c1ddb51c75abead195e445cd6e0e5aecf3546 WatchSource:0}: Error finding container 946d6e6572267dde46d428f8a74c1ddb51c75abead195e445cd6e0e5aecf3546: Status 404 returned error can't find the container with id 946d6e6572267dde46d428f8a74c1ddb51c75abead195e445cd6e0e5aecf3546
Nov 04 05:28:14.598164 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.598126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:14.598305 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.598224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:14.598305 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.598276    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 05:28:14.598425 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.598340    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls podName:810663b6-a5ea-4fef-b237-7caedfbab7f6 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:15.598322336 +0000 UTC m=+32.599497579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-6qps6" (UID: "810663b6-a5ea-4fef-b237-7caedfbab7f6") : secret "samples-operator-tls" not found
Nov 04 05:28:14.598425 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.598344    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 05:28:14.598425 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.598357    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77865897f5-8m6ds: secret "image-registry-tls" not found
Nov 04 05:28:14.598425 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.598387    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls podName:12d8c1e7-c045-45ee-90ab-7b26087ec7c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:15.598378175 +0000 UTC m=+32.599553404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls") pod "image-registry-77865897f5-8m6ds" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0") : secret "image-registry-tls" not found
Nov 04 05:28:14.598651 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.598444    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 05:28:14.598651 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.598475    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:15.598464136 +0000 UTC m=+32.599639378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : secret "router-metrics-certs-default" not found
Nov 04 05:28:14.598651 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.598279    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:14.598651 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.598523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:14.598651 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.598558    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:14.598894 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.598710    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 04 05:28:14.598894 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.598755    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls podName:907d151f-d95c-40e6-95af-4198aec88c33 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:15.598741088 +0000 UTC m=+32.599916331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxz59" (UID: "907d151f-d95c-40e6-95af-4198aec88c33") : secret "cluster-monitoring-operator-tls" not found
Nov 04 05:28:14.598894 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.598833    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:15.598821701 +0000 UTC m=+32.599996947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : configmap references non-existent config key: service-ca.crt
Nov 04 05:28:14.602989 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.601961    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7"]
Nov 04 05:28:14.606141 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.606059    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"]
Nov 04 05:28:14.644227 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.644191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:14.644913 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.644888    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:14.648766 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.648741    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 05:28:14.649176 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.648885    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-zs9xj\""
Nov 04 05:28:14.649176 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.649029    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-kkpcg\""
Nov 04 05:28:14.682281 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.682250    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"]
Nov 04 05:28:14.686385 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.685256    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"]
Nov 04 05:28:14.689307 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:14.689181    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7e37c2_a915_457b_a553_b53f25aaba42.slice/crio-ddf47ff9291b26c1645308ac84726086484efce113af0756b27cc26ad9a38e3e WatchSource:0}: Error finding container ddf47ff9291b26c1645308ac84726086484efce113af0756b27cc26ad9a38e3e: Status 404 returned error can't find the container with id ddf47ff9291b26c1645308ac84726086484efce113af0756b27cc26ad9a38e3e
Nov 04 05:28:14.695080 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.695033    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qfz8d"]
Nov 04 05:28:14.698988 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.698965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:14.699073 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.699005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:14.699107 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.699098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:14.699220 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.699209    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 05:28:14.699250 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.699222    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588d496878-vbp7s: secret "image-registry-tls" not found
Nov 04 05:28:14.699277 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.699259    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls podName:b0b21212-89e5-40ce-8bbd-75f93265da0e nodeName:}" failed. No retries permitted until 2026-11-04 05:28:15.699247619 +0000 UTC m=+32.700422861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls") pod "image-registry-588d496878-vbp7s" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e") : secret "image-registry-tls" not found
Nov 04 05:28:14.699314 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.699302    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 04 05:28:14.699345 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.699323    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert podName:41a1a23a-cfae-43f1-b639-b30b4448ea40 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:15.699316673 +0000 UTC m=+32.700491901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8dsn9" (UID: "41a1a23a-cfae-43f1-b639-b30b4448ea40") : secret "networking-console-plugin-cert" not found
Nov 04 05:28:14.699380 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.699361    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:28:14.699410 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:14.699380    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls podName:a2a942cf-93c8-445a-b6b6-cbda93d99210 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:15.699374112 +0000 UTC m=+32.700549341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls") pod "dns-default-dqblv" (UID: "a2a942cf-93c8-445a-b6b6-cbda93d99210") : secret "dns-default-metrics-tls" not found
Nov 04 05:28:14.699742 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:14.699721    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b2d156_2b78_4114_9980_8543ed070a9a.slice/crio-b64ba21b4d6ae7b296dc86849e43623ff40dc87f2fd4857cc9ef2a995d1b47ed WatchSource:0}: Error finding container b64ba21b4d6ae7b296dc86849e43623ff40dc87f2fd4857cc9ef2a995d1b47ed: Status 404 returned error can't find the container with id b64ba21b4d6ae7b296dc86849e43623ff40dc87f2fd4857cc9ef2a995d1b47ed
Nov 04 05:28:14.716283 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.716257    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-5skd7"]
Nov 04 05:28:14.717531 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:14.717485    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5794b522_36b9_4e80_b852_deff2905e1c7.slice/crio-bcc18f84b6b2c26478e2af21a89ee871c7b865bb9930123c3fe62c3bcd1ef947 WatchSource:0}: Error finding container bcc18f84b6b2c26478e2af21a89ee871c7b865bb9930123c3fe62c3bcd1ef947: Status 404 returned error can't find the container with id bcc18f84b6b2c26478e2af21a89ee871c7b865bb9930123c3fe62c3bcd1ef947
Nov 04 05:28:14.910317 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.910285    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qfz8d" event={"ID":"c7b2d156-2b78-4114-9980-8543ed070a9a","Type":"ContainerStarted","Data":"b64ba21b4d6ae7b296dc86849e43623ff40dc87f2fd4857cc9ef2a995d1b47ed"}
Nov 04 05:28:14.911424 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.911395    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8" event={"ID":"327add5c-5660-46e3-93b6-683b8bee126e","Type":"ContainerStarted","Data":"76bd0de76a45f78d067a3050c892b2a760fd3594adda919b45a8cd7bc3c44849"}
Nov 04 05:28:14.912552 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.912531    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h" event={"ID":"39761fca-7780-4800-a367-f827667dc6d7","Type":"ContainerStarted","Data":"fc78bf833cd11dac9ae32f384bffff4241e46ccb1dee83b70b9a4929c343f749"}
Nov 04 05:28:14.915664 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.915637    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7" event={"ID":"08f68bfa-5fe7-4cc2-a833-9f0c72871994","Type":"ContainerStarted","Data":"307a57c0b7e679bc4a5b545ab5268b7b7d6aeac6302afbaffe3df7ef5bdf78fd"}
Nov 04 05:28:14.917022 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.917000    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz" event={"ID":"8e7e37c2-a915-457b-a553-b53f25aaba42","Type":"ContainerStarted","Data":"ddf47ff9291b26c1645308ac84726086484efce113af0756b27cc26ad9a38e3e"}
Nov 04 05:28:14.918326 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.918299    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc" event={"ID":"ca807b05-9989-4b11-923c-d8f1423fde00","Type":"ContainerStarted","Data":"a5cff6c593e3912eddb60779ac33e7aeaa08d4caa27a06b81d057e789d365c91"}
Nov 04 05:28:14.919617 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.919598    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-bsk42" event={"ID":"6b1bfba7-f83b-46fc-b06b-2a736bad505f","Type":"ContainerStarted","Data":"b4b6aac27d0a8dd1a893b9668e230805fce7e65602b2fd9acbb00e09ad50944f"}
Nov 04 05:28:14.919707 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.919637    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-bsk42" event={"ID":"6b1bfba7-f83b-46fc-b06b-2a736bad505f","Type":"ContainerStarted","Data":"452a124c08741dc45db45b8b6ca7592d354fa717cfb0853f7803ad8d15fedaae"}
Nov 04 05:28:14.921007 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.920987    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-5skd7" event={"ID":"5794b522-36b9-4e80-b852-deff2905e1c7","Type":"ContainerStarted","Data":"bcc18f84b6b2c26478e2af21a89ee871c7b865bb9930123c3fe62c3bcd1ef947"}
Nov 04 05:28:14.922268 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.922249    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sh897" event={"ID":"40a2fd4e-7382-4886-8853-15b7387a53b3","Type":"ContainerStarted","Data":"e19e9f273f6abeaa8817b4a3ae9d6e4f0e80fc41d7c012adfe5b05bab8acc993"}
Nov 04 05:28:14.922372 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.922280    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sh897" event={"ID":"40a2fd4e-7382-4886-8853-15b7387a53b3","Type":"ContainerStarted","Data":"3826931ce5087c70a990efc5919fd571a11b46f82aa8339183cb6592ea89428a"}
Nov 04 05:28:14.924043 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.924022    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-2z628" event={"ID":"f20a6d3d-6645-4b3a-af29-0c208025ddda","Type":"ContainerStarted","Data":"3a9a7d701c3ed13ef3773c5f13fc66aac2c3e3824d9e23a5118cc087d1e9082e"}
Nov 04 05:28:14.924141 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.924052    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-2z628" event={"ID":"f20a6d3d-6645-4b3a-af29-0c208025ddda","Type":"ContainerStarted","Data":"946d6e6572267dde46d428f8a74c1ddb51c75abead195e445cd6e0e5aecf3546"}
Nov 04 05:28:14.935468 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.935424    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-bsk42" podStartSLOduration=467.935412785 podStartE2EDuration="7m47.935412785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:14.934953506 +0000 UTC m=+31.936128760" watchObservedRunningTime="2026-11-04 05:28:14.935412785 +0000 UTC m=+31.936588037"
Nov 04 05:28:14.950844 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.950798    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-2z628" podStartSLOduration=467.950784014 podStartE2EDuration="7m47.950784014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:14.950295117 +0000 UTC m=+31.951470366" watchObservedRunningTime="2026-11-04 05:28:14.950784014 +0000 UTC m=+31.951959266"
Nov 04 05:28:14.967412 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:14.967358    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-sh897" podStartSLOduration=467.96734248 podStartE2EDuration="7m47.96734248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:14.966733613 +0000 UTC m=+31.967908865" watchObservedRunningTime="2026-11-04 05:28:14.96734248 +0000 UTC m=+31.968517732"
Nov 04 05:28:15.299186 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.299153    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:28:15.299359 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.299329    2579 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:15.300193 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.300167    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:28:15.404028 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.403988    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:15.520491 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.520451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:15.608973 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.608890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:15.609138 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.608991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:15.609138 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.609047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:15.609138 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.609074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:15.609138 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.609106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:15.610153 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.609344    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 05:28:15.610153 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.609414    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:17.609394919 +0000 UTC m=+34.610570150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : secret "router-metrics-certs-default" not found
Nov 04 05:28:15.610153 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.609854    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 05:28:15.610153 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.609906    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls podName:810663b6-a5ea-4fef-b237-7caedfbab7f6 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:17.609890898 +0000 UTC m=+34.611066132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-6qps6" (UID: "810663b6-a5ea-4fef-b237-7caedfbab7f6") : secret "samples-operator-tls" not found
Nov 04 05:28:15.610153 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.609981    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 05:28:15.610153 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.609992    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77865897f5-8m6ds: secret "image-registry-tls" not found
Nov 04 05:28:15.610153 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.610039    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls podName:12d8c1e7-c045-45ee-90ab-7b26087ec7c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:17.610015773 +0000 UTC m=+34.611191004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls") pod "image-registry-77865897f5-8m6ds" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0") : secret "image-registry-tls" not found
Nov 04 05:28:15.610153 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.610106    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:17.610095646 +0000 UTC m=+34.611270881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : configmap references non-existent config key: service-ca.crt
Nov 04 05:28:15.610854 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.610758    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 04 05:28:15.610854 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.610827    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls podName:907d151f-d95c-40e6-95af-4198aec88c33 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:17.610810852 +0000 UTC m=+34.611986086 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxz59" (UID: "907d151f-d95c-40e6-95af-4198aec88c33") : secret "cluster-monitoring-operator-tls" not found
Nov 04 05:28:15.649759 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.645817    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:15.657583 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.656883    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 05:28:15.657583 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.657007    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pqp2n\""
Nov 04 05:28:15.710640 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.709829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:15.710640 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.709909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:15.710640 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:15.709996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:15.710640 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.710211    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:28:15.710640 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.710274    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls podName:a2a942cf-93c8-445a-b6b6-cbda93d99210 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:17.710257482 +0000 UTC m=+34.711432731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls") pod "dns-default-dqblv" (UID: "a2a942cf-93c8-445a-b6b6-cbda93d99210") : secret "dns-default-metrics-tls" not found
Nov 04 05:28:15.710640 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.710438    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 04 05:28:15.710640 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.710485    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert podName:41a1a23a-cfae-43f1-b639-b30b4448ea40 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:17.710472565 +0000 UTC m=+34.711647803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8dsn9" (UID: "41a1a23a-cfae-43f1-b639-b30b4448ea40") : secret "networking-console-plugin-cert" not found
Nov 04 05:28:15.710640 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.710566    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 05:28:15.710640 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.710579    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588d496878-vbp7s: secret "image-registry-tls" not found
Nov 04 05:28:15.710640 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:15.710613    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls podName:b0b21212-89e5-40ce-8bbd-75f93265da0e nodeName:}" failed. No retries permitted until 2026-11-04 05:28:17.710602522 +0000 UTC m=+34.711777754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls") pod "image-registry-588d496878-vbp7s" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e") : secret "image-registry-tls" not found
Nov 04 05:28:17.135261 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.135175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:17.148159 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.139820    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:17.236632 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.236594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:17.236802 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.236643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h2s\" (UniqueName: \"kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s\") pod \"network-check-target-j5vrf\" (UID: \"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9\") " pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:17.237694 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.237344    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 05:28:17.237694 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.237426    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs podName:d413c3c9-fece-4d7c-a6ea-7691c035a5ad nodeName:}" failed. No retries permitted until 2026-11-04 05:28:49.23739845 +0000 UTC m=+66.238573685 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs") pod "network-metrics-daemon-lbx9s" (UID: "d413c3c9-fece-4d7c-a6ea-7691c035a5ad") : secret "metrics-daemon-secret" not found
Nov 04 05:28:17.245075 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.245043    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2h2s\" (UniqueName: \"kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s\") pod \"network-check-target-j5vrf\" (UID: \"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9\") " pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:17.395613 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.395536    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:17.422637 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.422600    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:17.641420 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.641375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:17.641420 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.641434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:17.641694 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.641467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:17.641694 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.641564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:17.641694 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.641640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:17.641847 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.641787    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 05:28:17.641895 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.641863    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:21.641843576 +0000 UTC m=+38.643018811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : secret "router-metrics-certs-default" not found
Nov 04 05:28:17.642415 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.642285    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 05:28:17.642415 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.642306    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77865897f5-8m6ds: secret "image-registry-tls" not found
Nov 04 05:28:17.642415 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.642355    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls podName:12d8c1e7-c045-45ee-90ab-7b26087ec7c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:21.642339434 +0000 UTC m=+38.643514679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls") pod "image-registry-77865897f5-8m6ds" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0") : secret "image-registry-tls" not found
Nov 04 05:28:17.642667 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.642424    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:21.642412566 +0000 UTC m=+38.643587796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : configmap references non-existent config key: service-ca.crt
Nov 04 05:28:17.642667 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.642536    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 05:28:17.642667 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.642572    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls podName:810663b6-a5ea-4fef-b237-7caedfbab7f6 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:21.64256063 +0000 UTC m=+38.643735865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-6qps6" (UID: "810663b6-a5ea-4fef-b237-7caedfbab7f6") : secret "samples-operator-tls" not found
Nov 04 05:28:17.642667 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.642647    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 04 05:28:17.642854 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.642684    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls podName:907d151f-d95c-40e6-95af-4198aec88c33 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:21.642673342 +0000 UTC m=+38.643848574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxz59" (UID: "907d151f-d95c-40e6-95af-4198aec88c33") : secret "cluster-monitoring-operator-tls" not found
Nov 04 05:28:17.732478 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.732003    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j5vrf"]
Nov 04 05:28:17.735538 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.734880    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tgz7l"]
Nov 04 05:28:17.735538 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:17.735401    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f67d95f_5402_4ef6_96ac_8df95ee8bfa9.slice/crio-c1cbc4a32b0cd8299ef1c2751fcaa3f1b8bc10fd92175ee1abb27c8a68f309a7 WatchSource:0}: Error finding container c1cbc4a32b0cd8299ef1c2751fcaa3f1b8bc10fd92175ee1abb27c8a68f309a7: Status 404 returned error can't find the container with id c1cbc4a32b0cd8299ef1c2751fcaa3f1b8bc10fd92175ee1abb27c8a68f309a7
Nov 04 05:28:17.742349 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.742325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:17.742460 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.742363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:17.742460 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.742445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:17.742597 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.742586    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 05:28:17.742722 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.742600    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588d496878-vbp7s: secret "image-registry-tls" not found
Nov 04 05:28:17.742722 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.742599    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 04 05:28:17.742722 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.742650    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls podName:b0b21212-89e5-40ce-8bbd-75f93265da0e nodeName:}" failed. No retries permitted until 2026-11-04 05:28:21.742632165 +0000 UTC m=+38.743807409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls") pod "image-registry-588d496878-vbp7s" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e") : secret "image-registry-tls" not found
Nov 04 05:28:17.742722 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.742669    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert podName:41a1a23a-cfae-43f1-b639-b30b4448ea40 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:21.742658198 +0000 UTC m=+38.743833434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8dsn9" (UID: "41a1a23a-cfae-43f1-b639-b30b4448ea40") : secret "networking-console-plugin-cert" not found
Nov 04 05:28:17.742722 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.742691    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:28:17.742722 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:17.742712    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls podName:a2a942cf-93c8-445a-b6b6-cbda93d99210 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:21.742705796 +0000 UTC m=+38.743881029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls") pod "dns-default-dqblv" (UID: "a2a942cf-93c8-445a-b6b6-cbda93d99210") : secret "dns-default-metrics-tls" not found
Nov 04 05:28:17.940612 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.940573    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7" event={"ID":"08f68bfa-5fe7-4cc2-a833-9f0c72871994","Type":"ContainerStarted","Data":"7cc4e0ed11a67dc2d5668bbe015d9e1332e697e2a74208f0089dd36362daa5e9"}
Nov 04 05:28:17.943104 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.943065    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tgz7l" event={"ID":"9ba6f7a7-c835-4c2b-8e17-32015f629d52","Type":"ContainerStarted","Data":"40442cd901af1940c16dea8df4ad0a8e19c43dcc07fdf2cfb50e2f8d8036cac6"}
Nov 04 05:28:17.945678 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.945653    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j5vrf" event={"ID":"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9","Type":"ContainerStarted","Data":"c1cbc4a32b0cd8299ef1c2751fcaa3f1b8bc10fd92175ee1abb27c8a68f309a7"}
Nov 04 05:28:17.957717 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:17.956028    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7" podStartSLOduration=443.727709396 podStartE2EDuration="7m25.956009287s" totalImagesPullingTime="2.228299891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:17.954646382 +0000 UTC m=+34.955821634" watchObservedRunningTime="2026-11-04 05:28:17.956009287 +0000 UTC m=+34.957184540"
Nov 04 05:28:18.043541 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:18.043440    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:18.120616 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:18.120558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:19.368333 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:19.368295    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:19.432580 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:19.432488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:19.958614 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:19.958569    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/0.log"
Nov 04 05:28:19.958614 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:19.958613    2579 generic.go:356] "Generic (PLEG): container finished" podID="8e7e37c2-a915-457b-a553-b53f25aaba42" containerID="f5bcc0c18abfd98d665c9348cba9f92de3373dd7535c2bae49e1911f7027ece0" exitCode=255
Nov 04 05:28:19.958964 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:19.958664    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz" event={"ID":"8e7e37c2-a915-457b-a553-b53f25aaba42","Type":"ContainerDied","Data":"f5bcc0c18abfd98d665c9348cba9f92de3373dd7535c2bae49e1911f7027ece0"}
Nov 04 05:28:19.958964 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:19.958928    2579 scope.go:122] "RemoveContainer" containerID="f5bcc0c18abfd98d665c9348cba9f92de3373dd7535c2bae49e1911f7027ece0"
Nov 04 05:28:20.745832 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.745685    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq"]
Nov 04 05:28:20.771285 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.770769    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f"]
Nov 04 05:28:20.778539 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.777301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq"
Nov 04 05:28:20.779168 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.779135    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:20.790810 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.790363    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq"]
Nov 04 05:28:20.790810 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.790412    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f"]
Nov 04 05:28:20.790810 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.790534    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f"
Nov 04 05:28:20.793446 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.792902    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-st4b8\""
Nov 04 05:28:20.809547 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.809523    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:20.809688 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.809653    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 04 05:28:20.875265 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.874979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-547xj\" (UniqueName: \"kubernetes.io/projected/d44943ce-d083-4b43-a8ce-1c451bbd783b-kube-api-access-547xj\") pod \"migrator-66df5d496b-95h9f\" (UID: \"d44943ce-d083-4b43-a8ce-1c451bbd783b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f"
Nov 04 05:28:20.875265 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.875074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djxxq\" (UniqueName: \"kubernetes.io/projected/7ccd662b-1239-4afb-bf3a-d9d285d4fbda-kube-api-access-djxxq\") pod \"migrator-66df5d496b-x2zmq\" (UID: \"7ccd662b-1239-4afb-bf3a-d9d285d4fbda\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq"
Nov 04 05:28:20.904004 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.903972    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m8zlm"]
Nov 04 05:28:20.920017 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.919369    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m8zlm"]
Nov 04 05:28:20.920017 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.919467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:20.927958 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.927639    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 05:28:20.927958 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.927898    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 05:28:20.931109 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.928563    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-pcv9f-qnplw"]
Nov 04 05:28:20.931109 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.929566    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ghvrd\""
Nov 04 05:28:20.961657 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.961621    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:20.970386 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.970361    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-pcv9f-qnplw"]
Nov 04 05:28:20.970581 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.970487    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:20.974573 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.974549    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h8l64\""
Nov 04 05:28:20.976374 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.976355    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djxxq\" (UniqueName: \"kubernetes.io/projected/7ccd662b-1239-4afb-bf3a-d9d285d4fbda-kube-api-access-djxxq\") pod \"migrator-66df5d496b-x2zmq\" (UID: \"7ccd662b-1239-4afb-bf3a-d9d285d4fbda\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq"
Nov 04 05:28:20.976803 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.976777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-547xj\" (UniqueName: \"kubernetes.io/projected/d44943ce-d083-4b43-a8ce-1c451bbd783b-kube-api-access-547xj\") pod \"migrator-66df5d496b-95h9f\" (UID: \"d44943ce-d083-4b43-a8ce-1c451bbd783b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f"
Nov 04 05:28:20.980513 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.980472    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc" event={"ID":"ca807b05-9989-4b11-923c-d8f1423fde00","Type":"ContainerStarted","Data":"e5b2ede9b956e162ae4820457067cda33deb4764f99ac99745d46f8d33d9c60a"}
Nov 04 05:28:20.985858 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.985830    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djxxq\" (UniqueName: \"kubernetes.io/projected/7ccd662b-1239-4afb-bf3a-d9d285d4fbda-kube-api-access-djxxq\") pod \"migrator-66df5d496b-x2zmq\" (UID: \"7ccd662b-1239-4afb-bf3a-d9d285d4fbda\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq"
Nov 04 05:28:20.987601 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.987578    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-547xj\" (UniqueName: \"kubernetes.io/projected/d44943ce-d083-4b43-a8ce-1c451bbd783b-kube-api-access-547xj\") pod \"migrator-66df5d496b-95h9f\" (UID: \"d44943ce-d083-4b43-a8ce-1c451bbd783b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f"
Nov 04 05:28:20.999922 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:20.999710    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-5skd7" event={"ID":"5794b522-36b9-4e80-b852-deff2905e1c7","Type":"ContainerStarted","Data":"a80a125ab808bf5456a7ed9d3a542a465998e42151230fd833b5a1b81a4fcf88"}
Nov 04 05:28:21.014115 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.014057    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc" podStartSLOduration=438.017138777 podStartE2EDuration="7m24.014036847s" totalImagesPullingTime="5.99689807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:21.013617695 +0000 UTC m=+38.014792946" watchObservedRunningTime="2026-11-04 05:28:21.014036847 +0000 UTC m=+38.015212096"
Nov 04 05:28:21.015322 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.015243    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qfz8d" event={"ID":"c7b2d156-2b78-4114-9980-8543ed070a9a","Type":"ContainerStarted","Data":"7aed12ca053485baa52cd1579767a07168568cbd1891ea13c23493f555818dde"}
Nov 04 05:28:21.031216 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.030747    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-5skd7" podStartSLOduration=440.7696609 podStartE2EDuration="7m26.030727795s" totalImagesPullingTime="5.261066895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:21.030430745 +0000 UTC m=+38.031606000" watchObservedRunningTime="2026-11-04 05:28:21.030727795 +0000 UTC m=+38.031903050"
Nov 04 05:28:21.033463 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.033429    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8" event={"ID":"327add5c-5660-46e3-93b6-683b8bee126e","Type":"ContainerStarted","Data":"199832b147ecccee823c1a80f83366b53f26a11327be4f3b14d975eeaf6c7baf"}
Nov 04 05:28:21.035689 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.035654    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h" event={"ID":"39761fca-7780-4800-a367-f827667dc6d7","Type":"ContainerStarted","Data":"f24def93c13deaa627e0c075d3162aea21b650e7b25d21017b5a1e51ea539617"}
Nov 04 05:28:21.038581 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.038555    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:28:21.039596 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.039578    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/0.log"
Nov 04 05:28:21.039679 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.039612    2579 generic.go:356] "Generic (PLEG): container finished" podID="8e7e37c2-a915-457b-a553-b53f25aaba42" containerID="d952219913e9b4b176279c24ad9a9df273175f648a4305b0b1fed0f30cf828b6" exitCode=255
Nov 04 05:28:21.039679 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.039642    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz" event={"ID":"8e7e37c2-a915-457b-a553-b53f25aaba42","Type":"ContainerDied","Data":"d952219913e9b4b176279c24ad9a9df273175f648a4305b0b1fed0f30cf828b6"}
Nov 04 05:28:21.039821 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.039678    2579 scope.go:122] "RemoveContainer" containerID="f5bcc0c18abfd98d665c9348cba9f92de3373dd7535c2bae49e1911f7027ece0"
Nov 04 05:28:21.040123 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.040103    2579 scope.go:122] "RemoveContainer" containerID="d952219913e9b4b176279c24ad9a9df273175f648a4305b0b1fed0f30cf828b6"
Nov 04 05:28:21.040328 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.040304    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-jvwgz_openshift-console-operator(8e7e37c2-a915-457b-a553-b53f25aaba42)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz" podUID="8e7e37c2-a915-457b-a553-b53f25aaba42"
Nov 04 05:28:21.044331 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.044297    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:21.054569 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.054475    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8" podStartSLOduration=443.742131736 podStartE2EDuration="7m29.054460961s" totalImagesPullingTime="5.312329225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:21.053659677 +0000 UTC m=+38.054834928" watchObservedRunningTime="2026-11-04 05:28:21.054460961 +0000 UTC m=+38.055636213"
Nov 04 05:28:21.076673 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.076623    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qfz8d" podStartSLOduration=2.198474252 podStartE2EDuration="8.076607027s" totalImagesPullingTime="5.878132775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:21.076153323 +0000 UTC m=+38.077328574" watchObservedRunningTime="2026-11-04 05:28:21.076607027 +0000 UTC m=+38.077782278"
Nov 04 05:28:21.077573 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.077404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-trusted-ca-bundle\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.077573 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.077495    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.077929 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.077873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-service-ca-bundle\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.077929 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.077906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4952ed47-5e12-468b-9b7a-12566b6cffa5-crio-socket\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.078232 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.078195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4952ed47-5e12-468b-9b7a-12566b6cffa5-data-volume\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.078406 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.078388    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8b5b0789-263a-476a-ba8e-5119eceec889-archives-path\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.078785 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.078661    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt8cx\" (UniqueName: \"kubernetes.io/projected/8b5b0789-263a-476a-ba8e-5119eceec889-kube-api-access-tt8cx\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.078785 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.078717    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnzbx\" (UniqueName: \"kubernetes.io/projected/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-api-access-fnzbx\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.078785 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.078772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.099038 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.098646    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h" podStartSLOduration=443.732221605 podStartE2EDuration="7m29.098628564s" totalImagesPullingTime="5.366406959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:21.098420614 +0000 UTC m=+38.099595866" watchObservedRunningTime="2026-11-04 05:28:21.098628564 +0000 UTC m=+38.099803814"
Nov 04 05:28:21.114458 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.114427    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq"
Nov 04 05:28:21.120931 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.120901    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-6jklt"]
Nov 04 05:28:21.131494 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.131419    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-6jklt"]
Nov 04 05:28:21.131647 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.131548    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:21.132215 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.132185    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f"
Nov 04 05:28:21.136203 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.136181    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 04 05:28:21.137122 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.136761    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 04 05:28:21.137122 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.136856    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 04 05:28:21.137122 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.136950    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-68zmm\""
Nov 04 05:28:21.137122 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.137055    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 04 05:28:21.169900 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.169839    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:21.181569 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.179591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt8cx\" (UniqueName: \"kubernetes.io/projected/8b5b0789-263a-476a-ba8e-5119eceec889-kube-api-access-tt8cx\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.181569 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.179669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnzbx\" (UniqueName: \"kubernetes.io/projected/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-api-access-fnzbx\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.181569 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.179735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.181569 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.179776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-trusted-ca-bundle\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.181569 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.179877    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.181569 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.179935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-service-ca-bundle\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.181569 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.179961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4952ed47-5e12-468b-9b7a-12566b6cffa5-crio-socket\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.181569 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.180002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4952ed47-5e12-468b-9b7a-12566b6cffa5-data-volume\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.181569 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.180112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8b5b0789-263a-476a-ba8e-5119eceec889-archives-path\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.183457 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.182244    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 05:28:21.183457 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.182303    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:21.682286479 +0000 UTC m=+38.683461723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : configmap "kube-rbac-proxy" not found
Nov 04 05:28:21.183457 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.182513    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4952ed47-5e12-468b-9b7a-12566b6cffa5-crio-socket\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.183457 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.182893    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:21.183457 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.182951    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:21.682932376 +0000 UTC m=+38.684107630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:21.183457 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.182963    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8b5b0789-263a-476a-ba8e-5119eceec889-archives-path\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.183457 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.183217    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-service-ca-bundle\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.183457 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.183382    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4952ed47-5e12-468b-9b7a-12566b6cffa5-data-volume\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.183457 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.183411    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-trusted-ca-bundle\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.190270 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.190177    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt8cx\" (UniqueName: \"kubernetes.io/projected/8b5b0789-263a-476a-ba8e-5119eceec889-kube-api-access-tt8cx\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.195012 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.194959    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnzbx\" (UniqueName: \"kubernetes.io/projected/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-api-access-fnzbx\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.241099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.241073    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:21.281228 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.281195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37349891-fa32-427e-9938-c741ba8a605d-signing-cabundle\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:21.281359 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.281264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x9v9\" (UniqueName: \"kubernetes.io/projected/37349891-fa32-427e-9938-c741ba8a605d-kube-api-access-2x9v9\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:21.281359 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.281346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37349891-fa32-427e-9938-c741ba8a605d-signing-key\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:21.334442 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.334384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:21.383014 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.382541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37349891-fa32-427e-9938-c741ba8a605d-signing-cabundle\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:21.383014 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.382643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x9v9\" (UniqueName: \"kubernetes.io/projected/37349891-fa32-427e-9938-c741ba8a605d-kube-api-access-2x9v9\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:21.383014 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.382769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37349891-fa32-427e-9938-c741ba8a605d-signing-key\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:21.383343 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.383290    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37349891-fa32-427e-9938-c741ba8a605d-signing-cabundle\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:21.385758 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.385735    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37349891-fa32-427e-9938-c741ba8a605d-signing-key\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:21.391384 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.391358    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x9v9\" (UniqueName: \"kubernetes.io/projected/37349891-fa32-427e-9938-c741ba8a605d-kube-api-access-2x9v9\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:21.423288 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.423263    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq"]
Nov 04 05:28:21.431871 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:21.427216    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ccd662b_1239_4afb_bf3a_d9d285d4fbda.slice/crio-05f18a3a8834c2baf9ff6a3c24a06c34955f3f0172ac0b833e1eb09234684637 WatchSource:0}: Error finding container 05f18a3a8834c2baf9ff6a3c24a06c34955f3f0172ac0b833e1eb09234684637: Status 404 returned error can't find the container with id 05f18a3a8834c2baf9ff6a3c24a06c34955f3f0172ac0b833e1eb09234684637
Nov 04 05:28:21.468457 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.468425    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f"]
Nov 04 05:28:21.474644 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:21.471918    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44943ce_d083_4b43_a8ce_1c451bbd783b.slice/crio-7a2ea03847afc5dddd121b565044dd8a0a62f5003a6ed2a26b92f64f04b19171 WatchSource:0}: Error finding container 7a2ea03847afc5dddd121b565044dd8a0a62f5003a6ed2a26b92f64f04b19171: Status 404 returned error can't find the container with id 7a2ea03847afc5dddd121b565044dd8a0a62f5003a6ed2a26b92f64f04b19171
Nov 04 05:28:21.487150 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.487124    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:21.679420 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.679397    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-pcv9f-qnplw"]
Nov 04 05:28:21.681940 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:21.681909    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5b0789_263a_476a_ba8e_5119eceec889.slice/crio-5bce46cb4ae575446a63ffde37b795952fe90f240ef86408b93603a1734718bd WatchSource:0}: Error finding container 5bce46cb4ae575446a63ffde37b795952fe90f240ef86408b93603a1734718bd: Status 404 returned error can't find the container with id 5bce46cb4ae575446a63ffde37b795952fe90f240ef86408b93603a1734718bd
Nov 04 05:28:21.685624 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.685598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:21.685710 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.685639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:21.685710 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.685678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:21.685831 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.685756    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 05:28:21.685831 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.685772    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77865897f5-8m6ds: secret "image-registry-tls" not found
Nov 04 05:28:21.685831 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.685816    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls podName:12d8c1e7-c045-45ee-90ab-7b26087ec7c0 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.685801918 +0000 UTC m=+46.686977149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls") pod "image-registry-77865897f5-8m6ds" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0") : secret "image-registry-tls" not found
Nov 04 05:28:21.685831 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.685820    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 05:28:21.686032 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.685834    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.685820361 +0000 UTC m=+46.686995590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : configmap references non-existent config key: service-ca.crt
Nov 04 05:28:21.686032 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.685867    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:22.685852199 +0000 UTC m=+39.687027446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : configmap "kube-rbac-proxy" not found
Nov 04 05:28:21.686032 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.685769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.686032 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.685895    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 04 05:28:21.686032 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.685904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:21.686032 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.685923    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls podName:907d151f-d95c-40e6-95af-4198aec88c33 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.685914039 +0000 UTC m=+46.687089268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-mxz59" (UID: "907d151f-d95c-40e6-95af-4198aec88c33") : secret "cluster-monitoring-operator-tls" not found
Nov 04 05:28:21.686032 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.685976    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 05:28:21.686032 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.686011    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:21.686032 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.685974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:21.686032 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.686012    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls podName:810663b6-a5ea-4fef-b237-7caedfbab7f6 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.686000535 +0000 UTC m=+46.687175765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-6qps6" (UID: "810663b6-a5ea-4fef-b237-7caedfbab7f6") : secret "samples-operator-tls" not found
Nov 04 05:28:21.686405 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.686054    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:22.68604463 +0000 UTC m=+39.687219859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:21.686405 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.686118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:21.686405 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.686185    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 05:28:21.686405 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.686225    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.686215137 +0000 UTC m=+46.687390382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : secret "router-metrics-certs-default" not found
Nov 04 05:28:21.786773 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.786734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:21.787207 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.786793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:21.787207 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.786887    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 04 05:28:21.787207 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.786946    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert podName:41a1a23a-cfae-43f1-b639-b30b4448ea40 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.786928144 +0000 UTC m=+46.788103390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8dsn9" (UID: "41a1a23a-cfae-43f1-b639-b30b4448ea40") : secret "networking-console-plugin-cert" not found
Nov 04 05:28:21.787207 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.786944    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 05:28:21.787207 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.786989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:21.787207 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.787005    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls podName:a2a942cf-93c8-445a-b6b6-cbda93d99210 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.786986951 +0000 UTC m=+46.788162184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls") pod "dns-default-dqblv" (UID: "a2a942cf-93c8-445a-b6b6-cbda93d99210") : secret "dns-default-metrics-tls" not found
Nov 04 05:28:21.787207 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.787040    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 05:28:21.787207 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.787049    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-588d496878-vbp7s: secret "image-registry-tls" not found
Nov 04 05:28:21.787207 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:21.787073    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls podName:b0b21212-89e5-40ce-8bbd-75f93265da0e nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.78706555 +0000 UTC m=+46.788240820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls") pod "image-registry-588d496878-vbp7s" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e") : secret "image-registry-tls" not found
Nov 04 05:28:21.787495 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.787315    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-6jklt"]
Nov 04 05:28:21.791691 ip-10-0-141-135 kubenswrapper[2579]: W1104 05:28:21.791658    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37349891_fa32_427e_9938_c741ba8a605d.slice/crio-07a91304967dcd4b1ca836eb7e9c00f9c6663c91a0f531a8a026526faa401eb8 WatchSource:0}: Error finding container 07a91304967dcd4b1ca836eb7e9c00f9c6663c91a0f531a8a026526faa401eb8: Status 404 returned error can't find the container with id 07a91304967dcd4b1ca836eb7e9c00f9c6663c91a0f531a8a026526faa401eb8
Nov 04 05:28:21.879452 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:21.879386    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:22.047873 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.047797    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:28:22.048258 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.048238    2579 scope.go:122] "RemoveContainer" containerID="d952219913e9b4b176279c24ad9a9df273175f648a4305b0b1fed0f30cf828b6"
Nov 04 05:28:22.048486 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:22.048453    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-jvwgz_openshift-console-operator(8e7e37c2-a915-457b-a553-b53f25aaba42)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz" podUID="8e7e37c2-a915-457b-a553-b53f25aaba42"
Nov 04 05:28:22.051034 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.050922    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt" event={"ID":"37349891-fa32-427e-9938-c741ba8a605d","Type":"ContainerStarted","Data":"f12524d9e1e27dfbd9835849fd7c98935b382fa8b68e025c7c807421ec274d56"}
Nov 04 05:28:22.051034 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.050986    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt" event={"ID":"37349891-fa32-427e-9938-c741ba8a605d","Type":"ContainerStarted","Data":"07a91304967dcd4b1ca836eb7e9c00f9c6663c91a0f531a8a026526faa401eb8"}
Nov 04 05:28:22.053047 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.053009    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-pcv9f-qnplw" event={"ID":"8b5b0789-263a-476a-ba8e-5119eceec889","Type":"ContainerStarted","Data":"9d63815f51dd72c656194ab35d5cb4b573c3c53d02479a05a8306abbfe507f56"}
Nov 04 05:28:22.053174 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.053054    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-pcv9f-qnplw" event={"ID":"8b5b0789-263a-476a-ba8e-5119eceec889","Type":"ContainerStarted","Data":"5bce46cb4ae575446a63ffde37b795952fe90f240ef86408b93603a1734718bd"}
Nov 04 05:28:22.055792 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.055371    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j5vrf" event={"ID":"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9","Type":"ContainerStarted","Data":"b60595101fc69e042819b7cca97a6ff63dbba132894f507f623d4854f56cb98f"}
Nov 04 05:28:22.055792 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.055422    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:22.057034 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.057007    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f" event={"ID":"d44943ce-d083-4b43-a8ce-1c451bbd783b","Type":"ContainerStarted","Data":"7a2ea03847afc5dddd121b565044dd8a0a62f5003a6ed2a26b92f64f04b19171"}
Nov 04 05:28:22.058438 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.058411    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq" event={"ID":"7ccd662b-1239-4afb-bf3a-d9d285d4fbda","Type":"ContainerStarted","Data":"05f18a3a8834c2baf9ff6a3c24a06c34955f3f0172ac0b833e1eb09234684637"}
Nov 04 05:28:22.088053 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.087990    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt" podStartSLOduration=1.087974872 podStartE2EDuration="1.087974872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:22.08606187 +0000 UTC m=+39.087237126" watchObservedRunningTime="2026-11-04 05:28:22.087974872 +0000 UTC m=+39.089150123"
Nov 04 05:28:22.106223 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.106163    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-pcv9f-qnplw" podStartSLOduration=2.106144678 podStartE2EDuration="2.106144678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:22.104795513 +0000 UTC m=+39.105970765" watchObservedRunningTime="2026-11-04 05:28:22.106144678 +0000 UTC m=+39.107319931"
Nov 04 05:28:22.121794 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.121731    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j5vrf" podStartSLOduration=35.447586588 podStartE2EDuration="39.121711136s" totalImagesPullingTime="3.674124548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:22.120036517 +0000 UTC m=+39.121211769" watchObservedRunningTime="2026-11-04 05:28:22.121711136 +0000 UTC m=+39.122886389"
Nov 04 05:28:22.567208 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.567128    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:22.655902 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.655822    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:22.698070 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.698022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:22.698264 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.698104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:22.698332 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:22.698301    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:22.698382 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:22.698351    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:24.698337365 +0000 UTC m=+41.699512607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:22.698868 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:22.698682    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 05:28:22.698868 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:22.698727    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:24.698716568 +0000 UTC m=+41.699891810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : configmap "kube-rbac-proxy" not found
Nov 04 05:28:22.806649 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.806587    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:22.936801 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:22.936753    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:23.041223 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:23.041104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:23.137817 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:23.137778    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:23.506099 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:23.505577    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:23.798702 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:23.798622    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:24.070199 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.070097    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f" event={"ID":"d44943ce-d083-4b43-a8ce-1c451bbd783b","Type":"ContainerStarted","Data":"7fe0e9733e39763aa066e4c6ca46efdf08bf83656fd5554e2aff8ee592a5d4d7"}
Nov 04 05:28:24.071863 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.071808    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq" event={"ID":"7ccd662b-1239-4afb-bf3a-d9d285d4fbda","Type":"ContainerStarted","Data":"0a433e8a7e209a714989ad98acbbcb1b6181cd676f29263dd8390d0c8ee05021"}
Nov 04 05:28:24.086453 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.086404    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f" podStartSLOduration=2.314119683 podStartE2EDuration="4.086391076s" totalImagesPullingTime="1.772271393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:24.086332703 +0000 UTC m=+41.087507955" watchObservedRunningTime="2026-11-04 05:28:24.086391076 +0000 UTC m=+41.087566328"
Nov 04 05:28:24.102625 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.102570    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq" podStartSLOduration=2.069539307 podStartE2EDuration="4.10255594s" totalImagesPullingTime="2.033016633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:24.100977524 +0000 UTC m=+41.102152778" watchObservedRunningTime="2026-11-04 05:28:24.10255594 +0000 UTC m=+41.103731190"
Nov 04 05:28:24.129238 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.129205    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zgr4j_e02ac97f-6e15-4540-8b31-a7208f55217a/dns-node-resolver/0.log"
Nov 04 05:28:24.248700 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.248666    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:24.248891 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.248729    2579 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:24.249175 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.249155    2579 scope.go:122] "RemoveContainer" containerID="d952219913e9b4b176279c24ad9a9df273175f648a4305b0b1fed0f30cf828b6"
Nov 04 05:28:24.249413 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:24.249386    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-jvwgz_openshift-console-operator(8e7e37c2-a915-457b-a553-b53f25aaba42)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz" podUID="8e7e37c2-a915-457b-a553-b53f25aaba42"
Nov 04 05:28:24.335172 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.335076    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:24.466362 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.466334    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:24.709806 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.709776    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:24.718051 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.718023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:24.718184 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:24.718134    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 05:28:24.718234 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:24.718195    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:28.718179024 +0000 UTC m=+45.719354257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : configmap "kube-rbac-proxy" not found
Nov 04 05:28:24.718234 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.718162    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:24.718323 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:24.718306    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:24.718369 ip-10-0-141-135 kubenswrapper[2579]: E1104 05:28:24.718357    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:28.718345054 +0000 UTC m=+45.719520301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:24.731977 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.731955    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j2n64_8dd81a50-cf93-4c73-a2cf-793fee04c292/node-ca/0.log"
Nov 04 05:28:24.818098 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.818069    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:24.909947 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.909914    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:24.976174 ip-10-0-141-135 kubenswrapper[2579]: I1104 05:28:24.976090    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:25.075535 ip-10-0-141-135 systemd[1]: Stopping Kubernetes Kubelet...
Nov 04 05:28:25.092957 ip-10-0-141-135 systemd[1]: kubelet.service: Deactivated successfully.
Nov 04 05:28:25.093187 ip-10-0-141-135 systemd[1]: Stopped Kubernetes Kubelet.
Nov 04 05:28:25.093251 ip-10-0-141-135 systemd[1]: kubelet.service: Consumed 3.391s CPU time.
Nov 04 05:28:25.109047 ip-10-0-141-135 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 05:28:25.208449 ip-10-0-141-135 kubenswrapper[5079]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:28:25.208449 ip-10-0-141-135 kubenswrapper[5079]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 05:28:25.208449 ip-10-0-141-135 kubenswrapper[5079]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:28:25.208449 ip-10-0-141-135 kubenswrapper[5079]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 05:28:25.210610 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210512    5079 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:25.210610 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210608    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:25.210610 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210612    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:25.210610 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210615    5079 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210619    5079 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210622    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210625    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210634    5079 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210637    5079 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210640    5079 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210642    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210647    5079 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210651    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210654    5079 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210657    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210660    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210663    5079 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210666    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210668    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210671    5079 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210674    5079 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210677    5079 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:25.210769 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210680    5079 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210683    5079 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210686    5079 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210689    5079 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210692    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210695    5079 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210698    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210700    5079 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210703    5079 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210705    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210708    5079 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210711    5079 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210713    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210716    5079 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210719    5079 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210721    5079 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210724    5079 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210727    5079 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210730    5079 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:25.211265 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210732    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210735    5079 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210738    5079 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210741    5079 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210743    5079 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210746    5079 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210749    5079 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210752    5079 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210755    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210757    5079 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210760    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210763    5079 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210766    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210768    5079 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210771    5079 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210773    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210776    5079 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210779    5079 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210782    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:25.211771 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210785    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210788    5079 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210791    5079 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210794    5079 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210796    5079 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210799    5079 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210801    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210804    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210806    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210809    5079 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210812    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210815    5079 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210818    5079 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210821    5079 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210824    5079 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210826    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210830    5079 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210833    5079 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210835    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210838    5079 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:25.212238 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210840    5079 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210843    5079 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210846    5079 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210848    5079 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210851    5079 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210854    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210857    5079 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210859    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210862    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210864    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210867    5079 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210870    5079 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210874    5079 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210879    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210883    5079 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210887    5079 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210890    5079 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210892    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210896    5079 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:25.212774 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210898    5079 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210901    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210904    5079 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210906    5079 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210909    5079 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210911    5079 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.210915    5079 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211781    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211790    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211794    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211798    5079 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211801    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211804    5079 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211806    5079 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211809    5079 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211811    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211814    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211817    5079 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211819    5079 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211822    5079 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:25.213264 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211824    5079 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211827    5079 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211830    5079 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211833    5079 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211835    5079 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211839    5079 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211841    5079 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211846    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211849    5079 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211852    5079 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211854    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211857    5079 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211860    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211863    5079 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211865    5079 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211868    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211871    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211873    5079 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211876    5079 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211887    5079 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:25.213814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211890    5079 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211893    5079 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211896    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211898    5079 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211901    5079 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211904    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211906    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211909    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211912    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211914    5079 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211916    5079 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211919    5079 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211922    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211925    5079 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211927    5079 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211930    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211933    5079 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211935    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211938    5079 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211941    5079 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:25.214330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211944    5079 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211946    5079 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211951    5079 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211954    5079 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211957    5079 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211960    5079 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211964    5079 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211967    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211969    5079 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211972    5079 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211974    5079 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211977    5079 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211985    5079 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211988    5079 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211991    5079 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211994    5079 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211996    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.211999    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:25.214874 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212003    5079 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212007    5079 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212010    5079 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212013    5079 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212016    5079 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212019    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212021    5079 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212024    5079 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212027    5079 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212029    5079 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212032    5079 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212035    5079 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212038    5079 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212040    5079 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212043    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212045    5079 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212048    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212051    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212053    5079 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:25.215357 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212056    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212058    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212061    5079 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212064    5079 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212066    5079 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212069    5079 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212071    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212079    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212088    5079 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212090    5079 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212094    5079 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212097    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212099    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212102    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212105    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212107    5079 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212631    5079 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212637    5079 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212640    5079 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212643    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:25.215845 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212646    5079 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212649    5079 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212651    5079 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212654    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212657    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212660    5079 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212664    5079 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212667    5079 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212671    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212675    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212678    5079 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212682    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212684    5079 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212687    5079 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212690    5079 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212694    5079 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212696    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212699    5079 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212702    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:25.216343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212707    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212710    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212713    5079 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212716    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212718    5079 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212721    5079 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212724    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212726    5079 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212729    5079 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212732    5079 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212734    5079 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212737    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212739    5079 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212742    5079 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212744    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212747    5079 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212749    5079 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212752    5079 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212754    5079 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212757    5079 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:25.216864 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212760    5079 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212763    5079 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212765    5079 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212768    5079 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212771    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212773    5079 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212776    5079 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212779    5079 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212781    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212784    5079 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212787    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212789    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212793    5079 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212795    5079 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212798    5079 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212801    5079 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212804    5079 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212806    5079 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212809    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212811    5079 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:25.217630 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212814    5079 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212816    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212820    5079 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212823    5079 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212825    5079 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212827    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212830    5079 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212833    5079 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212835    5079 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212838    5079 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212841    5079 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212844    5079 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212846    5079 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212849    5079 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212852    5079 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212854    5079 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212857    5079 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212859    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212862    5079 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212864    5079 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:25.218709 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212867    5079 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212869    5079 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212872    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212875    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212877    5079 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212880    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212882    5079 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212888    5079 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212891    5079 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212893    5079 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212896    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212898    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212901    5079 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212904    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212906    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212909    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212911    5079 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212914    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212916    5079 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:25.219230 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212919    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212923    5079 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212927    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.212931    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213029    5079 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213039    5079 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213048    5079 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213055    5079 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213061    5079 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213064    5079 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213071    5079 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213075    5079 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213079    5079 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213082    5079 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213085    5079 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213089    5079 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213092    5079 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213095    5079 flags.go:64] FLAG: --cgroup-root=""
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213098    5079 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213101    5079 flags.go:64] FLAG: --client-ca-file=""
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213104    5079 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213109    5079 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213114    5079 flags.go:64] FLAG: --cluster-domain=""
Nov 04 05:28:25.219716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213117    5079 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213120    5079 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213123    5079 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213127    5079 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213131    5079 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213134    5079 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213137    5079 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213140    5079 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213143    5079 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213146    5079 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213149    5079 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213153    5079 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213156    5079 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213161    5079 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213164    5079 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213167    5079 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213170    5079 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213173    5079 flags.go:64] FLAG: --enable-server="true"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213176    5079 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213180    5079 flags.go:64] FLAG: --event-burst="100"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213185    5079 flags.go:64] FLAG: --event-qps="50"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213189    5079 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213192    5079 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213195    5079 flags.go:64] FLAG: --eviction-hard=""
Nov 04 05:28:25.220280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213200    5079 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213203    5079 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213206    5079 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213209    5079 flags.go:64] FLAG: --eviction-soft=""
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213213    5079 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213216    5079 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213219    5079 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213223    5079 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213226    5079 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213229    5079 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213232    5079 flags.go:64] FLAG: --feature-gates=""
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213236    5079 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213239    5079 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213243    5079 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213246    5079 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213250    5079 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213253    5079 flags.go:64] FLAG: --help="false"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213256    5079 flags.go:64] FLAG: --hostname-override="ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213260    5079 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213263    5079 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213266    5079 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213270    5079 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213274    5079 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 05:28:25.220879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213277    5079 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213280    5079 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213284    5079 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213287    5079 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213290    5079 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213294    5079 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213297    5079 flags.go:64] FLAG: --kube-reserved=""
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213300    5079 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213303    5079 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213306    5079 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213309    5079 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213312    5079 flags.go:64] FLAG: --lock-file=""
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213315    5079 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213318    5079 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213322    5079 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213327    5079 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213330    5079 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213334    5079 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213338    5079 flags.go:64] FLAG: --logging-format="text"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213341    5079 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213344    5079 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213352    5079 flags.go:64] FLAG: --manifest-url=""
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213355    5079 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213361    5079 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213364    5079 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 05:28:25.221490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213368    5079 flags.go:64] FLAG: --max-pods="110"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213371    5079 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213374    5079 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213377    5079 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213380    5079 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213384    5079 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213387    5079 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213390    5079 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213397    5079 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213400    5079 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213404    5079 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213407    5079 flags.go:64] FLAG: --pod-cidr=""
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213411    5079 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213415    5079 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213419    5079 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213422    5079 flags.go:64] FLAG: --port="10250"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213425    5079 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213428    5079 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-084f2a1523833e1cc"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213431    5079 flags.go:64] FLAG: --qos-reserved=""
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213434    5079 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213438    5079 flags.go:64] FLAG: --register-node="true"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213441    5079 flags.go:64] FLAG: --register-with-taints=""
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213444    5079 flags.go:64] FLAG: --registry-burst="10"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213447    5079 flags.go:64] FLAG: --registry-qps="5"
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213450    5079 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213454    5079 flags.go:64] FLAG: --reserved-memory=""
Nov 04 05:28:25.222185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213458    5079 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213461    5079 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213466    5079 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213469    5079 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213472    5079 flags.go:64] FLAG: --runonce="false"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213475    5079 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213479    5079 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213482    5079 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213485    5079 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213488    5079 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213491    5079 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213494    5079 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213514    5079 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213518    5079 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213521    5079 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213525    5079 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213528    5079 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213531    5079 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213536    5079 flags.go:64] FLAG: --system-cgroups=""
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213539    5079 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213544    5079 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213547    5079 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213550    5079 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213555    5079 flags.go:64] FLAG: --tls-min-version=""
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213558    5079 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 05:28:25.222854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213561    5079 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213564    5079 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213567    5079 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213570    5079 flags.go:64] FLAG: --v="2"
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213575    5079 flags.go:64] FLAG: --version="false"
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213580    5079 flags.go:64] FLAG: --vmodule=""
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213584    5079 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.213588    5079 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213742    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213747    5079 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213750    5079 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213754    5079 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213757    5079 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213759    5079 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213762    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213765    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213768    5079 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213772    5079 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213777    5079 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213780    5079 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213782    5079 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:25.223470 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213785    5079 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213788    5079 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213791    5079 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213793    5079 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213798    5079 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213800    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213803    5079 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213805    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213808    5079 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213811    5079 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213813    5079 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213816    5079 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213819    5079 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213822    5079 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213824    5079 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213827    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213830    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213832    5079 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213835    5079 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213838    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:25.224003 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213842    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213845    5079 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213848    5079 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213850    5079 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213853    5079 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213856    5079 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213858    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213861    5079 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213864    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213866    5079 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213869    5079 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213873    5079 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213877    5079 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213880    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213882    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213885    5079 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213889    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213892    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213894    5079 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:25.224481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213897    5079 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213900    5079 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213903    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213906    5079 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213909    5079 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213911    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213914    5079 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213917    5079 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213919    5079 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213922    5079 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213924    5079 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213927    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213930    5079 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213935    5079 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213938    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213940    5079 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213943    5079 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213946    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213948    5079 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213951    5079 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:25.224966 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213954    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213956    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213959    5079 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213962    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213964    5079 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213967    5079 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213970    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213972    5079 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213975    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213979    5079 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213982    5079 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213984    5079 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213987    5079 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213990    5079 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213992    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213995    5079 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.213998    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214000    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214003    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:25.225638 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214006    5079 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214008    5079 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214011    5079 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214014    5079 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214024    5079 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214027    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214031    5079 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214035    5079 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214037    5079 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214040    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214043    5079 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214045    5079 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214048    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214051    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214054    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.214083    5079 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:28:25.226206 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214120    5079 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214124    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214126    5079 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214130    5079 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214132    5079 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214135    5079 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214138    5079 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214142    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214145    5079 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214148    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214150    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214153    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214156    5079 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214159    5079 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214162    5079 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214164    5079 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214167    5079 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214169    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214172    5079 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:25.226808 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214174    5079 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214177    5079 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214180    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214183    5079 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214186    5079 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214189    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214192    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214194    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214197    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214199    5079 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214202    5079 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214205    5079 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214208    5079 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214210    5079 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214213    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214215    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214218    5079 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214221    5079 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214225    5079 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:25.227398 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214227    5079 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214232    5079 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214234    5079 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214237    5079 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214240    5079 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214243    5079 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214245    5079 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214248    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214251    5079 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214253    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214256    5079 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214258    5079 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214261    5079 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214263    5079 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214266    5079 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214268    5079 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214272    5079 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214275    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214278    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214281    5079 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:25.227961 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214284    5079 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214287    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214290    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214293    5079 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214295    5079 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214298    5079 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214301    5079 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214303    5079 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214306    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214309    5079 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214311    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214314    5079 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214316    5079 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214323    5079 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214327    5079 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214330    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214334    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214337    5079 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214339    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:25.228527 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214342    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214345    5079 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214348    5079 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214350    5079 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214353    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214355    5079 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214358    5079 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214361    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214363    5079 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214367    5079 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214370    5079 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214373    5079 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214375    5079 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214378    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214381    5079 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214384    5079 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214386    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214389    5079 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214391    5079 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214394    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:25.229047 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214396    5079 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214399    5079 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214402    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214405    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214408    5079 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214410    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214415    5079 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214417    5079 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.214420    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.219854    5079 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.219875    5079 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.219894    5079 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.219899    5079 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.219974    5079 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.219980    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.219984    5079 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.219987    5079 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.219990    5079 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.219993    5079 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.219996    5079 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:25.229560 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.219999    5079 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220002    5079 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220004    5079 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220007    5079 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220011    5079 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220013    5079 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220017    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220020    5079 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220023    5079 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220026    5079 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220028    5079 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220031    5079 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220033    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220036    5079 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220039    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220041    5079 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220044    5079 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220047    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220051    5079 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220055    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:25.230056 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220059    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220062    5079 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220064    5079 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220067    5079 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220070    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220073    5079 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220076    5079 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220079    5079 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220082    5079 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220084    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220087    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220090    5079 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220092    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220095    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220097    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220100    5079 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220103    5079 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220106    5079 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220109    5079 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220112    5079 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:25.230623 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220116    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220118    5079 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220121    5079 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220124    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220126    5079 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220130    5079 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220132    5079 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220135    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220138    5079 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220140    5079 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220143    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220146    5079 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220148    5079 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220151    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220153    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220156    5079 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220159    5079 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220162    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220165    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:25.231151 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220168    5079 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220170    5079 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220173    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220176    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220178    5079 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220181    5079 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220183    5079 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220186    5079 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220189    5079 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220191    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220194    5079 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220196    5079 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220199    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220202    5079 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220205    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220207    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220211    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220213    5079 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220216    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:25.231625 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220219    5079 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220221    5079 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220224    5079 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220226    5079 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220229    5079 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220232    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220234    5079 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220237    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220240    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220242    5079 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220245    5079 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220248    5079 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220251    5079 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220254    5079 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220256    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220260    5079 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220264    5079 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220267    5079 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220270    5079 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:25.232085 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220273    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220276    5079 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.220307    5079 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220456    5079 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220462    5079 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220466    5079 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220469    5079 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220472    5079 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220480    5079 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220483    5079 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220485    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220488    5079 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220491    5079 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220494    5079 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220512    5079 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220517    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:25.232552 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220521    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220524    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220527    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220530    5079 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220533    5079 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220536    5079 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220539    5079 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220541    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220544    5079 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220547    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220550    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220552    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220555    5079 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220558    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220561    5079 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220563    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220566    5079 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220568    5079 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220571    5079 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:25.233242 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220573    5079 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220576    5079 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220580    5079 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220584    5079 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220587    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220590    5079 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220593    5079 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220596    5079 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220599    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220602    5079 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220604    5079 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220607    5079 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220609    5079 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220612    5079 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220615    5079 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220617    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220620    5079 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220623    5079 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220625    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:25.233995 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220628    5079 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220630    5079 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220633    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220635    5079 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220638    5079 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220641    5079 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220643    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220646    5079 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220648    5079 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220651    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220654    5079 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220656    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220659    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220661    5079 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220664    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220667    5079 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220669    5079 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220672    5079 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220675    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:25.234481 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220678    5079 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220683    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220686    5079 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220688    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220691    5079 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220693    5079 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220696    5079 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220698    5079 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220701    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220703    5079 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220706    5079 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220709    5079 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220711    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220714    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220716    5079 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220723    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220726    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220729    5079 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220732    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220734    5079 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:25.235055 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220737    5079 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220740    5079 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220742    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220745    5079 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220747    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220750    5079 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220752    5079 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220755    5079 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220758    5079 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220760    5079 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220763    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220765    5079 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220768    5079 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220771    5079 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220773    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220776    5079 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:25.235814 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.220800    5079 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220834    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220839    5079 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220842    5079 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220845    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220848    5079 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220851    5079 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220854    5079 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220856    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220859    5079 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220861    5079 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220864    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220868    5079 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220871    5079 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220874    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220876    5079 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220879    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220882    5079 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220885    5079 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220888    5079 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 05:28:25.236356 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220891    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220896    5079 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220900    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220903    5079 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220905    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220908    5079 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220911    5079 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220914    5079 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220916    5079 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220919    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220921    5079 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220924    5079 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220927    5079 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220930    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220933    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220936    5079 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220938    5079 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220941    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220944    5079 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 05:28:25.237105 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220946    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220949    5079 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220952    5079 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220955    5079 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220957    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220961    5079 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220964    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220966    5079 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220969    5079 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220972    5079 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220974    5079 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220977    5079 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220979    5079 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220982    5079 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220985    5079 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220987    5079 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220990    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220992    5079 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220995    5079 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.220998    5079 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 05:28:25.237842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221002    5079 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221004    5079 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221007    5079 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221009    5079 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221012    5079 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221015    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221018    5079 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221020    5079 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221022    5079 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221026    5079 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221028    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221031    5079 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221033    5079 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221036    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221038    5079 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221041    5079 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221043    5079 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221047    5079 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221050    5079 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221052    5079 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 05:28:25.238569 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221055    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221057    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221060    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221063    5079 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221066    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221070    5079 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221072    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221075    5079 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221077    5079 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221080    5079 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221083    5079 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221085    5079 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221094    5079 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221097    5079 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221100    5079 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221103    5079 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221105    5079 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221108    5079 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221111    5079 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 05:28:25.239090 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221114    5079 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221116    5079 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221119    5079 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221122    5079 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221125    5079 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221127    5079 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221130    5079 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221133    5079 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:25.221136    5079 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.221195    5079 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.222269    5079 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.222332    5079 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.222605    5079 server.go:1014] "Starting client certificate rotation"
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.222741    5079 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.222800    5079 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 05:22:43 +0000 UTC" deadline="2028-07-08 15:06:29.080972869 +0000 UTC"
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.222831    5079 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14697h38m3.858144846s"
Nov 04 05:28:25.239578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.223087    5079 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:28:25.240005 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.224236    5079 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 05:28:25.240005 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.225568    5079 log.go:25] "Validated CRI v1 runtime API"
Nov 04 05:28:25.240005 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.227346    5079 log.go:25] "Validated CRI v1 image API"
Nov 04 05:28:25.240005 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.228114    5079 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 05:28:25.240005 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.230200    5079 fs.go:135] Filesystem UUIDs: map[2b01b889-4a31-4b46-93df-ab13e369ebb6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a1d93fbe-de53-4cb5-a61a-08fc0ee6045f:/dev/nvme0n1p4]
Nov 04 05:28:25.240167 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.230216    5079 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/05f18a3a8834c2baf9ff6a3c24a06c34955f3f0172ac0b833e1eb09234684637/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/05f18a3a8834c2baf9ff6a3c24a06c34955f3f0172ac0b833e1eb09234684637/userdata/shm major:0 minor:334 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/076805bd92baf3feafb1f5fa5ccf49b568fd5fd946b28e6655616f540ef20e4e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/076805bd92baf3feafb1f5fa5ccf49b568fd5fd946b28e6655616f540ef20e4e/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/07a91304967dcd4b1ca836eb7e9c00f9c6663c91a0f531a8a026526faa401eb8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/07a91304967dcd4b1ca836eb7e9c00f9c6663c91a0f531a8a026526faa401eb8/userdata/shm major:0 minor:348 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0b9d81f7f61e4bedb94a59a960d03046280a8a7bb3d68bc67902feb655c6f399/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0b9d81f7f61e4bedb94a59a960d03046280a8a7bb3d68bc67902feb655c6f399/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/17efbc26e040d5667feb2d499ec602a82c750e45c8683ab733c12cff67a9ebde/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/17efbc26e040d5667feb2d499ec602a82c750e45c8683ab733c12cff67a9ebde/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/26bba77d4e6bff4b6e7259abc73bcc68cbfed187a2d6892f88719f76247ac350/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/26bba77d4e6bff4b6e7259abc73bcc68cbfed187a2d6892f88719f76247ac350/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/29ea7d2a945583be0f6dfbe90e0b19ddc87598195c636666daac6fb3f474b1cd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/29ea7d2a945583be0f6dfbe90e0b19ddc87598195c636666daac6fb3f474b1cd/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/307a57c0b7e679bc4a5b545ab5268b7b7d6aeac6302afbaffe3df7ef5bdf78fd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/307a57c0b7e679bc4a5b545ab5268b7b7d6aeac6302afbaffe3df7ef5bdf78fd/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3826931ce5087c70a990efc5919fd571a11b46f82aa8339183cb6592ea89428a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3826931ce5087c70a990efc5919fd571a11b46f82aa8339183cb6592ea89428a/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/40442cd901af1940c16dea8df4ad0a8e19c43dcc07fdf2cfb50e2f8d8036cac6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/40442cd901af1940c16dea8df4ad0a8e19c43dcc07fdf2cfb50e2f8d8036cac6/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/452a124c08741dc45db45b8b6ca7592d354fa717cfb0853f7803ad8d15fedaae/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/452a124c08741dc45db45b8b6ca7592d354fa717cfb0853f7803ad8d15fedaae/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5ad90056adb69d8d50ab24ad3c92f3f24de8ac45c0500cbdee16a725cbcd43a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5ad90056adb69d8d50ab24ad3c92f3f24de8ac45c0500cbdee16a725cbcd43a3/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5bce46cb4ae575446a63ffde37b795952fe90f240ef86408b93603a1734718bd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5bce46cb4ae575446a63ffde37b795952fe90f240ef86408b93603a1734718bd/userdata/shm major:0 minor:342 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6a00e0f307bc93fe9a39ff6fd0669fe41cb629c9570ac117fbfe6998299e93a8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6a00e0f307bc93fe9a39ff6fd0669fe41cb629c9570ac117fbfe6998299e93a8/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/76bd0de76a45f78d067a3050c892b2a760fd3594adda919b45a8cd7bc3c44849/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/76bd0de76a45f78d067a3050c892b2a760fd3594adda919b45a8cd7bc3c44849/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7a2ea03847afc5dddd121b565044dd8a0a62f5003a6ed2a26b92f64f04b19171/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7a2ea03847afc5dddd121b565044dd8a0a62f5003a6ed2a26b92f64f04b19171/userdata/shm major:0 minor:336 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/946d6e6572267dde46d428f8a74c1ddb51c75abead195e445cd6e0e5aecf3546/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/946d6e6572267dde46d428f8a74c1ddb51c75abead195e445cd6e0e5aecf3546/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a5cff6c593e3912eddb60779ac33e7aeaa08d4caa27a06b81d057e789d365c91/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a5cff6c593e3912eddb60779ac33e7aeaa08d4caa27a06b81d057e789d365c91/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b64ba21b4d6ae7b296dc86849e43623ff40dc87f2fd4857cc9ef2a995d1b47ed/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b64ba21b4d6ae7b296dc86849e43623ff40dc87f2fd4857cc9ef2a995d1b47ed/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bcc18f84b6b2c26478e2af21a89ee871c7b865bb9930123c3fe62c3bcd1ef947/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bcc18f84b6b2c26478e2af21a89ee871c7b865bb9930123c3fe62c3bcd1ef947/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c1cbc4a32b0cd8299ef1c2751fcaa3f1b8bc10fd92175ee1abb27c8a68f309a7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c1cbc4a32b0cd8299ef1c2751fcaa3f1b8bc10fd92175ee1abb27c8a68f309a7/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c75189a2c0081033b372c565fb204c9dd763b97442c719ea56f9c2f24d2576c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c75189a2c0081033b372c565fb204c9dd763b97442c719ea56f9c2f24d2576c2/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d3639527eac29c5593bdf5febf4603ebc7a296dd62e22b4f47c0e6e256e291d6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d3639527eac29c5593bdf5febf4603ebc7a296dd62e22b4f47c0e6e256e291d6/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ddf47ff9291b26c1645308ac84726086484efce113af0756b27cc26ad9a38e3e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ddf47ff9291b26c1645308ac84726086484efce113af0756b27cc26ad9a38e3e/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ee14ead0ff77f12b2d5e183a04800b066977cb4ea36f2a9f64a8d038250da35b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ee14ead0ff77f12b2d5e183a04800b066977cb4ea36f2a9f64a8d038250da35b/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fc78bf833cd11dac9ae32f384bffff4241e46ccb1dee83b70b9a4929c343f749/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fc78bf833cd11dac9ae32f384bffff4241e46ccb1dee83b70b9a4929c343f749/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/05890613-c051-4133-b1c6-7b282670a076/volumes/kubernetes.io~projected/kube-api-access-bfzfb:{mountpoint:/var/lib/kubelet/pods/05890613-c051-4133-b1c6-7b282670a076/volumes/kubernetes.io~projected/kube-api-access-bfzfb major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/08f68bfa-5fe7-4cc2-a833-9f0c72871994/volumes/kubernetes.io~projected/kube-api-access-wwr2j:{mountpoint:/var/lib/kubelet/pods/08f68bfa-5fe7-4cc2-a833-9f0c72871994/volumes/kubernetes.io~projected/kube-api-access-wwr2j major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~projected/kube-api-access-fb7nn:{mountpoint:/var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~projected/kube-api-access-fb7nn major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3024b38f-4b25-45ec-8a49-40a3859ca462/volumes/kubernetes.io~projected/kube-api-access-vh2lg:{mountpoint:/var/lib/kubelet/pods/3024b38f-4b25-45ec-8a49-40a3859ca462/volumes/kubernetes.io~projected/kube-api-access-vh2lg major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3024b38f-4b25-45ec-8a49-40a3859ca462/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/3024b38f-4b25-45ec-8a49-40a3859ca462/volumes/kubernetes.io~secret/default-certificate major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3024b38f-4b25-45ec-8a49-40a3859ca462/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/3024b38f-4b25-45ec-8a49-40a3859ca462/volumes/kubernetes.io~secret/stats-auth major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/327add5c-5660-46e3-93b6-683b8bee126e/volumes/kubernetes.io~projected/kube-api-access-fst49:{mountpoint:/var/lib/kubelet/pods/327add5c-5660-46e3-93b6-683b8bee126e/volumes/kubernetes.io~projected/kube-api-access-fst49 major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/327add5c-5660-46e3-93b6-683b8bee126e/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/327add5c-5660-46e3-93b6-683b8bee126e/volumes/kubernetes.io~secret/serving-cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/37349891-fa32-427e-9938-c741ba8a605d/volumes/kubernetes.io~projected/kube-api-access-2x9v9:{mountpoint:/var/lib/kubelet/pods/37349891-fa32-427e-9938-c741ba8a605d/volumes/kubernetes.io~projected/kube-api-access-2x9v9 major:0 minor:341 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/37349891-fa32-427e-9938-c741ba8a605d/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/37349891-fa32-427e-9938-c741ba8a605d/volumes/kubernetes.io~secret/signing-key major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39761fca-7780-4800-a367-f827667dc6d7/volumes/kubernetes.io~projected/kube-api-access-hp5vz:{mountpoint:/var/lib/kubelet/pods/39761fca-7780-4800-a367-f827667dc6d7/volumes/kubernetes.io~projected/kube-api-access-hp5vz major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/39761fca-7780-4800-a367-f827667dc6d7/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/39761fca-7780-4800-a367-f827667dc6d7/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/40a2fd4e-7382-4886-8853-15b7387a53b3/volumes/kubernetes.io~projected/kube-api-access-dmcsd:{mountpoint:/var/lib/kubelet/pods/40a2fd4e-7382-4886-8853-15b7387a53b3/volumes/kubernetes.io~projected/kube-api-access-dmcsd major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4952ed47-5e12-468b-9b7a-12566b6cffa5/volumes/kubernetes.io~projected/kube-api-access-fnzbx:{mountpoint:/var/lib/kubelet/pods/4952ed47-5e12-468b-9b7a-12566b6cffa5/volumes/kubernetes.io~projected/kube-api-access-fnzbx major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/526ed430-5c81-45f1-885d-2211b36b7745/volumes/kubernetes.io~projected/kube-api-access-s78z2:{mountpoint:/var/lib/kubelet/pods/526ed430-5c81-45f1-885d-2211b36b7745/volumes/kubernetes.io~projected/kube-api-access-s78z2 major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5794b522-36b9-4e80-b852-deff2905e1c7/volumes/kubernetes.io~projected/kube-api-access-xkkfg:{mountpoint:/var/lib/kubelet/pods/5794b522-36b9-4e80-b852-deff2905e1c7/volumes/kubernetes.io~projected/kube-api-access-xkkfg major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5794b522-36b9-4e80-b852-deff2905e1c7/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/5794b522-36b9-4e80-b852-deff2905e1c7/volumes/kubernetes.io~secret/serving-cert major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/589feb32-bcd4-4ab3-810a-0210968dc7b6/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/589feb32-bcd4-4ab3-810a-0210968dc7b6/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/589feb32-bcd4-4ab3-810a-0210968dc7b6/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/589feb32-bcd4-4ab3-810a-0210968dc7b6/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/589feb32-bcd4-4ab3-810a-0210968dc7b6/volumes/kubernetes.io~projected/kube-api-access-8kvnm:{mountpoint:/var/lib/kubelet/pods/589feb32-bcd4-4ab3-810a-0210968dc7b6/volumes/kubernetes.io~projected/kube-api-access-8kvnm major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b1bfba7-f83b-46fc-b06b-2a736bad505f/volumes/kubernetes.io~projected/kube-api-access-frjx7:{mountpoint:/var/lib/kubelet/pods/6b1bfba7-f83b-46fc-b06b-2a736bad505f/volumes/kubernetes.io~projected/kube-api-access-frjx7 major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6deb7716-c3cc-4944-99bf-dd904746d24c/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/6deb7716-c3cc-4944-99bf-dd904746d24c/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6deb7716-c3cc-4944-99bf-dd904746d24c/volumes/kubernetes.io~projected/kube-api-access-hsgh7:{mountpoint:/var/lib/kubelet/pods/6deb7716-c3cc-4944-99bf-dd904746d24c/volumes/kubernetes.io~projected/kube-api-access-hsgh7 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6deb7716-c3cc-4944-99bf-dd904746d24c/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/6deb7716-c3cc-4944-99bf-dd904746d24c/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7ccd662b-1239-4afb-bf3a-d9d285d4fbda/volumes/kubernetes.io~projected/kube-api-access-djxxq:{mountpoint:/var/lib/kubelet/pods/7ccd662b-1239-4afb-bf3a-d9d285d4fbda/volumes/kubernetes.io~projected/kube-api-access-djxxq major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/810663b6-a5ea-4fef-b237-7caedfbab7f6/volumes/kubernetes.io~projected/kube-api-access-dmq6l:{mountpoint:/var/lib/kubelet/pods/810663b6-a5ea-4fef-b237-7caedfbab7f6/volumes/kubernetes.io~projected/kube-api-access-dmq6l major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b5b0789-263a-476a-ba8e-5119eceec889/volumes/kubernetes.io~projected/kube-api-access-tt8cx:{mountpoint:/var/lib/kubelet/pods/8b5b0789-263a-476a-ba8e-5119eceec889/volumes/kubernetes.io~projected/kube-api-access-tt8cx major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8dd81a50-cf93-4c73-a2cf-793fee04c292/volumes/kubernetes.io~projected/kube-api-access-9cnbc:{mountpoint:/var/lib/kubelet/pods/8dd81a50-cf93-4c73-a2cf-793fee04c292/volumes/kubernetes.io~projected/kube-api-access-9cnbc major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e7e37c2-a915-457b-a553-b53f25aaba42/volumes/kubernetes.io~projected/kube-api-access-rsfg5:{mountpoint:/var/lib/kubelet/pods/8e7e37c2-a915-457b-a553-b53f25aaba42/volumes/kubernetes.io~projected/kube-api-access-rsfg5 major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e7e37c2-a915-457b-a553-b53f25aaba42/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/8e7e37c2-a915-457b-a553-b53f25aaba42/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9/volumes/kubernetes.io~projected/kube-api-access-f2h2s:{mountpoint:/var/lib/kubelet/pods/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9/volumes/kubernetes.io~projected/kube-api-access-f2h2s major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/907d151f-d95c-40e6-95af-4198aec88c33/volumes/kubernetes.io~projected/kube-api-access-wgw8h:{mountpoint:/var/lib/kubelet/pods/907d151f-d95c-40e6-95af-4198aec88c33/volumes/kubernetes.io~projected/kube-api-access-wgw8h major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9ba6f7a7-c835-4c2b-8e17-32015f629d52/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/9ba6f7a7-c835-4c2b-8e17-32015f629d52/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:272 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e/volumes/kubernetes.io~projected/kube-api-access-nvtkt:{mountpoint:/var/lib/kubelet/pods/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e/volumes/kubernetes.io~projected/kube-api-access-nvtkt major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a2a942cf-93c8-445a-b6b6-cbda93d99210/volumes/kubernetes.io~projected/kube-api-access-djhql:{mountpoint:/var/lib/kubelet/pods/a2a942cf-93c8-445a-b6b6-cbda93d99210/volumes/kubernetes.io~projected/kube-api-access-djhql major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~projected/kube-api-access-fgqtt:{mountpoint:/var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~projected/kube-api-access-fgqtt major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bdfef95a-7674-41dd-b03e-9055b658a2aa/volumes/kubernetes.io~projected/kube-api-access-s9pjr:{mountpoint:/var/lib/kubelet/pods/bdfef95a-7674-41dd-b03e-9055b658a2aa/volumes/kubernetes.io~projected/kube-api-access-s9pjr major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c7b2d156-2b78-4114-9980-8543ed070a9a/volumes/kubernetes.io~projected/kube-api-access-swqtn:{mountpoint:/var/lib/kubelet/pods/c7b2d156-2b78-4114-9980-8543ed070a9a/volumes/kubernetes.io~projected/kube-api-access-swqtn major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c7b2d156-2b78-4114-9980-8543ed070a9a/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/c7b2d156-2b78-4114-9980-8543ed070a9a/volumes/kubernetes.io~secret/cert major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ca807b05-9989-4b11-923c-d8f1423fde00/volumes/kubernetes.io~projected/kube-api-access-tjz95:{mountpoint:/var/lib/kubelet/pods/ca807b05-9989-4b11-923c-d8f1423fde00/volumes/kubernetes.io~projected/kube-api-access-tjz95 major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d413c3c9-fece-4d7c-a6ea-7691c035a5ad/volumes/kubernetes.io~projected/kube-api-access-xwc9w:{mountpoint:/var/lib/kubelet/pods/d413c3c9-fece-4d7c-a6ea-7691c035a5ad/volumes/kubernetes.io~projected/kube-api-access-xwc9w major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d44943ce-d083-4b43-a8ce-1c451bbd783b/volumes/kubernetes.io~projected/kube-api-access-547xj:{mountpoint:/var/lib/kubelet/pods/d44943ce-d083-4b43-a8ce-1c451bbd783b/volumes/kubernetes.io~projected/kube-api-access-547xj major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e02ac97f-6e15-4540-8b31-a7208f55217a/volumes/kubernetes.io~projected/kube-api-access-6qsq4:{mountpoint:/var/lib/kubelet/pods/e02ac97f-6e15-4540-8b31-a7208f55217a/volumes/kubernetes.io~projected/kube-api-access-6qsq4 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f20a6d3d-6645-4b3a-af29-0c208025ddda/volumes/kubernetes.io~projected/kube-api-access-6xb6m:{mountpoint:/var/lib/kubelet/pods/f20a6d3d-6645-4b3a-af29-0c208025ddda/volumes/kubernetes.io~projected/kube-api-access-6xb6m major:0 minor:209 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/dca0db68ac29312a66ffb56aa1fab2ab96aefa0659603e8ec8302edb2b3983cf/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/c9b8f7320e3ce0395f4776704382d5038c99a61f47c0ed471ec12cf688a8fe62/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/9b055b2453a3a2a067862fc38e99fe04a57951fcae18fbf2bd202ba0cab9656e/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-112:{mountpoint:/var/lib/containers/storage/overlay/720aa67d8de511210ae6162e46cddf723eee319706a3f23c21e27725851735ec/merged major:0 minor:112 fsType:overlay blockSize:0} overlay_0-113:{mountpoint:/var/lib/containers/storage/overlay/f86e10f34ec354f3706c1136c9ac4ee2648826646523fe3e5ef3d6461a039649/merged major:0 minor:113 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/255879f237968a9cb4193ebf6847ec0d649853ac83e0eb78ddde8e86bd33bf34/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/928b53aef7c52651c494d6297c10075c5edcd8bf51eda1bae5eacd505dc1fa81/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/509922a925a8b54b2ad923b0c46a0172100af27e3cc10050fa7723f8178c21e1/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/b42afd7e3ce3da9050954d4641e5fd51a7fdc32f4ed22ba310640e4393f194f4/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/52fae957e5d2400a80c84234a87acc11e46f32d178861065d9aa2723bb023241/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/46af270f9601a68dfbae3ddc2ff9cd94ce3f712bbcc4547bc2798f63ecb2037e/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/dc8893eb17c6a25a4b9a529fd6ae5295dae5ea68673cd60d8c3720910aa5ac6f/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/b33e6b00c83c99974950b41fffbc4969ad7947be3494c0c2fadf1516e3db0800/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/58ad5c11b9fed20fe3b5ad3607202982b46ce74b069002f92d1dc6cef48bb57b/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/d5c02ffcd97576d8d767495216f29388b7858a2964d0549b36d3cedf7ef71211/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/6d2095f5b6baa1f6a769b119fa8b9baef25fc90ad365bcb88a73f1d218dd6844/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/f7725c05c0217b47460d719102df7ddea7515eb9361a817b4db99a6e795470b7/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/460b67a9f2082efa12770b72e59aadbdeb23b75c5cb42d85ed2e0c87ce85d7e4/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/9936879a66a533e7d77a543a4f26be1eec198260890c6015489f1ba139e21e58/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/893cf25a7e78a9dcf6ff0e1ff93fff10015368ef1d6d67802fabdc88725ffa02/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/46f43b7f571c2dba600f1a54ac6a3d87bd8a3118977fce81edfb31f1f0e5435b/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/7f27b2b9d366842d1cb2a607e9f30bcf7bafe4952ce3cc0e6cef85958f9dbf98/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/d72aeb0817fa8d3c25ecc205f00dd60979eb2d8e268e62fd3b65576f7885afe4/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/be03652d0bd5be25fc77e378e25fbe4bef3a23a5f201c5d3d2ff3ae8e65ae7a1/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/d58d4f72f7b0b5d2df8b88a33b0a391cffd13231254934e9e1154c5b32ba667c/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/761d9478efd77cd1c2c9e6ce8826649dc3ba77936682b762cb4677c7d957a4bd/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/e50e7bec18e331582bc80ec2ae06598ed984ee891b8e46d1a95920b57a775227/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/f283a6e4b778d4a29445b3f0911d0e292d1480eb8ec0064c471238041ed5ae5d/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/01fad68ff2f4995413d2529712b84bff7e8226cec3ef60cf8bfc248677c03282/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/11f0f9507e385c084e5c446e4bd495364b82fb48d94d73ebae3f0d5029443ab1/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/ebe053e0fc36057b89ac1845ce0aaa564c12c26cc2aab727a6224a1f32fd24dd/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/e554a934bf36e91ee0821792b5638127ce629ec795061e10663e591d4cd3b362/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/ae57b82c24f976b45ef083c40673beb86f5b87ecb7db40641e2ff92ebda80508/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/ecc9b03afb4d18c558d6191ee5b9c9d4effb9fb4e8130732949c15ba7b6a480c/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-287:{mountpoint:/var/lib/containers/storage/overlay/726203afa0af16a4498e29b72f0a969120e3eb4408a504e3f91f5575da7d5731/merged major:0 minor:287 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/4d29a037f2beb70901a8cc95385a31f14d04416147be66715cfced2dadf5bc9d/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/9bfb17a0c5660c071e778349d8bf99127304f3daaeaf3fc8c672396db9c0240f/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/9eff084c30f4d0618abd9e2e076f19f7e01dd28fd66f5c2b7e8bc5b49c35f5b8/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/8f7f54c627065a13484bc545b08495e0faf8cd53b6626df019bd7fca91b86961/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/37b609cd97436401380af434a5578d2c4b8a39ccfee5910b250f076cb1ed0187/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/b98889e67db74fd8b075e78f8185e7ddf01793bedd0b3bcaa8bafdd93c067cd6/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/2af26dacb4f251b95b628fbb6f35b7020ccc55880d47e430da965131480bd892/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/8879f72a7799e71741415459a84a18bd99530f54d0c85efa7dedaa702039c0ac/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/c9ea5c774ff00f6d55a95880061b4839321cc9c18c013c0bb4df109ff3f73344/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/22210c54113bcd020855597f6ec5ebf87bc3ea42e7154564408fb6f1cb5a3fdd/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/3f65067798a2a7e61c51eca2c3d2613dd655ab2d017f488d8e2b15c7b9f52619/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/1b268a870c723921bd2b5b815b8df618dc9d2f9a79a770873d535678a1f7bfa7/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/932b58c7e017b008c24e7fdcc0fb0ac42416c9223fb0b16d66afcd1d4cfaa7e9/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/5a3e0d8e2f70cb4beb26575b296dbe6a3269847353992fb798f3f9c8365beaed/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/8c048ec4602464136d6803b19417be9b5d7819bf3401f10f8e164f3ac95d0bc5/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/b36a481b424333688c3858c2a228c9800bedca28d48d251d077e700d66900f24/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/dbcc190d0624bbd6c47549e58e69735089c1af72b3504452b74527ad89826c3e/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/6a3bbb957adf21c04992adb72e20f5358e3e1813756f849fc0ffdd7d96803703/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/6f490ae921d1dc15ab39f4e8bd57b279b9f78ba13a7f118b3708522ebeb2b50a/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/7a9cc918b2d75b30228744d3a4a398924bc46b29d2000ffa5a020f751621d3be/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/139452b08a4fcb7b7e206d87f2f6b94558767048403a189ccc5348da32fd48f4/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/9dda329636da882339a84e27146bac0b727c57ca15f48d74580d200519444df6/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/cffe13b9b8f9e31625ae41ac253a7e578e65d6a729e4526bb1d64ec73f90c716/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/e8e8274aad6380235b4028843c5c5451c521da5ef3afcbddb721662b20e9d858/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/c5b81808efeba530778b2b89b13d1a163aab02e69525943ccc8b9163904dba35/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/291e84feac86055d1636775136d45c7942a890f984bb833fea5b2cf5fd89d988/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/46463e42c73e04931ff4b4e5b52c5cc600655cbdc1717e7f3254c8f6db88c425/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.239195    5079 manager.go:217] Machine: {Timestamp:2026-11-04 05:28:25.238698991 +0000 UTC m=+0.096686812 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100122 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d414b5817758eb0dc343a9ed85890 SystemUUID:ec2d414b-5817-758e-b0dc-343a9ed85890 BootID:28d59e38-60ed-44dd-9fe5-59a8064c87cb Filesystems:[{Device:/var/lib/kubelet/pods/589feb32-bcd4-4ab3-810a-0210968dc7b6/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5ad90056adb69d8d50ab24ad3c92f3f24de8ac45c0500cbdee16a725cbcd43a3/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-113 DeviceMajor:0 DeviceMinor:113 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:204 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:215 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b64ba21b4d6ae7b296dc86849e43623ff40dc87f2fd4857cc9ef2a995d1b47ed/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/29ea7d2a945583be0f6dfbe90e0b19ddc87598195c636666daac6fb3f474b1cd/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a2a942cf-93c8-445a-b6b6-cbda93d99210/volumes/kubernetes.io~projected/kube-api-access-djhql DeviceMajor:0 DeviceMinor:223 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3826931ce5087c70a990efc5919fd571a11b46f82aa8339183cb6592ea89428a/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/6deb7716-c3cc-4944-99bf-dd904746d24c/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:61 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/d413c3c9-fece-4d7c-a6ea-7691c035a5ad/volumes/kubernetes.io~projected/kube-api-access-xwc9w DeviceMajor:0 DeviceMinor:62 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3024b38f-4b25-45ec-8a49-40a3859ca462/volumes/kubernetes.io~projected/kube-api-access-vh2lg DeviceMajor:0 DeviceMinor:207 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:218 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/76bd0de76a45f78d067a3050c892b2a760fd3594adda919b45a8cd7bc3c44849/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/d44943ce-d083-4b43-a8ce-1c451bbd783b/volumes/kubernetes.io~projected/kube-api-access-547xj DeviceMajor:0 DeviceMinor:313 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f20a6d3d-6645-4b3a-af29-0c208025ddda/volumes/kubernetes.io~projected/kube-api-access-6xb6m DeviceMajor:0 DeviceMinor:209 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-112 DeviceMajor:0 DeviceMinor:112 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/589feb32-bcd4-4ab3-810a-0210968dc7b6/volumes/kubernetes.io~projected/kube-api-access-8kvnm DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/08f68bfa-5fe7-4cc2-a833-9f0c72871994/volumes/kubernetes.io~projected/kube-api-access-wwr2j DeviceMajor:0 DeviceMinor:213 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c1cbc4a32b0cd8299ef1c2751fcaa3f1b8bc10fd92175ee1abb27c8a68f309a7/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~projected/kube-api-access-fgqtt DeviceMajor:0 DeviceMinor:227 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/452a124c08741dc45db45b8b6ca7592d354fa717cfb0853f7803ad8d15fedaae/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bcc18f84b6b2c26478e2af21a89ee871c7b865bb9930123c3fe62c3bcd1ef947/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/40442cd901af1940c16dea8df4ad0a8e19c43dcc07fdf2cfb50e2f8d8036cac6/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8dd81a50-cf93-4c73-a2cf-793fee04c292/volumes/kubernetes.io~projected/kube-api-access-9cnbc DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5794b522-36b9-4e80-b852-deff2905e1c7/volumes/kubernetes.io~projected/kube-api-access-xkkfg DeviceMajor:0 DeviceMinor:222 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a5cff6c593e3912eddb60779ac33e7aeaa08d4caa27a06b81d057e789d365c91/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/37349891-fa32-427e-9938-c741ba8a605d/volumes/kubernetes.io~projected/kube-api-access-2x9v9 DeviceMajor:0 DeviceMinor:341 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/589feb32-bcd4-4ab3-810a-0210968dc7b6/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/327add5c-5660-46e3-93b6-683b8bee126e/volumes/kubernetes.io~projected/kube-api-access-fst49 DeviceMajor:0 DeviceMinor:216 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/307a57c0b7e679bc4a5b545ab5268b7b7d6aeac6302afbaffe3df7ef5bdf78fd/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-287 DeviceMajor:0 DeviceMinor:287 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/05f18a3a8834c2baf9ff6a3c24a06c34955f3f0172ac0b833e1eb09234684637/userdata/shm DeviceMajor:0 DeviceMinor:334 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/07a91304967dcd4b1ca836eb7e9c00f9c6663c91a0f531a8a026526faa401eb8/userdata/shm DeviceMajor:0 DeviceMinor:348 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/26bba77d4e6bff4b6e7259abc73bcc68cbfed187a2d6892f88719f76247ac350/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/526ed430-5c81-45f1-885d-2211b36b7745/volumes/kubernetes.io~projected/kube-api-access-s78z2 DeviceMajor:0 DeviceMinor:64 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d3639527eac29c5593bdf5febf4603ebc7a296dd62e22b4f47c0e6e256e291d6/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3024b38f-4b25-45ec-8a49-40a3859ca462/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c7b2d156-2b78-4114-9980-8543ed070a9a/volumes/kubernetes.io~projected/kube-api-access-swqtn DeviceMajor:0 DeviceMinor:225 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9/volumes/kubernetes.io~projected/kube-api-access-f2h2s DeviceMajor:0 DeviceMinor:293 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6a00e0f307bc93fe9a39ff6fd0669fe41cb629c9570ac117fbfe6998299e93a8/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:208 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5bce46cb4ae575446a63ffde37b795952fe90f240ef86408b93603a1734718bd/userdata/shm DeviceMajor:0 DeviceMinor:342 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9ba6f7a7-c835-4c2b-8e17-32015f629d52/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:272 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/3024b38f-4b25-45ec-8a49-40a3859ca462/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7ccd662b-1239-4afb-bf3a-d9d285d4fbda/volumes/kubernetes.io~projected/kube-api-access-djxxq DeviceMajor:0 DeviceMinor:312 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/4952ed47-5e12-468b-9b7a-12566b6cffa5/volumes/kubernetes.io~projected/kube-api-access-fnzbx DeviceMajor:0 DeviceMinor:338 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ee14ead0ff77f12b2d5e183a04800b066977cb4ea36f2a9f64a8d038250da35b/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/076805bd92baf3feafb1f5fa5ccf49b568fd5fd946b28e6655616f540ef20e4e/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8e7e37c2-a915-457b-a553-b53f25aaba42/volumes/kubernetes.io~projected/kube-api-access-rsfg5 DeviceMajor:0 DeviceMinor:212 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/17efbc26e040d5667feb2d499ec602a82c750e45c8683ab733c12cff67a9ebde/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6deb7716-c3cc-4944-99bf-dd904746d24c/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5794b522-36b9-4e80-b852-deff2905e1c7/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:221 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/946d6e6572267dde46d428f8a74c1ddb51c75abead195e445cd6e0e5aecf3546/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0b9d81f7f61e4bedb94a59a960d03046280a8a7bb3d68bc67902feb655c6f399/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:219 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:226 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bdfef95a-7674-41dd-b03e-9055b658a2aa/volumes/kubernetes.io~projected/kube-api-access-s9pjr DeviceMajor:0 DeviceMinor:66 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/907d151f-d95c-40e6-95af-4198aec88c33/volumes/kubernetes.io~projected/kube-api-access-wgw8h DeviceMajor:0 DeviceMinor:214 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b1bfba7-f83b-46fc-b06b-2a736bad505f/volumes/kubernetes.io~projected/kube-api-access-frjx7 DeviceMajor:0 DeviceMinor:205 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e02ac97f-6e15-4540-8b31-a7208f55217a/volumes/kubernetes.io~projected/kube-api-access-6qsq4 DeviceMajor:0 DeviceMinor:65 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ddf47ff9291b26c1645308ac84726086484efce113af0756b27cc26ad9a38e3e/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/37349891-fa32-427e-9938-c741ba8a605d/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:340 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/05890613-c051-4133-b1c6-7b282670a076/volumes/kubernetes.io~projected/kube-api-access-bfzfb DeviceMajor:0 DeviceMinor:63 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c75189a2c0081033b372c565fb204c9dd763b97442c719ea56f9c2f24d2576c2/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c7b2d156-2b78-4114-9980-8543ed070a9a/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:220 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fc78bf833cd11dac9ae32f384bffff4241e46ccb1dee83b70b9a4929c343f749/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7a2ea03847afc5dddd121b565044dd8a0a62f5003a6ed2a26b92f64f04b19171/userdata/shm DeviceMajor:0 DeviceMinor:336 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e/volumes/kubernetes.io~projected/kube-api-access-nvtkt DeviceMajor:0 DeviceMinor:60 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8e7e37c2-a915-457b-a553-b53f25aaba42/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/327add5c-5660-46e3-93b6-683b8bee126e/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/810663b6-a5ea-4fef-b237-7caedfbab7f6/volumes/kubernetes.io~projected/kube-api-access-dmq6l DeviceMajor:0 DeviceMinor:210 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes/kubernetes.io~projected/kube-api-access-fb7nn DeviceMajor:0 DeviceMinor:211 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/40a2fd4e-7382-4886-8853-15b7387a53b3/volumes/kubernetes.io~projected/kube-api-access-dmcsd DeviceMajor:0 DeviceMinor:217 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/ca807b05-9989-4b11-923c-d8f1423fde00/volumes/kubernetes.io~projected/kube-api-access-tjz95 DeviceMajor:0 DeviceMinor:224 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/39761fca-7780-4800-a367-f827667dc6d7/volumes/kubernetes.io~projected/kube-api-access-hp5vz DeviceMajor:0 DeviceMinor:206 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/39761fca-7780-4800-a367-f827667dc6d7/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8b5b0789-263a-476a-ba8e-5119eceec889/volumes/kubernetes.io~projected/kube-api-access-tt8cx DeviceMajor:0 DeviceMinor:339 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/6deb7716-c3cc-4944-99bf-dd904746d24c/volumes/kubernetes.io~projected/kube-api-access-hsgh7 DeviceMajor:0 DeviceMinor:67 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:05f18a3a8834c2b MacAddress:4a:e8:26:c1:79:bc Speed:10000 Mtu:8901} {Name:07a91304967dcd4 MacAddress:de:50:8d:39:a5:08 Speed:10000 Mtu:8901} {Name:307a57c0b7e679b MacAddress:1a:46:5c:61:4f:e1 Speed:10000 Mtu:8901} {Name:3826931ce5087c7 MacAddress:66:68:0d:f1:e6:c5 Speed:10000 Mtu:8901} {Name:40442cd901af194 MacAddress:f6:96:d9:b5:59:08 Speed:10000 Mtu:8901} {Name:452a124c08741dc MacAddress:a2:d2:e6:79:60:ed Speed:10000 Mtu:8901} {Name:5bce46cb4ae5754 MacAddress:06:ad:45:bc:e2:2d Speed:10000 Mtu:8901} {Name:76bd0de76a45f78 MacAddress:ce:e1:8d:1a:1c:82 Speed:10000 Mtu:8901} {Name:7a2ea03847afc5d MacAddress:be:f8:b4:fa:ec:af Speed:10000 Mtu:8901} {Name:946d6e6572267dd MacAddress:ca:45:a2:c8:75:63 Speed:10000 Mtu:8901} {Name:a5cff6c593e3912 MacAddress:c6:9f:1b:fa:97:87 Speed:10000 Mtu:8901} {Name:b64ba21b4d6ae7b MacAddress:4a:65:90:77:52:6a Speed:10000 Mtu:8901} {Name:bcc18f84b6b2c26 MacAddress:f2:6e:f5:81:4f:ad Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:fe:53:47:f9 Speed:0 Mtu:9001} {Name:br-int MacAddress:4a:01:03:fd:3f:f4 Speed:0 Mtu:8901} {Name:c1cbc4a32b0cd82 MacAddress:8e:1a:43:8a:9d:1d Speed:10000 Mtu:8901} {Name:ddf47ff9291b26c MacAddress:92:1b:71:64:d1:08 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:fe:53:47:f9 Speed:0 Mtu:9001} {Name:fc78bf833cd11da MacAddress:fa:dc:31:1c:2f:e4 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:c6:21:3e:89:a3:17 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:c2:c5:21:5f:d0:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.239607    5079 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.239656    5079 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.239906    5079 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.239925    5079 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-135.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240053    5079 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240061    5079 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240071    5079 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240091    5079 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240109    5079 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240263    5079 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240378    5079 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240412    5079 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 05:28:25.240414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240423    5079 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 05:28:25.241050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240434    5079 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 05:28:25.241050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240443    5079 kubelet.go:405] "Adding apiserver pod source"
Nov 04 05:28:25.241050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.240453    5079 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 05:28:25.241170 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.241144    5079 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 05:28:25.241170 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.241153    5079 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:28:25.241709 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.241689    5079 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 05:28:25.244364 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244344    5079 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 05:28:25.244364 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244360    5079 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 05:28:25.244529 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244482    5079 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 04 05:28:25.244743 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244727    5079 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 05:28:25.244818 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244767    5079 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 05:28:25.244899 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244888    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 05:28:25.244952 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244908    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 05:28:25.244952 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244919    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 05:28:25.244952 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244929    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 05:28:25.244952 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244937    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 05:28:25.244952 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244947    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 05:28:25.245171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244956    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 05:28:25.245171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244966    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 05:28:25.245171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244977    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 05:28:25.245171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.244989    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 05:28:25.245171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.245009    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 05:28:25.245171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.245025    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 05:28:25.245171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.245065    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 05:28:25.245171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.245075    5079 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 05:28:25.248800 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.248784    5079 server.go:1263] "Started kubelet"
Nov 04 05:28:25.249381 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.248880    5079 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 05:28:25.249381 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.248980    5079 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 05:28:25.249381 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.249333    5079 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 05:28:25.249466 ip-10-0-141-135 systemd[1]: Started Kubernetes Kubelet.
Nov 04 05:28:25.253775 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.249793    5079 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 05:28:25.253775 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.252832    5079 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 05:28:25.255735 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.255648    5079 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:28:25.256013 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.255997    5079 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 05:28:25.256088 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.256023    5079 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 05:28:25.258579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.256168    5079 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 05:28:25.258579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.256185    5079 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 05:28:25.258579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.256308    5079 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 05:28:25.258579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.256166    5079 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 05:22:45 +0000 UTC" deadline="2028-04-27 18:51:40.046686758 +0000 UTC"
Nov 04 05:28:25.258579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.256366    5079 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12973h23m14.790335131s"
Nov 04 05:28:25.258579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.257955    5079 factory.go:55] Registering systemd factory
Nov 04 05:28:25.258579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.257969    5079 factory.go:223] Registration of the systemd container factory successfully
Nov 04 05:28:25.258579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.258458    5079 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:28:25.258957 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.258806    5079 factory.go:153] Registering CRI-O factory
Nov 04 05:28:25.258957 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.258822    5079 factory.go:223] Registration of the crio container factory successfully
Nov 04 05:28:25.258957 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.258880    5079 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 05:28:25.258957 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.258900    5079 factory.go:103] Registering Raw factory
Nov 04 05:28:25.258957 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.258914    5079 manager.go:1199] Started watching for new ooms in manager
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259254    5079 manager.go:319] Starting recovery of all containers
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259361    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e7e37c2-a915-457b-a553-b53f25aaba42" volumeName="kubernetes.io/secret/8e7e37c2-a915-457b-a553-b53f25aaba42-serving-cert" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259423    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="907d151f-d95c-40e6-95af-4198aec88c33" volumeName="kubernetes.io/projected/907d151f-d95c-40e6-95af-4198aec88c33-kube-api-access-wgw8h" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259438    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0b21212-89e5-40ce-8bbd-75f93265da0e" volumeName="kubernetes.io/empty-dir/b0b21212-89e5-40ce-8bbd-75f93265da0e-ca-trust-extracted" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259452    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05890613-c051-4133-b1c6-7b282670a076" volumeName="kubernetes.io/projected/05890613-c051-4133-b1c6-7b282670a076-kube-api-access-bfzfb" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259467    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" volumeName="kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-trusted-ca" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259479    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39761fca-7780-4800-a367-f827667dc6d7" volumeName="kubernetes.io/configmap/39761fca-7780-4800-a367-f827667dc6d7-config" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259491    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="526ed430-5c81-45f1-885d-2211b36b7745" volumeName="kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259518    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b5b0789-263a-476a-ba8e-5119eceec889" volumeName="kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259535    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b5b0789-263a-476a-ba8e-5119eceec889" volumeName="kubernetes.io/empty-dir/8b5b0789-263a-476a-ba8e-5119eceec889-archives-path" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259547    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e7e37c2-a915-457b-a553-b53f25aaba42" volumeName="kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-trusted-ca" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259562    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f20a6d3d-6645-4b3a-af29-0c208025ddda" volumeName="kubernetes.io/projected/f20a6d3d-6645-4b3a-af29-0c208025ddda-kube-api-access-6xb6m" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259575    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="327add5c-5660-46e3-93b6-683b8bee126e" volumeName="kubernetes.io/projected/327add5c-5660-46e3-93b6-683b8bee126e-kube-api-access-fst49" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259588    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5794b522-36b9-4e80-b852-deff2905e1c7" volumeName="kubernetes.io/secret/5794b522-36b9-4e80-b852-deff2905e1c7-serving-cert" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259621    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6deb7716-c3cc-4944-99bf-dd904746d24c" volumeName="kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-env-overrides" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259635    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" volumeName="kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-kube-api-access-fb7nn" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259649    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5794b522-36b9-4e80-b852-deff2905e1c7" volumeName="kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-service-ca-bundle" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259669    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c7b2d156-2b78-4114-9980-8543ed070a9a" volumeName="kubernetes.io/projected/c7b2d156-2b78-4114-9980-8543ed070a9a-kube-api-access-swqtn" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259683    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" volumeName="kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-certificates" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259696    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3024b38f-4b25-45ec-8a49-40a3859ca462" volumeName="kubernetes.io/projected/3024b38f-4b25-45ec-8a49-40a3859ca462-kube-api-access-vh2lg" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259709    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40a2fd4e-7382-4886-8853-15b7387a53b3" volumeName="kubernetes.io/projected/40a2fd4e-7382-4886-8853-15b7387a53b3-kube-api-access-dmcsd" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259721    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="526ed430-5c81-45f1-885d-2211b36b7745" volumeName="kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259737    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="526ed430-5c81-45f1-885d-2211b36b7745" volumeName="kubernetes.io/projected/526ed430-5c81-45f1-885d-2211b36b7745-kube-api-access-s78z2" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259750    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5794b522-36b9-4e80-b852-deff2905e1c7" volumeName="kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-tmp" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259761    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5794b522-36b9-4e80-b852-deff2905e1c7" volumeName="kubernetes.io/projected/5794b522-36b9-4e80-b852-deff2905e1c7-kube-api-access-xkkfg" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259776    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="589feb32-bcd4-4ab3-810a-0210968dc7b6" volumeName="kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-tmp" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259787    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="327add5c-5660-46e3-93b6-683b8bee126e" volumeName="kubernetes.io/configmap/327add5c-5660-46e3-93b6-683b8bee126e-config" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259802    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6deb7716-c3cc-4944-99bf-dd904746d24c" volumeName="kubernetes.io/projected/6deb7716-c3cc-4944-99bf-dd904746d24c-kube-api-access-hsgh7" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259814    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6deb7716-c3cc-4944-99bf-dd904746d24c" volumeName="kubernetes.io/secret/6deb7716-c3cc-4944-99bf-dd904746d24c-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259832    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="810663b6-a5ea-4fef-b237-7caedfbab7f6" volumeName="kubernetes.io/configmap/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-config" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259846    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b5b0789-263a-476a-ba8e-5119eceec889" volumeName="kubernetes.io/projected/8b5b0789-263a-476a-ba8e-5119eceec889-kube-api-access-tt8cx" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259861    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e45fa7b-edf2-4c01-ac71-76ca9c425f7e" volumeName="kubernetes.io/configmap/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-iptables-alerter-script" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259876    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0b21212-89e5-40ce-8bbd-75f93265da0e" volumeName="kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-image-registry-private-configuration" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259890    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bdfef95a-7674-41dd-b03e-9055b658a2aa" volumeName="kubernetes.io/projected/bdfef95a-7674-41dd-b03e-9055b658a2aa-kube-api-access-s9pjr" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259906    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" volumeName="kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-installation-pull-secrets" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259921    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" volumeName="kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-image-registry-private-configuration" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259935    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ba6f7a7-c835-4c2b-8e17-32015f629d52" volumeName="kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259949    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d44943ce-d083-4b43-a8ce-1c451bbd783b" volumeName="kubernetes.io/projected/d44943ce-d083-4b43-a8ce-1c451bbd783b-kube-api-access-547xj" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259963    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e02ac97f-6e15-4540-8b31-a7208f55217a" volumeName="kubernetes.io/projected/e02ac97f-6e15-4540-8b31-a7208f55217a-kube-api-access-6qsq4" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259977    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" volumeName="kubernetes.io/empty-dir/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-ca-trust-extracted" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.259992    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" volumeName="kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-bound-sa-token" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260007    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb" volumeName="kubernetes.io/secret/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-agent-certs" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260021    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0b21212-89e5-40ce-8bbd-75f93265da0e" volumeName="kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-certificates" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260035    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05890613-c051-4133-b1c6-7b282670a076" volumeName="kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-cni-binary-copy" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260048    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39761fca-7780-4800-a367-f827667dc6d7" volumeName="kubernetes.io/secret/39761fca-7780-4800-a367-f827667dc6d7-serving-cert" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260061    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4952ed47-5e12-468b-9b7a-12566b6cffa5" volumeName="kubernetes.io/empty-dir/4952ed47-5e12-468b-9b7a-12566b6cffa5-data-volume" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260075    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7ccd662b-1239-4afb-bf3a-d9d285d4fbda" volumeName="kubernetes.io/projected/7ccd662b-1239-4afb-bf3a-d9d285d4fbda-kube-api-access-djxxq" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260089    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b5b0789-263a-476a-ba8e-5119eceec889" volumeName="kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-service-ca-bundle" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260103    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f67d95f-5402-4ef6-96ac-8df95ee8bfa9" volumeName="kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260119    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca807b05-9989-4b11-923c-d8f1423fde00" volumeName="kubernetes.io/projected/ca807b05-9989-4b11-923c-d8f1423fde00-kube-api-access-tjz95" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260133    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="08f68bfa-5fe7-4cc2-a833-9f0c72871994" volumeName="kubernetes.io/projected/08f68bfa-5fe7-4cc2-a833-9f0c72871994-kube-api-access-wwr2j" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260148    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="810663b6-a5ea-4fef-b237-7caedfbab7f6" volumeName="kubernetes.io/projected/810663b6-a5ea-4fef-b237-7caedfbab7f6-kube-api-access-dmq6l" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260161    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="907d151f-d95c-40e6-95af-4198aec88c33" volumeName="kubernetes.io/configmap/907d151f-d95c-40e6-95af-4198aec88c33-telemetry-config" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260176    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2a942cf-93c8-445a-b6b6-cbda93d99210" volumeName="kubernetes.io/projected/a2a942cf-93c8-445a-b6b6-cbda93d99210-kube-api-access-djhql" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260190    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0b21212-89e5-40ce-8bbd-75f93265da0e" volumeName="kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-trusted-ca" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260202    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="05890613-c051-4133-b1c6-7b282670a076" volumeName="kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-multus-daemon-config" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260215    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="526ed430-5c81-45f1-885d-2211b36b7745" volumeName="kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-binary-copy" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260239    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="589feb32-bcd4-4ab3-810a-0210968dc7b6" volumeName="kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-tuned" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260258    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e7e37c2-a915-457b-a553-b53f25aaba42" volumeName="kubernetes.io/projected/8e7e37c2-a915-457b-a553-b53f25aaba42-kube-api-access-rsfg5" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260272    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0b21212-89e5-40ce-8bbd-75f93265da0e" volumeName="kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-installation-pull-secrets" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260284    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e02ac97f-6e15-4540-8b31-a7208f55217a" volumeName="kubernetes.io/empty-dir/e02ac97f-6e15-4540-8b31-a7208f55217a-tmp-dir" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260295    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3024b38f-4b25-45ec-8a49-40a3859ca462" volumeName="kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-default-certificate" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260308    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6deb7716-c3cc-4944-99bf-dd904746d24c" volumeName="kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-config" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260320    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2a942cf-93c8-445a-b6b6-cbda93d99210" volumeName="kubernetes.io/configmap/a2a942cf-93c8-445a-b6b6-cbda93d99210-config-volume" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260333    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="327add5c-5660-46e3-93b6-683b8bee126e" volumeName="kubernetes.io/secret/327add5c-5660-46e3-93b6-683b8bee126e-serving-cert" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260346    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="39761fca-7780-4800-a367-f827667dc6d7" volumeName="kubernetes.io/projected/39761fca-7780-4800-a367-f827667dc6d7-kube-api-access-hp5vz" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260358    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5794b522-36b9-4e80-b852-deff2905e1c7" volumeName="kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260369    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b1bfba7-f83b-46fc-b06b-2a736bad505f" volumeName="kubernetes.io/projected/6b1bfba7-f83b-46fc-b06b-2a736bad505f-kube-api-access-frjx7" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260382    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6deb7716-c3cc-4944-99bf-dd904746d24c" volumeName="kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-script-lib" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260396    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8dd81a50-cf93-4c73-a2cf-793fee04c292" volumeName="kubernetes.io/projected/8dd81a50-cf93-4c73-a2cf-793fee04c292-kube-api-access-9cnbc" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260408    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb" volumeName="kubernetes.io/configmap/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-konnectivity-ca" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260420    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0b21212-89e5-40ce-8bbd-75f93265da0e" volumeName="kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-kube-api-access-fgqtt" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260431    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3024b38f-4b25-45ec-8a49-40a3859ca462" volumeName="kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-stats-auth" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260442    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="41a1a23a-cfae-43f1-b639-b30b4448ea40" volumeName="kubernetes.io/configmap/41a1a23a-cfae-43f1-b639-b30b4448ea40-nginx-conf" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260454    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="37349891-fa32-427e-9938-c741ba8a605d" volumeName="kubernetes.io/configmap/37349891-fa32-427e-9938-c741ba8a605d-signing-cabundle" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260465    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="37349891-fa32-427e-9938-c741ba8a605d" volumeName="kubernetes.io/secret/37349891-fa32-427e-9938-c741ba8a605d-signing-key" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260476    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="589feb32-bcd4-4ab3-810a-0210968dc7b6" volumeName="kubernetes.io/projected/589feb32-bcd4-4ab3-810a-0210968dc7b6-kube-api-access-8kvnm" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260488    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e7e37c2-a915-457b-a553-b53f25aaba42" volumeName="kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-config" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260517    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e45fa7b-edf2-4c01-ac71-76ca9c425f7e" volumeName="kubernetes.io/projected/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-kube-api-access-nvtkt" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260530    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2a942cf-93c8-445a-b6b6-cbda93d99210" volumeName="kubernetes.io/empty-dir/a2a942cf-93c8-445a-b6b6-cbda93d99210-tmp-dir" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260542    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0b21212-89e5-40ce-8bbd-75f93265da0e" volumeName="kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-bound-sa-token" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260553    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c7b2d156-2b78-4114-9980-8543ed070a9a" volumeName="kubernetes.io/secret/c7b2d156-2b78-4114-9980-8543ed070a9a-cert" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260566    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d413c3c9-fece-4d7c-a6ea-7691c035a5ad" volumeName="kubernetes.io/projected/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-kube-api-access-xwc9w" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260579    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="37349891-fa32-427e-9938-c741ba8a605d" volumeName="kubernetes.io/projected/37349891-fa32-427e-9938-c741ba8a605d-kube-api-access-2x9v9" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260591    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4952ed47-5e12-468b-9b7a-12566b6cffa5" volumeName="kubernetes.io/projected/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-api-access-fnzbx" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260602    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5794b522-36b9-4e80-b852-deff2905e1c7" volumeName="kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-snapshots" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260617    5079 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8dd81a50-cf93-4c73-a2cf-793fee04c292" volumeName="kubernetes.io/configmap/8dd81a50-cf93-4c73-a2cf-793fee04c292-serviceca" seLinuxMountContext=""
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260629    5079 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.260637    5079 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 05:28:25.263060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.261691    5079 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:28:25.268366 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.263260    5079 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 04 05:28:25.277576 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.277550    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:28:25.277709 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.277550    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:28:25.284190 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.284166    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:28:25.284902 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.284866    5079 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 05:28:25.285026 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.284993    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:28:25.291489 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.288006    5079 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 05:28:25.291489 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.288053    5079 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 05:28:25.291489 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.288076    5079 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 05:28:25.291489 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:25.288138    5079 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 04 05:28:25.293396 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.292537    5079 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 05:28:25.308955 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.308929    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:28:25.309093 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.308968    5079 generic.go:356] "Generic (PLEG): container finished" podID="8e7e37c2-a915-457b-a553-b53f25aaba42" containerID="d952219913e9b4b176279c24ad9a9df273175f648a4305b0b1fed0f30cf828b6" exitCode=255
Nov 04 05:28:25.315771 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.315743    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:28:25.316145 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.316122    5079 generic.go:356] "Generic (PLEG): container finished" podID="6deb7716-c3cc-4944-99bf-dd904746d24c" containerID="d3c02ea075cd7a8e5e3dfbd9e3fa55493d9193cf1e12db71b6013695441617b0" exitCode=1
Nov 04 05:28:25.342267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.342231    5079 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="6ac01b63932cce8f7fe4a79c5936ac6a385036a26620a09da2ed59fe4e118c81" exitCode=0
Nov 04 05:28:25.342267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.342258    5079 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="412d7e8bcbd7fc3851485fb2e6e7fc03f029607a38921d6df7c0ea0b56bc2a0a" exitCode=0
Nov 04 05:28:25.342267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.342264    5079 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="43244479121fdd3ff34d435547a84a50718234da039f36a79fa4baf6f49f6c40" exitCode=0
Nov 04 05:28:25.342267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.342270    5079 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="35046300d13ea2dbffc3bd6648b402d065492f99f895f48ad79134f2537656c9" exitCode=0
Nov 04 05:28:25.342267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.342275    5079 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="b92e285cb54d937808ed63a569ea059c876c1d95d2571324f155d5fcf3d74067" exitCode=0
Nov 04 05:28:25.342267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.342281    5079 generic.go:356] "Generic (PLEG): container finished" podID="526ed430-5c81-45f1-885d-2211b36b7745" containerID="cb282f6c7a1b1b2217daaa2f19853cf2e8020760c05c11638a272e31d08e674e" exitCode=0
Nov 04 05:28:25.351591 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.351556    5079 generic.go:356] "Generic (PLEG): container finished" podID="48f0772ea75929fd9b2f469477c18173" containerID="9bea241eeb8bc3e67a7c5006c3946f46c91999cd72fe98bfdade99cb81fc2eb9" exitCode=0
Nov 04 05:28:25.365537 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.365492    5079 manager.go:324] Recovery completed
Nov 04 05:28:25.388307 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:25.388264    5079 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 04 05:28:25.389646 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.389630    5079 cpu_manager.go:226] "Starting" policy="none"
Nov 04 05:28:25.389646 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.389643    5079 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 05:28:25.389743 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.389664    5079 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 05:28:25.389818 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.389804    5079 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 04 05:28:25.390275 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.389818    5079 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 04 05:28:25.390305 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.390278    5079 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 04 05:28:25.390305 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.390285    5079 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 04 05:28:25.390305 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.390291    5079 policy_none.go:50] "Start"
Nov 04 05:28:25.390305 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.390300    5079 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 05:28:25.390409 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.390313    5079 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 05:28:25.390457 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.390448    5079 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 04 05:28:25.390486 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.390458    5079 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 04 05:28:25.390486 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.390463    5079 policy_none.go:44] "Start"
Nov 04 05:28:25.395036 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.395005    5079 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 05:28:25.397701 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.397689    5079 manager.go:341] "Starting Device Plugin manager"
Nov 04 05:28:25.397748 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:25.397712    5079 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 05:28:25.397748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.397721    5079 server.go:87] "Starting device plugin registration server"
Nov 04 05:28:25.398002 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.397989    5079 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 05:28:25.398092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.398002    5079 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 05:28:25.398092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.398080    5079 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 05:28:25.398227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.398193    5079 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 05:28:25.398281 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.398239    5079 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 05:28:25.398281 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.398245    5079 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 05:28:25.398413 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.398279    5079 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T05:28:25.398223305Z","UUID":"5d1a9fba-c966-476a-9a79-0f960486d0bf","Handler":null,"Name":"","Endpoint":""}
Nov 04 05:28:25.399786 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.399764    5079 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 05:28:25.399889 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.399793    5079 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 05:28:25.399935 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:25.399920    5079 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 05:28:25.499197 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.499109    5079 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 05:28:25.500484 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.500463    5079 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 05:28:25.500609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.500523    5079 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 05:28:25.500609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.500540    5079 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-135.us-east-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 05:28:25.500609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.500587    5079 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.514058 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.514033    5079 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.514179 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.514107    5079 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.588869 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.588815    5079 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"]
Nov 04 05:28:25.589491 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.589458    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal" event={"ID":"ebe8f4db5b3dfd0d97b0792740b3bd94","Type":"ContainerStarted","Data":"853857e488a116939e24cc6de1a56da4523b7307f1ee83fbd424400fc7e4263b"}
Nov 04 05:28:25.589565 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.589522    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal" event={"ID":"ebe8f4db5b3dfd0d97b0792740b3bd94","Type":"ContainerStarted","Data":"17efbc26e040d5667feb2d499ec602a82c750e45c8683ab733c12cff67a9ebde"}
Nov 04 05:28:25.589595 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.589569    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal" event={"ID":"48f0772ea75929fd9b2f469477c18173","Type":"ContainerStarted","Data":"6933e177cc569eef69f06405cfb047db3270bc960a4da033277fbca4a3e53909"}
Nov 04 05:28:25.589595 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.589582    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal" event={"ID":"48f0772ea75929fd9b2f469477c18173","Type":"ContainerDied","Data":"9bea241eeb8bc3e67a7c5006c3946f46c91999cd72fe98bfdade99cb81fc2eb9"}
Nov 04 05:28:25.589659 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.589602    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal" event={"ID":"48f0772ea75929fd9b2f469477c18173","Type":"ContainerStarted","Data":"ee14ead0ff77f12b2d5e183a04800b066977cb4ea36f2a9f64a8d038250da35b"}
Nov 04 05:28:25.589659 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.589644    5079 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.589727 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.589717    5079 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.602741 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.602714    5079 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:28:25.602864 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:25.602765    5079 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.603184 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.603169    5079 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:28:25.603220 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:25.603207    5079 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.665561 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.665527    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.665561 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.665562    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.665741 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.665584    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebe8f4db5b3dfd0d97b0792740b3bd94-config\") pod \"kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"ebe8f4db5b3dfd0d97b0792740b3bd94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.766068 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.765977    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.766068 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.766024    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.766068 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.766048    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebe8f4db5b3dfd0d97b0792740b3bd94-config\") pod \"kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"ebe8f4db5b3dfd0d97b0792740b3bd94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.766280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.766092    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebe8f4db5b3dfd0d97b0792740b3bd94-config\") pod \"kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"ebe8f4db5b3dfd0d97b0792740b3bd94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.766280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.766100    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:25.766280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:25.766100    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48f0772ea75929fd9b2f469477c18173-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" (UID: \"48f0772ea75929fd9b2f469477c18173\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:26.240910 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.240869    5079 apiserver.go:52] "Watching apiserver"
Nov 04 05:28:26.258319 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.258289    5079 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 05:28:26.259008 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.258982    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-jvwgz","openshift-multus/multus-additional-cni-plugins-tw2sv","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6","openshift-network-diagnostics/network-check-target-j5vrf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d","openshift-multus/network-metrics-daemon-lbx9s","openshift-image-registry/image-registry-588d496878-vbp7s","openshift-ingress-canary/ingress-canary-qfz8d","openshift-service-ca/service-ca-5fffc97bdf-6jklt","kube-system/kas-connection-checker-685895c7c9-sh897","openshift-ingress/router-default-6d8999f8d7-rwnj7","kube-system/global-pull-secret-syncer-tgz7l","openshift-image-registry/image-registry-77865897f5-8m6ds","openshift-network-console/networking-console-plugin-86c478bb88-8dsn9","openshift-insights/insights-operator-7c4986d449-5skd7","openshift-dns/node-resolver-zgr4j","openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h","openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq","openshift-ovn-kubernetes/ovnkube-node-vk7hk","openshift-insights/periodic-gathering-pcv9f-qnplw","openshift-network-operator/iptables-alerter-xffhq","openshift-dns/dns-default-dqblv","openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f","openshift-insights/insights-runtime-extractor-m8zlm","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8","kube-system/kas-connection-checker-685895c7c9-2z628","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7","kube-system/konnectivity-agent-bcklp","kube-system/kas-connection-checker-685895c7c9-bsk42","openshift-image-registry/node-ca-j2n64","openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc","openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59","kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal","openshift-cluster-node-tuning-operator/tuned-55msn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal","openshift-multus/multus-9hlsm"]
Nov 04 05:28:26.260197 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.260176    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.261039 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.261012    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:26.262484 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.262466    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.263058 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.263039    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:26.264994 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.264961    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Nov 04 05:28:26.265126 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.265106    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Nov 04 05:28:26.265237 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.265218    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Nov 04 05:28:26.265327 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.265299    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Nov 04 05:28:26.265440 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.265365    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.265488 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.265446    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Nov 04 05:28:26.265552 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.265527    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.265929 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.265908    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.266039 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.266023    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.266114 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.265916    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.266479 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.266460    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.266738 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.266718    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Nov 04 05:28:26.266893 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.266876    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Nov 04 05:28:26.266974 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.266959    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.267352 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.267327    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.267452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.267351    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:26.267619 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.267525    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.267851 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.267752    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.268150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.268131    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Nov 04 05:28:26.269275 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.269239    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Nov 04 05:28:26.269424 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.269405    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Nov 04 05:28:26.269662 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.269636    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.270761 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.270743    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.270917 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.270757    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Nov 04 05:28:26.271008 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.270784    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Nov 04 05:28:26.272003 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.271971    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.272003 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.271978    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.272111 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.272043    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Nov 04 05:28:26.272551 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.272535    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 04 05:28:26.272605 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.272568    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 04 05:28:26.272741 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.272729    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.272783 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.272769    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 04 05:28:26.273741 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.273721    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 05:28:26.273899 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.273834    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.273899 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.273893    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.273989 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.273897    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.275697 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.275678    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:26.276382 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.276365    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.276733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.276713    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Nov 04 05:28:26.277581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.277566    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:26.278260 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278240    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.278362 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278294    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 04 05:28:26.278421 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278401    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.278473 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278457    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Nov 04 05:28:26.278473 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278460    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 05:28:26.278594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278521    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.278594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278554    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Nov 04 05:28:26.278594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278560    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.278594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278586    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 05:28:26.278795 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278587    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.278795 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278591    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.278795 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.278696    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.279772 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.279753    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Nov 04 05:28:26.280142 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.280121    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-ggrvl\""
Nov 04 05:28:26.280327 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.280307    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fwwlp\""
Nov 04 05:28:26.280327 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.280312    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Nov 04 05:28:26.280534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.280350    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 05:28:26.281776 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.281758    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.281890 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.281775    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 05:28:26.281964 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.281792    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.281964 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.281803    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 05:28:26.282571 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.282551    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.282662 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.282646    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.283056 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283034    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-kkpcg\""
Nov 04 05:28:26.283142 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283107    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.283212 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283142    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 04 05:28:26.283212 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283168    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 05:28:26.283315 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283227    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-zs9xj\""
Nov 04 05:28:26.283315 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283237    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 05:28:26.283406 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283372    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 05:28:26.283653 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283634    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 05:28:26.283757 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283740    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7x6ks\""
Nov 04 05:28:26.283956 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283938    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-chnwp\""
Nov 04 05:28:26.284012 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283785    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rpj2j\""
Nov 04 05:28:26.284012 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.283769    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-67qcf\""
Nov 04 05:28:26.285620 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.285601    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 05:28:26.285730 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.285717    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.285807 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.285795    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qlwsz\""
Nov 04 05:28:26.285912 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.285898    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.286061 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.286042    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.286126 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.286091    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.286176 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.286151    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 05:28:26.286221 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.286172    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 05:28:26.286265 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.286234    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.286615 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.286597    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 05:28:26.286702 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.286690    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 05:28:26.286770 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.286747    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 05:28:26.287155 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287139    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.287219 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287163    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 05:28:26.287261 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287247    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-4fjpb\""
Nov 04 05:28:26.287296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287286    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-gqfxb\""
Nov 04 05:28:26.287345 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287332    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pqp2n\""
Nov 04 05:28:26.287385 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287372    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xhrfz\""
Nov 04 05:28:26.287479 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287465    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.287570 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287533    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m8rqh\""
Nov 04 05:28:26.287570 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287552    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xrb2c\""
Nov 04 05:28:26.287750 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287739    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qm9rq\""
Nov 04 05:28:26.287820 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287803    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 04 05:28:26.287871 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287856    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 05:28:26.287919 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287894    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 05:28:26.287919 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287900    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.288012 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287918    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 05:28:26.288012 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287939    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-st4b8\""
Nov 04 05:28:26.288012 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287970    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ghvrd\""
Nov 04 05:28:26.288012 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.287980    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.288211 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.288012    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 04 05:28:26.288211 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.288025    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 04 05:28:26.288211 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.288050    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 04 05:28:26.288211 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.288054    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h8l64\""
Nov 04 05:28:26.288211 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.288055    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 04 05:28:26.288211 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.288103    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-68zmm\""
Nov 04 05:28:26.311823 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.311784    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:26.355652 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.355623    5079 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:26.355820 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.355696    5079 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:26.358950 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.358928    5079 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 05:28:26.364588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.364567    5079 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:28:26.364719 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.364609    5079 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:26.365042 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.365019    5079 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 05:28:26.365091 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.365073    5079 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-135.us-east-2.compute.internal"
Nov 04 05:28:26.367918 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.367892    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-conf\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.368033 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.367933    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-ca-trust-extracted\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.368033 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.367957    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e02ac97f-6e15-4540-8b31-a7208f55217a-tmp-dir\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:28:26.368033 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368001    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.368177 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368060    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-netns\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.368177 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368069    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-ca-trust-extracted\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.368177 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368075    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e02ac97f-6e15-4540-8b31-a7208f55217a-tmp-dir\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:28:26.368177 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368132    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-snapshots\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.368177 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368168    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x9v9\" (UniqueName: \"kubernetes.io/projected/37349891-fa32-427e-9938-c741ba8a605d-kube-api-access-2x9v9\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:26.368407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368208    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-snapshots\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.368407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368212    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-trusted-ca\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:26.368407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368302    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-netns\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.368407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368323    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-bound-sa-token\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.368407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368366    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/327add5c-5660-46e3-93b6-683b8bee126e-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:26.368407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368386    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysconfig\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.368656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368479    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.368656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368549    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmq6l\" (UniqueName: \"kubernetes.io/projected/810663b6-a5ea-4fef-b237-7caedfbab7f6-kube-api-access-dmq6l\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:26.368656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368577    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/327add5c-5660-46e3-93b6-683b8bee126e-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:26.368656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368596    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-lib-modules\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.368790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368674    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-trusted-ca\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:26.368790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368697    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39761fca-7780-4800-a367-f827667dc6d7-serving-cert\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:26.368790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368727    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-systemd-units\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.368790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368763    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-cnibin\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.368913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368789    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-kubernetes\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.368913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368838    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djxxq\" (UniqueName: \"kubernetes.io/projected/7ccd662b-1239-4afb-bf3a-d9d285d4fbda-kube-api-access-djxxq\") pod \"migrator-66df5d496b-x2zmq\" (UID: \"7ccd662b-1239-4afb-bf3a-d9d285d4fbda\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq"
Nov 04 05:28:26.368913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368864    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.368913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368890    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:26.369131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368930    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-socket-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.369131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368966    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsfg5\" (UniqueName: \"kubernetes.io/projected/8e7e37c2-a915-457b-a553-b53f25aaba42-kube-api-access-rsfg5\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:26.369131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.368975    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39761fca-7780-4800-a367-f827667dc6d7-serving-cert\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:26.369131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369005    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-slash\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.369131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369038    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-config\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.369131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369114    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfzfb\" (UniqueName: \"kubernetes.io/projected/05890613-c051-4133-b1c6-7b282670a076-kube-api-access-bfzfb\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.369399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369183    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-system-cni-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.369399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369215    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba6f7a7-c835-4c2b-8e17-32015f629d52-original-pull-secret\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:26.369399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369289    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-config\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.369399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369309    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/327add5c-5660-46e3-93b6-683b8bee126e-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:26.369399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369355    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-systemd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.369399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369386    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-log-socket\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.369595 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369480    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/907d151f-d95c-40e6-95af-4198aec88c33-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:26.369595 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369544    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-systemd\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.369661 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369629    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.369700 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369677    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-installation-pull-secrets\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.369734 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369706    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.369734 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369711    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/327add5c-5660-46e3-93b6-683b8bee126e-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:26.369798 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369765    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/907d151f-d95c-40e6-95af-4198aec88c33-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:26.369879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369863    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:26.369925 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369911    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h2s\" (UniqueName: \"kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s\") pod \"network-check-target-j5vrf\" (UID: \"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9\") " pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:26.369958 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.369945    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-installation-pull-secrets\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.370039 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370023    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-host-slash\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:28:26.370082 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370070    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-hostroot\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.370117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370104    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-kubelet\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.370146 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370126    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8dd81a50-cf93-4c73-a2cf-793fee04c292-serviceca\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:28:26.370186 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370169    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.370234 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370219    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-host\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.370265 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370253    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-tmp\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.370326 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370305    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4952ed47-5e12-468b-9b7a-12566b6cffa5-data-volume\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.370452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370340    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-tmp\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.370452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370372    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.370452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370390    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4952ed47-5e12-468b-9b7a-12566b6cffa5-data-volume\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.370452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370411    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8dd81a50-cf93-4c73-a2cf-793fee04c292-serviceca\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:28:26.370452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370425    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-bin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.370452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370441    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:26.370750 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370477    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.370750 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370553    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.370750 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370626    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-image-registry-private-configuration\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.370750 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370663    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-system-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.370750 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370740    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-multus-daemon-config\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.370990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370770    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s78z2\" (UniqueName: \"kubernetes.io/projected/526ed430-5c81-45f1-885d-2211b36b7745-kube-api-access-s78z2\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.370990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370830    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xb6m\" (UniqueName: \"kubernetes.io/projected/f20a6d3d-6645-4b3a-af29-0c208025ddda-kube-api-access-6xb6m\") pod \"kas-connection-checker-685895c7c9-2z628\" (UID: \"f20a6d3d-6645-4b3a-af29-0c208025ddda\") " pod="kube-system/kas-connection-checker-685895c7c9-2z628"
Nov 04 05:28:26.370990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370873    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-image-registry-private-configuration\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.370990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370948    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-node-log\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.371146 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.370999    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-bin\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.371146 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371013    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-multus-daemon-config\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.371146 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371060    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-etc-kubernetes\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.371146 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371103    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frjx7\" (UniqueName: \"kubernetes.io/projected/6b1bfba7-f83b-46fc-b06b-2a736bad505f-kube-api-access-frjx7\") pod \"kas-connection-checker-685895c7c9-bsk42\" (UID: \"6b1bfba7-f83b-46fc-b06b-2a736bad505f\") " pod="kube-system/kas-connection-checker-685895c7c9-bsk42"
Nov 04 05:28:26.371318 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371142    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-env-overrides\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.371318 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371169    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsgh7\" (UniqueName: \"kubernetes.io/projected/6deb7716-c3cc-4944-99bf-dd904746d24c-kube-api-access-hsgh7\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.371318 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371192    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djhql\" (UniqueName: \"kubernetes.io/projected/a2a942cf-93c8-445a-b6b6-cbda93d99210-kube-api-access-djhql\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:26.371318 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371216    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt8cx\" (UniqueName: \"kubernetes.io/projected/8b5b0789-263a-476a-ba8e-5119eceec889-kube-api-access-tt8cx\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:26.371514 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371335    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-env-overrides\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.371514 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371349    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.371514 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371397    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-kubelet\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.371514 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371425    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.371514 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371472    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-agent-certs\") pod \"konnectivity-agent-bcklp\" (UID: \"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb\") " pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371494    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fst49\" (UniqueName: \"kubernetes.io/projected/327add5c-5660-46e3-93b6-683b8bee126e-kube-api-access-fst49\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371543    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-tuned\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371562    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjz95\" (UniqueName: \"kubernetes.io/projected/ca807b05-9989-4b11-923c-d8f1423fde00-kube-api-access-tjz95\") pod \"network-check-source-6f78d59f99-f8krc\" (UID: \"ca807b05-9989-4b11-923c-d8f1423fde00\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371590    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6deb7716-c3cc-4944-99bf-dd904746d24c-ovn-node-metrics-cert\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371614    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-cni-binary-copy\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371617    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-tuned\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371639    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371665    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqtn\" (UniqueName: \"kubernetes.io/projected/c7b2d156-2b78-4114-9980-8543ed070a9a-kube-api-access-swqtn\") pod \"ingress-canary-qfz8d\" (UID: \"c7b2d156-2b78-4114-9980-8543ed070a9a\") " pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371690    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-bound-sa-token\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371716    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-iptables-alerter-script\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371747    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgqtt\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-kube-api-access-fgqtt\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.371763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371751    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-agent-certs\") pod \"konnectivity-agent-bcklp\" (UID: \"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb\") " pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371771    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41a1a23a-cfae-43f1-b639-b30b4448ea40-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371804    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371884    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05890613-c051-4133-b1c6-7b282670a076-cni-binary-copy\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371933    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.371991    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6deb7716-c3cc-4944-99bf-dd904746d24c-ovn-node-metrics-cert\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372023    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-modprobe-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372058    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-service-ca-bundle\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372140    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372167    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-run\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372185    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-service-ca-bundle\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372192    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7b2d156-2b78-4114-9980-8543ed070a9a-cert\") pod \"ingress-canary-qfz8d\" (UID: \"c7b2d156-2b78-4114-9980-8543ed070a9a\") " pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372189    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-iptables-alerter-script\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372219    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-installation-pull-secrets\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.372296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372302    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvtkt\" (UniqueName: \"kubernetes.io/projected/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-kube-api-access-nvtkt\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372333    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41a1a23a-cfae-43f1-b639-b30b4448ea40-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372399    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7b2d156-2b78-4114-9980-8543ed070a9a-cert\") pod \"ingress-canary-qfz8d\" (UID: \"c7b2d156-2b78-4114-9980-8543ed070a9a\") " pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372400    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-registration-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372431    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-config\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372455    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-k8s-cni-cncf-io\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372431    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-installation-pull-secrets\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372484    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372534    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4952ed47-5e12-468b-9b7a-12566b6cffa5-crio-socket\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372568    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-device-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372602    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-socket-dir-parent\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372633    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgw8h\" (UniqueName: \"kubernetes.io/projected/907d151f-d95c-40e6-95af-4198aec88c33-kube-api-access-wgw8h\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372634    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e7e37c2-a915-457b-a553-b53f25aaba42-config\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372671    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372715    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-stats-auth\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.372840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372746    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-script-lib\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372850    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a942cf-93c8-445a-b6b6-cbda93d99210-tmp-dir\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372884    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-stats-auth\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372956    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-multus-certs\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.372988    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a942cf-93c8-445a-b6b6-cbda93d99210-tmp-dir\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373001    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b21212-89e5-40ce-8bbd-75f93265da0e-ca-trust-extracted\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373013    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6deb7716-c3cc-4944-99bf-dd904746d24c-ovnkube-script-lib\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373062    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b21212-89e5-40ce-8bbd-75f93265da0e-ca-trust-extracted\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373098    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8b5b0789-263a-476a-ba8e-5119eceec889-archives-path\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373122    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-multus\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373140    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnbc\" (UniqueName: \"kubernetes.io/projected/8dd81a50-cf93-4c73-a2cf-793fee04c292-kube-api-access-9cnbc\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373161    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmcsd\" (UniqueName: \"kubernetes.io/projected/40a2fd4e-7382-4886-8853-15b7387a53b3-kube-api-access-dmcsd\") pod \"kas-connection-checker-685895c7c9-sh897\" (UID: \"40a2fd4e-7382-4886-8853-15b7387a53b3\") " pod="kube-system/kas-connection-checker-685895c7c9-sh897"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373188    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kvnm\" (UniqueName: \"kubernetes.io/projected/589feb32-bcd4-4ab3-810a-0210968dc7b6-kube-api-access-8kvnm\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373214    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-default-certificate\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373282    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8b5b0789-263a-476a-ba8e-5119eceec889-archives-path\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373317    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-image-registry-private-configuration\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373351    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-certificates\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373380    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-conf-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.373407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373413    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37349891-fa32-427e-9938-c741ba8a605d-signing-key\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373438    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qsq4\" (UniqueName: \"kubernetes.io/projected/e02ac97f-6e15-4540-8b31-a7208f55217a-kube-api-access-6qsq4\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373475    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkkfg\" (UniqueName: \"kubernetes.io/projected/5794b522-36b9-4e80-b852-deff2905e1c7-kube-api-access-xkkfg\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373440    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-default-certificate\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373527    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh2lg\" (UniqueName: \"kubernetes.io/projected/3024b38f-4b25-45ec-8a49-40a3859ca462-kube-api-access-vh2lg\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373532    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-image-registry-private-configuration\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373555    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-547xj\" (UniqueName: \"kubernetes.io/projected/d44943ce-d083-4b43-a8ce-1c451bbd783b-kube-api-access-547xj\") pod \"migrator-66df5d496b-95h9f\" (UID: \"d44943ce-d083-4b43-a8ce-1c451bbd783b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373587    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-dbus\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373633    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2a942cf-93c8-445a-b6b6-cbda93d99210-config-volume\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373649    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-certificates\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373665    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373693    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-sys\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373718    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwc9w\" (UniqueName: \"kubernetes.io/projected/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-kube-api-access-xwc9w\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373772    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnzbx\" (UniqueName: \"kubernetes.io/projected/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-api-access-fnzbx\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373664    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/37349891-fa32-427e-9938-c741ba8a605d-signing-key\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373801    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp5vz\" (UniqueName: \"kubernetes.io/projected/39761fca-7780-4800-a367-f827667dc6d7-kube-api-access-hp5vz\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373838    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373841    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2a942cf-93c8-445a-b6b6-cbda93d99210-config-volume\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373850    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb7nn\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-kube-api-access-fb7nn\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373884    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-kubelet-config\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373912    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-ovn\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373949    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-binary-copy\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.373978    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-trusted-ca\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374005    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-service-ca-bundle\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374041    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-sys-fs\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374069    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-certificates\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374094    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374118    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37349891-fa32-427e-9938-c741ba8a605d-signing-cabundle\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374144    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374146    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-binary-copy\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374168    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39761fca-7780-4800-a367-f827667dc6d7-config\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374192    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-trusted-ca\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374203    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-certificates\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374203    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-service-ca-bundle\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.374227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374243    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e7e37c2-a915-457b-a553-b53f25aaba42-serving-cert\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374278    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwr2j\" (UniqueName: \"kubernetes.io/projected/08f68bfa-5fe7-4cc2-a833-9f0c72871994-kube-api-access-wwr2j\") pod \"volume-data-source-validator-58c9f5f46d-7gnk7\" (UID: \"08f68bfa-5fe7-4cc2-a833-9f0c72871994\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374306    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5794b522-36b9-4e80-b852-deff2905e1c7-serving-cert\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374336    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-var-lib-kubelet\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374337    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/37349891-fa32-427e-9938-c741ba8a605d-signing-cabundle\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374357    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-trusted-ca\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374366    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-var-lib-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374393    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39761fca-7780-4800-a367-f827667dc6d7-config\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374417    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-netd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374439    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-trusted-ca-bundle\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374463    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-cnibin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374483    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dd81a50-cf93-4c73-a2cf-793fee04c292-host\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374521    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-konnectivity-ca\") pod \"konnectivity-agent-bcklp\" (UID: \"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb\") " pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374548    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5794b522-36b9-4e80-b852-deff2905e1c7-serving-cert\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374440    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e7e37c2-a915-457b-a553-b53f25aaba42-serving-cert\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374632    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-tmp\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374661    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pjr\" (UniqueName: \"kubernetes.io/projected/bdfef95a-7674-41dd-b03e-9055b658a2aa-kube-api-access-s9pjr\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374686    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-etc-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374712    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e02ac97f-6e15-4540-8b31-a7208f55217a-hosts-file\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374744    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.374776    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.375010    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb-konnectivity-ca\") pod \"konnectivity-agent-bcklp\" (UID: \"8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb\") " pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.375031    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/526ed430-5c81-45f1-885d-2211b36b7745-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.375418    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-trusted-ca\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.375461    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5794b522-36b9-4e80-b852-deff2905e1c7-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.375668    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-trusted-ca-bundle\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:26.375819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.375785    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x9v9\" (UniqueName: \"kubernetes.io/projected/37349891-fa32-427e-9938-c741ba8a605d-kube-api-access-2x9v9\") pod \"service-ca-5fffc97bdf-6jklt\" (UID: \"37349891-fa32-427e-9938-c741ba8a605d\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6jklt"
Nov 04 05:28:26.376925 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.375849    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5794b522-36b9-4e80-b852-deff2905e1c7-tmp\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.376925 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.376188    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-bound-sa-token\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.376925 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.376470    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmq6l\" (UniqueName: \"kubernetes.io/projected/810663b6-a5ea-4fef-b237-7caedfbab7f6-kube-api-access-dmq6l\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:26.376925 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.376542    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2h2s\" (UniqueName: \"kubernetes.io/projected/8f67d95f-5402-4ef6-96ac-8df95ee8bfa9-kube-api-access-f2h2s\") pod \"network-check-target-j5vrf\" (UID: \"8f67d95f-5402-4ef6-96ac-8df95ee8bfa9\") " pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:26.376925 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.376921    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djxxq\" (UniqueName: \"kubernetes.io/projected/7ccd662b-1239-4afb-bf3a-d9d285d4fbda-kube-api-access-djxxq\") pod \"migrator-66df5d496b-x2zmq\" (UID: \"7ccd662b-1239-4afb-bf3a-d9d285d4fbda\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x2zmq"
Nov 04 05:28:26.377301 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.377272    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xb6m\" (UniqueName: \"kubernetes.io/projected/f20a6d3d-6645-4b3a-af29-0c208025ddda-kube-api-access-6xb6m\") pod \"kas-connection-checker-685895c7c9-2z628\" (UID: \"f20a6d3d-6645-4b3a-af29-0c208025ddda\") " pod="kube-system/kas-connection-checker-685895c7c9-2z628"
Nov 04 05:28:26.377485 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.377465    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfzfb\" (UniqueName: \"kubernetes.io/projected/05890613-c051-4133-b1c6-7b282670a076-kube-api-access-bfzfb\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.377586 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.377472    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s78z2\" (UniqueName: \"kubernetes.io/projected/526ed430-5c81-45f1-885d-2211b36b7745-kube-api-access-s78z2\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.377659 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.377596    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsfg5\" (UniqueName: \"kubernetes.io/projected/8e7e37c2-a915-457b-a553-b53f25aaba42-kube-api-access-rsfg5\") pod \"console-operator-7cd56b8dbc-jvwgz\" (UID: \"8e7e37c2-a915-457b-a553-b53f25aaba42\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:26.379586 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.379418    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt8cx\" (UniqueName: \"kubernetes.io/projected/8b5b0789-263a-476a-ba8e-5119eceec889-kube-api-access-tt8cx\") pod \"periodic-gathering-pcv9f-qnplw\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") " pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:28:26.379962 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.379886    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frjx7\" (UniqueName: \"kubernetes.io/projected/6b1bfba7-f83b-46fc-b06b-2a736bad505f-kube-api-access-frjx7\") pod \"kas-connection-checker-685895c7c9-bsk42\" (UID: \"6b1bfba7-f83b-46fc-b06b-2a736bad505f\") " pod="kube-system/kas-connection-checker-685895c7c9-bsk42"
Nov 04 05:28:26.380916 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.380832    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-bound-sa-token\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.381877 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.381473    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djhql\" (UniqueName: \"kubernetes.io/projected/a2a942cf-93c8-445a-b6b6-cbda93d99210-kube-api-access-djhql\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:26.381877 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.381595    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmcsd\" (UniqueName: \"kubernetes.io/projected/40a2fd4e-7382-4886-8853-15b7387a53b3-kube-api-access-dmcsd\") pod \"kas-connection-checker-685895c7c9-sh897\" (UID: \"40a2fd4e-7382-4886-8853-15b7387a53b3\") " pod="kube-system/kas-connection-checker-685895c7c9-sh897"
Nov 04 05:28:26.381877 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.381663    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fst49\" (UniqueName: \"kubernetes.io/projected/327add5c-5660-46e3-93b6-683b8bee126e-kube-api-access-fst49\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8\" (UID: \"327add5c-5660-46e3-93b6-683b8bee126e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8"
Nov 04 05:28:26.381877 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.381708    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjz95\" (UniqueName: \"kubernetes.io/projected/ca807b05-9989-4b11-923c-d8f1423fde00-kube-api-access-tjz95\") pod \"network-check-source-6f78d59f99-f8krc\" (UID: \"ca807b05-9989-4b11-923c-d8f1423fde00\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-f8krc"
Nov 04 05:28:26.382267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.382242    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsgh7\" (UniqueName: \"kubernetes.io/projected/6deb7716-c3cc-4944-99bf-dd904746d24c-kube-api-access-hsgh7\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.382378 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.382273    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnzbx\" (UniqueName: \"kubernetes.io/projected/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-api-access-fnzbx\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.383853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.382907    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-547xj\" (UniqueName: \"kubernetes.io/projected/d44943ce-d083-4b43-a8ce-1c451bbd783b-kube-api-access-547xj\") pod \"migrator-66df5d496b-95h9f\" (UID: \"d44943ce-d083-4b43-a8ce-1c451bbd783b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-95h9f"
Nov 04 05:28:26.383853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.382951    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgqtt\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-kube-api-access-fgqtt\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.383853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.382983    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgw8h\" (UniqueName: \"kubernetes.io/projected/907d151f-d95c-40e6-95af-4198aec88c33-kube-api-access-wgw8h\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:26.383853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.383463    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp5vz\" (UniqueName: \"kubernetes.io/projected/39761fca-7780-4800-a367-f827667dc6d7-kube-api-access-hp5vz\") pod \"service-ca-operator-544d749c8c-lp49h\" (UID: \"39761fca-7780-4800-a367-f827667dc6d7\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h"
Nov 04 05:28:26.383853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.383579    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwc9w\" (UniqueName: \"kubernetes.io/projected/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-kube-api-access-xwc9w\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:26.383853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.383761    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb7nn\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-kube-api-access-fb7nn\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.383853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.383790    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkkfg\" (UniqueName: \"kubernetes.io/projected/5794b522-36b9-4e80-b852-deff2905e1c7-kube-api-access-xkkfg\") pod \"insights-operator-7c4986d449-5skd7\" (UID: \"5794b522-36b9-4e80-b852-deff2905e1c7\") " pod="openshift-insights/insights-operator-7c4986d449-5skd7"
Nov 04 05:28:26.383853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.383798    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqtn\" (UniqueName: \"kubernetes.io/projected/c7b2d156-2b78-4114-9980-8543ed070a9a-kube-api-access-swqtn\") pod \"ingress-canary-qfz8d\" (UID: \"c7b2d156-2b78-4114-9980-8543ed070a9a\") " pod="openshift-ingress-canary/ingress-canary-qfz8d"
Nov 04 05:28:26.383853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.383798    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwr2j\" (UniqueName: \"kubernetes.io/projected/08f68bfa-5fe7-4cc2-a833-9f0c72871994-kube-api-access-wwr2j\") pod \"volume-data-source-validator-58c9f5f46d-7gnk7\" (UID: \"08f68bfa-5fe7-4cc2-a833-9f0c72871994\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7gnk7"
Nov 04 05:28:26.384352 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.384100    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9pjr\" (UniqueName: \"kubernetes.io/projected/bdfef95a-7674-41dd-b03e-9055b658a2aa-kube-api-access-s9pjr\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.384352 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.384210    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qsq4\" (UniqueName: \"kubernetes.io/projected/e02ac97f-6e15-4540-8b31-a7208f55217a-kube-api-access-6qsq4\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:28:26.384352 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.384244    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnbc\" (UniqueName: \"kubernetes.io/projected/8dd81a50-cf93-4c73-a2cf-793fee04c292-kube-api-access-9cnbc\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:28:26.384352 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.384281    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvtkt\" (UniqueName: \"kubernetes.io/projected/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-kube-api-access-nvtkt\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:28:26.384352 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.384313    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kvnm\" (UniqueName: \"kubernetes.io/projected/589feb32-bcd4-4ab3-810a-0210968dc7b6-kube-api-access-8kvnm\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.384572 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.384551    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh2lg\" (UniqueName: \"kubernetes.io/projected/3024b38f-4b25-45ec-8a49-40a3859ca462-kube-api-access-vh2lg\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.475871 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.475835    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-system-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.475871 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.475873    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-node-log\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.475891    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-bin\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.475922    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-etc-kubernetes\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.475950    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.475957    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-node-log\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.475977    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-kubelet\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.475977    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-system-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.475980    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-bin\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476010    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-etc-kubernetes\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476019    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476036    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-kubelet\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476004    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476057    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476075    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476098    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-modprobe-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.476117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476113    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476137    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-run\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476153    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-registration-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476174    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-k8s-cni-cncf-io\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476196    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476221    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4952ed47-5e12-468b-9b7a-12566b6cffa5-crio-socket\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476241    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476246    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-device-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476281    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-registration-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476243    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-modprobe-d\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476296    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4952ed47-5e12-468b-9b7a-12566b6cffa5-crio-socket\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476222    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-run\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476283    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-socket-dir-parent\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476322    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-socket-dir-parent\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476256    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-k8s-cni-cncf-io\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476346    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476375    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-multus-certs\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476399    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-multus\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476348    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-device-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476429    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-conf-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476459    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-multus\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476462    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-multus-certs\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476465    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-dbus\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476529    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-sys\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476466    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-conf-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476551    5079 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476557    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-kubelet-config\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476583    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-sys\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476596    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-ovn\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476626    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-ovn\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476586    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-kubelet-config\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476645    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-sys-fs\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476672    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476544    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba6f7a7-c835-4c2b-8e17-32015f629d52-dbus\") pod \"global-pull-secret-syncer-tgz7l\" (UID: \"9ba6f7a7-c835-4c2b-8e17-32015f629d52\") " pod="kube-system/global-pull-secret-syncer-tgz7l"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476683    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-sys-fs\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476717    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-var-lib-kubelet\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476744    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-var-lib-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476765    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-netd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476799    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-cnibin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.476780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476803    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-var-lib-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476807    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-var-lib-kubelet\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476821    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dd81a50-cf93-4c73-a2cf-793fee04c292-host\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476847    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-etc-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476853    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-cni-netd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476874    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e02ac97f-6e15-4540-8b31-a7208f55217a-hosts-file\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476878    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-cnibin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476882    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8dd81a50-cf93-4c73-a2cf-793fee04c292-host\") pod \"node-ca-j2n64\" (UID: \"8dd81a50-cf93-4c73-a2cf-793fee04c292\") " pod="openshift-image-registry/node-ca-j2n64"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476896    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-etc-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476909    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.476914    5079 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476935    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e02ac97f-6e15-4540-8b31-a7208f55217a-hosts-file\") pod \"node-resolver-zgr4j\" (UID: \"e02ac97f-6e15-4540-8b31-a7208f55217a\") " pod="openshift-dns/node-resolver-zgr4j"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476938    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-conf\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.476967    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.476991    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:26.976975091 +0000 UTC m=+1.834962926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : secret "router-metrics-certs-default" not found
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477014    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-multus-cni-dir\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477015    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-netns\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477048    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-run-netns\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477057    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysctl-conf\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477060    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-netns\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477093    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysconfig\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477099    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-netns\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477117    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477147    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-lib-modules\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477152    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-sysconfig\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477172    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-systemd-units\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477196    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-cnibin\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477220    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-kubernetes\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477271    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477292    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-systemd-units\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477298    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-socket-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477322    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-slash\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477368    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-system-cni-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477390    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-systemd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477395    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-lib-modules\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477413    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-log-socket\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477418    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477439    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-systemd\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477466    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477478    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-kubernetes\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477492    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477537    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-slash\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477542    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477496    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-etc-systemd\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477566    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-systemd\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477441    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-cnibin\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477569    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-host-slash\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477629    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-hostroot\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477655    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-kubelet\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477537    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-socket-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477585    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-run-openvswitch\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477694    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-hostroot\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477698    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477730    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-kubelet\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477737    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-host\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477740    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-host-run-ovn-kubernetes\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477767    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477775    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6deb7716-c3cc-4944-99bf-dd904746d24c-log-socket\") pod \"ovnkube-node-vk7hk\" (UID: \"6deb7716-c3cc-4944-99bf-dd904746d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477795    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/589feb32-bcd4-4ab3-810a-0210968dc7b6-host\") pod \"tuned-55msn\" (UID: \"589feb32-bcd4-4ab3-810a-0210968dc7b6\") " pod="openshift-cluster-node-tuning-operator/tuned-55msn"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477795    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-bin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477816    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/526ed430-5c81-45f1-885d-2211b36b7745-system-cni-dir\") pod \"multus-additional-cni-plugins-tw2sv\" (UID: \"526ed430-5c81-45f1-885d-2211b36b7745\") " pod="openshift-multus/multus-additional-cni-plugins-tw2sv"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477832    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477853    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e45fa7b-edf2-4c01-ac71-76ca9c425f7e-host-slash\") pod \"iptables-alerter-xffhq\" (UID: \"9e45fa7b-edf2-4c01-ac71-76ca9c425f7e\") " pod="openshift-network-operator/iptables-alerter-xffhq"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477862    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477884    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bdfef95a-7674-41dd-b03e-9055b658a2aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrz8d\" (UID: \"bdfef95a-7674-41dd-b03e-9055b658a2aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrz8d"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477835    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/05890613-c051-4133-b1c6-7b282670a076-host-var-lib-cni-bin\") pod \"multus-9hlsm\" (UID: \"05890613-c051-4133-b1c6-7b282670a076\") " pod="openshift-multus/multus-9hlsm"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.477888    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.477936    5079 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.477980    5079 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.478068    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls podName:810663b6-a5ea-4fef-b237-7caedfbab7f6 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:26.978049292 +0000 UTC m=+1.836037100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-6qps6" (UID: "810663b6-a5ea-4fef-b237-7caedfbab7f6") : secret "samples-operator-tls" not found
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.478089    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:26.978079497 +0000 UTC m=+1.836067308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.478107    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:26.978096561 +0000 UTC m=+1.836084373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : configmap references non-existent config key: service-ca.crt
Nov 04 05:28:26.479050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.478211    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4952ed47-5e12-468b-9b7a-12566b6cffa5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.482292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.480032    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\") pod \"image-registry-77865897f5-8m6ds\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") " pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.482292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.480313    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2a942cf-93c8-445a-b6b6-cbda93d99210-metrics-tls\") pod \"dns-default-dqblv\" (UID: \"a2a942cf-93c8-445a-b6b6-cbda93d99210\") " pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:26.482292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.480327    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a1a23a-cfae-43f1-b639-b30b4448ea40-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8dsn9\" (UID: \"41a1a23a-cfae-43f1-b639-b30b4448ea40\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:26.482292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.480780    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d413c3c9-fece-4d7c-a6ea-7691c035a5ad-metrics-certs\") pod \"network-metrics-daemon-lbx9s\" (UID: \"d413c3c9-fece-4d7c-a6ea-7691c035a5ad\") " pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:26.482292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.480889    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/907d151f-d95c-40e6-95af-4198aec88c33-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-mxz59\" (UID: \"907d151f-d95c-40e6-95af-4198aec88c33\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:26.482292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.481194    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\") pod \"image-registry-588d496878-vbp7s\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") " pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.561864 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.561779    5079 scope.go:122] "RemoveContainer" containerID="d952219913e9b4b176279c24ad9a9df273175f648a4305b0b1fed0f30cf828b6"
Nov 04 05:28:26.562812 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.562797    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:26.563706 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.563683    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"
Nov 04 05:28:26.567628 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.567609    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"
Nov 04 05:28:26.576131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.575941    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lbx9s"
Nov 04 05:28:26.576871 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.576851    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:26.578208 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.577972    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:26.709689 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.709413    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:26.857123 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.857051    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77865897f5-8m6ds"]
Nov 04 05:28:26.860343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:26.860296    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d8c1e7_c045_45ee_90ab_7b26087ec7c0.slice/crio-9569d6026deb3f3b98c195e939d65bd93492ca5220c76bdc8eb3224258a04dcd WatchSource:0}: Error finding container 9569d6026deb3f3b98c195e939d65bd93492ca5220c76bdc8eb3224258a04dcd: Status 404 returned error can't find the container with id 9569d6026deb3f3b98c195e939d65bd93492ca5220c76bdc8eb3224258a04dcd
Nov 04 05:28:26.869736 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:26.869703    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod907d151f_d95c_40e6_95af_4198aec88c33.slice/crio-6e40eae2c2b7a97fe6657ca786472d9db1f79d370ad710a5e0be0e1218f85971 WatchSource:0}: Error finding container 6e40eae2c2b7a97fe6657ca786472d9db1f79d370ad710a5e0be0e1218f85971: Status 404 returned error can't find the container with id 6e40eae2c2b7a97fe6657ca786472d9db1f79d370ad710a5e0be0e1218f85971
Nov 04 05:28:26.870578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.870554    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59"]
Nov 04 05:28:26.871132 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.871105    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8dsn9"]
Nov 04 05:28:26.871586 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.871381    5079 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:28:26.874050 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:26.874035    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a1a23a_cfae_43f1_b639_b30b4448ea40.slice/crio-ce12189de285ee1d025927022651ed99387b03461cf4f97c58e0cd9b6721d24b WatchSource:0}: Error finding container ce12189de285ee1d025927022651ed99387b03461cf4f97c58e0cd9b6721d24b: Status 404 returned error can't find the container with id ce12189de285ee1d025927022651ed99387b03461cf4f97c58e0cd9b6721d24b
Nov 04 05:28:26.910682 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.910655    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lbx9s"]
Nov 04 05:28:26.914885 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.914857    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:26.916631 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:26.916609    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd413c3c9_fece_4d7c_a6ea_7691c035a5ad.slice/crio-e4b8965e0cdcb5c7fa71080a07f77fdeb65c451e702c5fa0fbed0b9f95c5593e WatchSource:0}: Error finding container e4b8965e0cdcb5c7fa71080a07f77fdeb65c451e702c5fa0fbed0b9f95c5593e: Status 404 returned error can't find the container with id e4b8965e0cdcb5c7fa71080a07f77fdeb65c451e702c5fa0fbed0b9f95c5593e
Nov 04 05:28:26.922224 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.922160    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dqblv"]
Nov 04 05:28:26.925364 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:26.925341    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a942cf_93c8_445a_b6b6_cbda93d99210.slice/crio-a77d15ce9c96b3f9c15c8147d22443ac158c65b69e33ba4f2c614645f8060db9 WatchSource:0}: Error finding container a77d15ce9c96b3f9c15c8147d22443ac158c65b69e33ba4f2c614645f8060db9: Status 404 returned error can't find the container with id a77d15ce9c96b3f9c15c8147d22443ac158c65b69e33ba4f2c614645f8060db9
Nov 04 05:28:26.948352 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.948321    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-588d496878-vbp7s"]
Nov 04 05:28:26.952078 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:26.952048    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b21212_89e5_40ce_8bbd_75f93265da0e.slice/crio-4c56b0161f1cf470f5b7694de8341c29045b16d6b6f7461a93ced0cd55492e96 WatchSource:0}: Error finding container 4c56b0161f1cf470f5b7694de8341c29045b16d6b6f7461a93ced0cd55492e96: Status 404 returned error can't find the container with id 4c56b0161f1cf470f5b7694de8341c29045b16d6b6f7461a93ced0cd55492e96
Nov 04 05:28:26.981967 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.981931    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:26.981967 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.981968    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:26.982184 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.981985    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.982184 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:26.982039    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:26.982184 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.982109    5079 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:26.982184 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.982109    5079 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 05:28:26.982404 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.982117    5079 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 05:28:26.982404 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.982183    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:27.98216244 +0000 UTC m=+2.840150266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:26.982404 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.982254    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:27.982236456 +0000 UTC m=+2.840224268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : configmap references non-existent config key: service-ca.crt
Nov 04 05:28:26.982404 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.982269    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls podName:810663b6-a5ea-4fef-b237-7caedfbab7f6 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:27.982260358 +0000 UTC m=+2.840248170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-6qps6" (UID: "810663b6-a5ea-4fef-b237-7caedfbab7f6") : secret "samples-operator-tls" not found
Nov 04 05:28:26.982404 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:26.982283    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:27.982274064 +0000 UTC m=+2.840261878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : secret "router-metrics-certs-default" not found
Nov 04 05:28:27.111621 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.111534    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:27.332013 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.331929    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:27.360774 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.360743    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:27.367420 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.367336    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588d496878-vbp7s" event={"ID":"b0b21212-89e5-40ce-8bbd-75f93265da0e","Type":"ContainerStarted","Data":"888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236"}
Nov 04 05:28:27.367724 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.367692    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588d496878-vbp7s" event={"ID":"b0b21212-89e5-40ce-8bbd-75f93265da0e","Type":"ContainerStarted","Data":"4c56b0161f1cf470f5b7694de8341c29045b16d6b6f7461a93ced0cd55492e96"}
Nov 04 05:28:27.369384 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.369320    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqblv" event={"ID":"a2a942cf-93c8-445a-b6b6-cbda93d99210","Type":"ContainerStarted","Data":"a77d15ce9c96b3f9c15c8147d22443ac158c65b69e33ba4f2c614645f8060db9"}
Nov 04 05:28:27.371358 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.371333    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lbx9s" event={"ID":"d413c3c9-fece-4d7c-a6ea-7691c035a5ad","Type":"ContainerStarted","Data":"e4b8965e0cdcb5c7fa71080a07f77fdeb65c451e702c5fa0fbed0b9f95c5593e"}
Nov 04 05:28:27.374004 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.373558    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77865897f5-8m6ds" event={"ID":"12d8c1e7-c045-45ee-90ab-7b26087ec7c0","Type":"ContainerStarted","Data":"242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993"}
Nov 04 05:28:27.374004 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.373601    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77865897f5-8m6ds" event={"ID":"12d8c1e7-c045-45ee-90ab-7b26087ec7c0","Type":"ContainerStarted","Data":"9569d6026deb3f3b98c195e939d65bd93492ca5220c76bdc8eb3224258a04dcd"}
Nov 04 05:28:27.375798 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.375779    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:28:27.375893 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.375851    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz" event={"ID":"8e7e37c2-a915-457b-a553-b53f25aaba42","Type":"ContainerStarted","Data":"7cb42ee2fe56f4b82d6058127a3d6a29a96777a3542014675d83bb70eaa7d7ea"}
Nov 04 05:28:27.378407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.378344    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9" event={"ID":"41a1a23a-cfae-43f1-b639-b30b4448ea40","Type":"ContainerStarted","Data":"ce12189de285ee1d025927022651ed99387b03461cf4f97c58e0cd9b6721d24b"}
Nov 04 05:28:27.381390 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.380380    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59" event={"ID":"907d151f-d95c-40e6-95af-4198aec88c33","Type":"ContainerStarted","Data":"6e40eae2c2b7a97fe6657ca786472d9db1f79d370ad710a5e0be0e1218f85971"}
Nov 04 05:28:27.418669 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.418633    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:27.491302 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.491200    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:27.592153 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.592116    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:27.691090 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.691058    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:27.879351 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.879319    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:27.952572 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.951926    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:27.992966 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.992898    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:27.993162 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.993050    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:27.993162 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.993074    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:27.993162 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:27.993090    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:27.993327 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:27.993207    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.993194156 +0000 UTC m=+4.851181963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : configmap references non-existent config key: service-ca.crt
Nov 04 05:28:27.993558 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:27.993537    5079 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 05:28:27.993655 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:27.993582    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs podName:3024b38f-4b25-45ec-8a49-40a3859ca462 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.993570591 +0000 UTC m=+4.851558400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs") pod "router-default-6d8999f8d7-rwnj7" (UID: "3024b38f-4b25-45ec-8a49-40a3859ca462") : secret "router-metrics-certs-default" not found
Nov 04 05:28:27.993655 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:27.993618    5079 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 05:28:27.993655 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:27.993638    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls podName:810663b6-a5ea-4fef-b237-7caedfbab7f6 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.993631952 +0000 UTC m=+4.851619759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-6qps6" (UID: "810663b6-a5ea-4fef-b237-7caedfbab7f6") : secret "samples-operator-tls" not found
Nov 04 05:28:27.993811 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:27.993674    5079 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:27.993811 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:27.993694    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:29.993687691 +0000 UTC m=+4.851675499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:28.024288 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:28.024122    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:28.239700 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:28.239476    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:28.342721 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:28.342492    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:28.385686 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:28.385659    5079 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:28.385965 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:28.385944    5079 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:28.456421 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:28.456388    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:28.709416 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:28.709373    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:28.722244 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:28.722211    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:28.722444 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:28.722372    5079 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:28.728723 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:28.728695    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-jvwgz"
Nov 04 05:28:28.912796 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:28.912702    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:29.111808 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.111771    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:29.212101 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.212077    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:29.312976 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.312905    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:29.391788 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.391751    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-8dsn9" event={"ID":"41a1a23a-cfae-43f1-b639-b30b4448ea40","Type":"ContainerStarted","Data":"4849473a6f74f691d783189ac9354d273624b7f0cdcff0a3442f9fdb064e3efe"}
Nov 04 05:28:29.397889 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.397854    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-mxz59" event={"ID":"907d151f-d95c-40e6-95af-4198aec88c33","Type":"ContainerStarted","Data":"9f5fc46cf32f30944a0868808a31befd6314bc471944827d071bf972745ecb65"}
Nov 04 05:28:29.400919 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.400457    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqblv" event={"ID":"a2a942cf-93c8-445a-b6b6-cbda93d99210","Type":"ContainerStarted","Data":"e0e207d9c7f66f6aeb5635fc00d0bddbd197ac1e5141a787a7292b4c69d5a3a2"}
Nov 04 05:28:29.400919 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.400533    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dqblv" event={"ID":"a2a942cf-93c8-445a-b6b6-cbda93d99210","Type":"ContainerStarted","Data":"b5a0c1cde6671acc3351bc0a89c738a65a7cbce9971b293e32840fe547da81d1"}
Nov 04 05:28:29.400919 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.400561    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:29.402379 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.402355    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lbx9s" event={"ID":"d413c3c9-fece-4d7c-a6ea-7691c035a5ad","Type":"ContainerStarted","Data":"a4e804eff7d474422d69baf5ac57ab770be3871608471dd2b55b47c89ddffa6c"}
Nov 04 05:28:29.402489 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.402404    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lbx9s" event={"ID":"d413c3c9-fece-4d7c-a6ea-7691c035a5ad","Type":"ContainerStarted","Data":"b6d09fddf78f6d24e622e8b207df8a3534e592b1d0bc7d3d32962bcecfa10f51"}
Nov 04 05:28:29.416349 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.416269    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:29.529699 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.529667    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:29.626187 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.626141    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:29.727045 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.727010    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:29.870619 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.870594    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:29.870878 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:29.870867    5079 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:30.014813 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.014708    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:30.014813 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.014764    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:30.015030 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:30.014856    5079 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:30.015030 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:30.014906    5079 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls podName:4952ed47-5e12-468b-9b7a-12566b6cffa5 nodeName:}" failed. No retries permitted until 2026-11-04 05:28:34.014893154 +0000 UTC m=+8.872880962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m8zlm" (UID: "4952ed47-5e12-468b-9b7a-12566b6cffa5") : secret "insights-runtime-extractor-tls" not found
Nov 04 05:28:30.015030 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.014896    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:30.015030 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.014975    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:30.015615 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.015591    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3024b38f-4b25-45ec-8a49-40a3859ca462-service-ca-bundle\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:30.017217 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.017195    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/810663b6-a5ea-4fef-b237-7caedfbab7f6-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-6qps6\" (UID: \"810663b6-a5ea-4fef-b237-7caedfbab7f6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:30.017314 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.017238    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3024b38f-4b25-45ec-8a49-40a3859ca462-metrics-certs\") pod \"router-default-6d8999f8d7-rwnj7\" (UID: \"3024b38f-4b25-45ec-8a49-40a3859ca462\") " pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:30.070376 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.070331    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:30.161363 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.161325    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:30.161591 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.161395    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"
Nov 04 05:28:30.274604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.274521    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:30.349820 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.349775    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:30.447195 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.446832    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6"]
Nov 04 05:28:30.450301 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.450267    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d8999f8d7-rwnj7"]
Nov 04 05:28:30.483451 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:30.483413    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3024b38f_4b25_45ec_8a49_40a3859ca462.slice/crio-f0287c9ca8e014381f5f9a18a8c6114e7adb9a33032a732c38a2765712a6b655 WatchSource:0}: Error finding container f0287c9ca8e014381f5f9a18a8c6114e7adb9a33032a732c38a2765712a6b655: Status 404 returned error can't find the container with id f0287c9ca8e014381f5f9a18a8c6114e7adb9a33032a732c38a2765712a6b655
Nov 04 05:28:30.713111 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.713066    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:30.913239 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:30.913150    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:31.114922 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:31.114855    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:31.415682 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:31.415646    5079 generic.go:356] "Generic (PLEG): container finished" podID="39761fca-7780-4800-a367-f827667dc6d7" containerID="f24def93c13deaa627e0c075d3162aea21b650e7b25d21017b5a1e51ea539617" exitCode=0
Nov 04 05:28:31.415844 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:31.415722    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h" event={"ID":"39761fca-7780-4800-a367-f827667dc6d7","Type":"ContainerDied","Data":"f24def93c13deaa627e0c075d3162aea21b650e7b25d21017b5a1e51ea539617"}
Nov 04 05:28:31.416254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:31.416232    5079 scope.go:122] "RemoveContainer" containerID="f24def93c13deaa627e0c075d3162aea21b650e7b25d21017b5a1e51ea539617"
Nov 04 05:28:31.417697 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:31.417312    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6" event={"ID":"810663b6-a5ea-4fef-b237-7caedfbab7f6","Type":"ContainerStarted","Data":"b08da8cc22248c5c468603ae95d595bad39c3ff885ae4c7d656980530439779a"}
Nov 04 05:28:31.419978 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:31.419957    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d8999f8d7-rwnj7" event={"ID":"3024b38f-4b25-45ec-8a49-40a3859ca462","Type":"ContainerStarted","Data":"9da1d1e405cb3cc9e1d8cdb119c9c5bfbdb46c79be8aa1ea974181b045253e19"}
Nov 04 05:28:31.420091 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:31.420006    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d8999f8d7-rwnj7" event={"ID":"3024b38f-4b25-45ec-8a49-40a3859ca462","Type":"ContainerStarted","Data":"f0287c9ca8e014381f5f9a18a8c6114e7adb9a33032a732c38a2765712a6b655"}
Nov 04 05:28:31.422086 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:31.422059    5079 generic.go:356] "Generic (PLEG): container finished" podID="327add5c-5660-46e3-93b6-683b8bee126e" containerID="199832b147ecccee823c1a80f83366b53f26a11327be4f3b14d975eeaf6c7baf" exitCode=0
Nov 04 05:28:31.422178 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:31.422154    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8" event={"ID":"327add5c-5660-46e3-93b6-683b8bee126e","Type":"ContainerDied","Data":"199832b147ecccee823c1a80f83366b53f26a11327be4f3b14d975eeaf6c7baf"}
Nov 04 05:28:31.422522 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:31.422485    5079 scope.go:122] "RemoveContainer" containerID="199832b147ecccee823c1a80f83366b53f26a11327be4f3b14d975eeaf6c7baf"
Nov 04 05:28:31.514155 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:31.514059    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:32.018262 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:32.018227    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:32.161600 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:32.161558    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:32.164477 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:32.164457    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:32.342058 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:32.342022    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:32.429266 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:32.429235    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lp49h" event={"ID":"39761fca-7780-4800-a367-f827667dc6d7","Type":"ContainerStarted","Data":"12970d01a49ef5294dc93997dcfff57d33383dc3e2fd3ba0adf59370152fd80a"}
Nov 04 05:28:32.431307 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:32.431276    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6" event={"ID":"810663b6-a5ea-4fef-b237-7caedfbab7f6","Type":"ContainerStarted","Data":"254c95a1b50e8dc96845e0a10e6c42e508734ec3ae787e44e7bb0b0841b71d60"}
Nov 04 05:28:32.431452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:32.431335    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-6qps6" event={"ID":"810663b6-a5ea-4fef-b237-7caedfbab7f6","Type":"ContainerStarted","Data":"619fcdd085433ac5117cfe2c9ce43bf60430c5c2db1d02ecd769474ed216cd99"}
Nov 04 05:28:32.433248 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:32.433222    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-t7zn8" event={"ID":"327add5c-5660-46e3-93b6-683b8bee126e","Type":"ContainerStarted","Data":"98c4ac2fc5115a04734e3e73b3cc6a0d9062c072a4197d64b1fbffd3b951ad0d"}
Nov 04 05:28:32.513025 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:32.512988    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:32.910218 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:32.910181    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:33.107512 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:33.107456    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:33.438368 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:33.438341    5079 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:33.513322 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:33.513290    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:33.916614 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:33.916527    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:34.055006 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:34.054974    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:34.057472 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:34.057441    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4952ed47-5e12-468b-9b7a-12566b6cffa5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m8zlm\" (UID: \"4952ed47-5e12-468b-9b7a-12566b6cffa5\") " pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:34.078886 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:34.078856    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m8zlm"
Nov 04 05:28:34.112481 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:34.112452    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:34.357337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:34.357301    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m8zlm"]
Nov 04 05:28:34.360898 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:34.360862    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4952ed47_5e12_468b_9b7a_12566b6cffa5.slice/crio-7a96d71c6961ad11595693a21b58dad5804a83068e12e3f1bfd9b42482df6cba WatchSource:0}: Error finding container 7a96d71c6961ad11595693a21b58dad5804a83068e12e3f1bfd9b42482df6cba: Status 404 returned error can't find the container with id 7a96d71c6961ad11595693a21b58dad5804a83068e12e3f1bfd9b42482df6cba
Nov 04 05:28:34.372057 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:34.372025    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:34.444778 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:34.444742    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m8zlm" event={"ID":"4952ed47-5e12-468b-9b7a-12566b6cffa5","Type":"ContainerStarted","Data":"94ce0bbe41916ed55e1f07496f7488f5034b02094e5a165ae498d767db8c499a"}
Nov 04 05:28:34.444915 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:34.444798    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m8zlm" event={"ID":"4952ed47-5e12-468b-9b7a-12566b6cffa5","Type":"ContainerStarted","Data":"7a96d71c6961ad11595693a21b58dad5804a83068e12e3f1bfd9b42482df6cba"}
Nov 04 05:28:34.449185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:34.449151    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:35.450771 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:35.450735    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m8zlm" event={"ID":"4952ed47-5e12-468b-9b7a-12566b6cffa5","Type":"ContainerStarted","Data":"bee6c4a65d0c8507ee4fcecd00a109f64f73b17d89b95c1f20f86d1f1eff7af7"}
Nov 04 05:28:37.462635 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:37.462597    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m8zlm" event={"ID":"4952ed47-5e12-468b-9b7a-12566b6cffa5","Type":"ContainerStarted","Data":"f6334a715ed10d62c68f1a04349b6e23b7ab441f5553aef55ddc92e832b86a73"}
Nov 04 05:28:37.843563 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:37.843454    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:37.843703 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:37.843608    5079 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 05:28:37.844893 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:37.844870    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d8999f8d7-rwnj7"
Nov 04 05:28:39.409830 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:39.409796    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dqblv"
Nov 04 05:28:40.640302 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:40.640252    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77865897f5-8m6ds"]
Nov 04 05:28:40.692338 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:40.692290    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:40.792148 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:40.792114    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:43.082790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:43.082752    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:45.365141 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:45.365096    5079 patch_prober.go:29] interesting pod/image-registry-588d496878-vbp7s container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Nov 04 05:28:45.365659 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:45.365182    5079 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-588d496878-vbp7s" podUID="b0b21212-89e5-40ce-8bbd-75f93265da0e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:28:45.762138 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:45.762086    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:45.878145 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:45.878103    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:45.978950 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:45.978916    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:46.657519 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:28:46.657469    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:28:47.070447 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:47.070406    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:47.140036 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:47.139991    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:47.653599 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:47.653573    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vk7hk"
Nov 04 05:28:48.099659 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:48.099621    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:48.298934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:48.298899    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:48.365887 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:48.365794    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:48.563216 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:48.563186    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bcklp"
Nov 04 05:28:49.362774 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:49.362733    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:49.463676 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:49.463644    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:49.954397 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:49.954350    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:50.054427 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.054375    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:50.075564 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.075533    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:28:50.166309 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.166251    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:50.180116 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.180083    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ctncw"]
Nov 04 05:28:50.185865 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.185836    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.245032 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.244938    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pwkwp\""
Nov 04 05:28:50.245032 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.244938    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 05:28:50.245032 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.244993    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 05:28:50.258567 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.258522    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:50.262162 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.262140    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 05:28:50.262361 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.262343    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 05:28:50.309070 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.309032    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-metrics-client-ca\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.309070 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.309082    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-tls\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.309287 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.309184    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-wtmp\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.309328 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.309283    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.309328 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.309307    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtkd8\" (UniqueName: \"kubernetes.io/projected/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-kube-api-access-gtkd8\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.309391 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.309336    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-sys\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.309391 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.309360    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-textfile\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.309451 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.309391    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.309486 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.309466    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-root\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.354458 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.354418    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:50.410558 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410490    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-wtmp\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410579    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410596    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtkd8\" (UniqueName: \"kubernetes.io/projected/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-kube-api-access-gtkd8\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410619    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-sys\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410635    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-textfile\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410651    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410671    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-root\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410685    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-wtmp\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410708    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-sys\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410734    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-root\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410696    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-metrics-client-ca\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.410792    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-tls\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.411006    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-textfile\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411624 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.411266    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.411624 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.411441    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-metrics-client-ca\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.413201 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.413172    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.413337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.413322    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-node-exporter-tls\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.417940 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.417919    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtkd8\" (UniqueName: \"kubernetes.io/projected/f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3-kube-api-access-gtkd8\") pod \"node-exporter-ctncw\" (UID: \"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3\") " pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.504257 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.504177    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctncw"
Nov 04 05:28:50.517669 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:28:50.517638    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ba30ae_b6c3_47aa_b9b2_67fb361f7bd3.slice/crio-5842614d1342b7bb643d72a15c264ae669b04b95f271501ff7a42cbb9e6f31b0 WatchSource:0}: Error finding container 5842614d1342b7bb643d72a15c264ae669b04b95f271501ff7a42cbb9e6f31b0: Status 404 returned error can't find the container with id 5842614d1342b7bb643d72a15c264ae669b04b95f271501ff7a42cbb9e6f31b0
Nov 04 05:28:50.533063 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.533031    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:50.633588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.633547    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:50.646241 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:50.646216    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:28:51.081554 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:51.081486    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:51.180736 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:51.180699    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:51.266961 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:51.266912    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:51.389717 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:51.389605    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:51.522410 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:51.522375    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctncw" event={"ID":"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3","Type":"ContainerStarted","Data":"5842614d1342b7bb643d72a15c264ae669b04b95f271501ff7a42cbb9e6f31b0"}
Nov 04 05:28:52.528520 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:52.528465    5079 generic.go:356] "Generic (PLEG): container finished" podID="f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3" containerID="2cfafaef97189932a10642a0164f331c75093aefe9be3bb2048a5f2baff1e147" exitCode=0
Nov 04 05:28:52.528916 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:52.528540    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctncw" event={"ID":"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3","Type":"ContainerDied","Data":"2cfafaef97189932a10642a0164f331c75093aefe9be3bb2048a5f2baff1e147"}
Nov 04 05:28:53.171364 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:53.171329    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:53.276679 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:53.276635    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:53.372670 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:53.372634    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:53.534635 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:53.534595    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctncw" event={"ID":"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3","Type":"ContainerStarted","Data":"9f1c5299bacdf7e207eb39198aab831c6cd6d1303e33c30cebe3ea5d51933af1"}
Nov 04 05:28:53.535032 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:53.534653    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctncw" event={"ID":"f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3","Type":"ContainerStarted","Data":"669b41a53c83fdcfd1f0b9c941bcf0ee11fb12c11caf39f28996ec6f87d0d7a6"}
Nov 04 05:28:53.556763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:53.556708    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ctncw" podStartSLOduration=2.428698035 podStartE2EDuration="3.556693744s" totalImagesPullingTime="1.05908387s" totalInitContainerRuntime="68.911839ms" isStatefulPod=true podCreationTimestamp="2026-11-04 05:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:28:53.554710368 +0000 UTC m=+28.412698204" watchObservedRunningTime="2026-11-04 05:28:53.556693744 +0000 UTC m=+28.414681571"
Nov 04 05:28:54.959608 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:54.959572    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:55.055789 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:55.055754    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:55.133789 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:55.133758    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:55.573524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:55.573464    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:55.666079 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:55.666043    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:56.462226 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:56.462191    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:58.277281 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:58.277240    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:58.377964 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:58.377929    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:28:58.460450 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:58.460419    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j5vrf"
Nov 04 05:28:59.685913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:28:59.685878    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:00.287758 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:00.287724    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-588d496878-vbp7s"]
Nov 04 05:29:00.386970 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:00.386935    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:00.488837 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:00.488800    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:00.909956 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:00.909923    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:00.999733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:00.999701    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:02.073780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:02.073744    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:02.175493 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:02.175457    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:03.279012 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:03.278963    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:03.344262 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:03.344224    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:03.512962 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:03.512922    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:03.639067 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:03.638958    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:04.370823 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:04.370791    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:04.471543 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:04.471492    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:04.572239 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:04.572201    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:04.774187 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:04.774150    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:04.875214 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:04.875179    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:05.663615 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.663524    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77865897f5-8m6ds" podUID="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" containerName="registry" containerID="cri-o://242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993" gracePeriod=30
Nov 04 05:29:05.911131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.911107    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:29:05.925974 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.925951    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-installation-pull-secrets\") pod \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") "
Nov 04 05:29:05.926125 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.925982    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-image-registry-private-configuration\") pod \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") "
Nov 04 05:29:05.926125 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.926014    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-kube-api-access-fb7nn\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-kube-api-access-fb7nn\") pod \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") "
Nov 04 05:29:05.926125 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.926040    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\") pod \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") "
Nov 04 05:29:05.926125 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.926091    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-ca-trust-extracted\") pod \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") "
Nov 04 05:29:05.926348 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.926154    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-certificates\") pod \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") "
Nov 04 05:29:05.926348 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.926196    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-bound-sa-token\") pod \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") "
Nov 04 05:29:05.927153 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.927064    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-certificates" pod "12d8c1e7-c045-45ee-90ab-7b26087ec7c0" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:29:05.930250 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.929681    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls" pod "12d8c1e7-c045-45ee-90ab-7b26087ec7c0" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:29:05.935696 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.935592    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-installation-pull-secrets" pod "12d8c1e7-c045-45ee-90ab-7b26087ec7c0" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:29:05.937091 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.936457    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-ca-trust-extracted" pod "12d8c1e7-c045-45ee-90ab-7b26087ec7c0" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:29:05.937091 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.936771    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-image-registry-private-configuration" pod "12d8c1e7-c045-45ee-90ab-7b26087ec7c0" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:29:05.937091 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.936991    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-kube-api-access-fb7nn" pod "12d8c1e7-c045-45ee-90ab-7b26087ec7c0" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0"). InnerVolumeSpecName "kube-api-access-fb7nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:29:05.937420 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:05.937325    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-bound-sa-token" pod "12d8c1e7-c045-45ee-90ab-7b26087ec7c0" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:29:06.026807 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.026774    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-trusted-ca\") pod \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\" (UID: \"12d8c1e7-c045-45ee-90ab-7b26087ec7c0\") "
Nov 04 05:29:06.026974 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.026942    5079 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-image-registry-private-configuration\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:06.026974 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.026955    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb7nn\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-kube-api-access-fb7nn\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:06.026974 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.026968    5079 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-tls\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:06.027068 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.026979    5079 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-ca-trust-extracted\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:06.027068 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.026989    5079 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-registry-certificates\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:06.027068 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.027000    5079 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-bound-sa-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:06.027068 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.027014    5079 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-installation-pull-secrets\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:06.027186 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.027133    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-trusted-ca" pod "12d8c1e7-c045-45ee-90ab-7b26087ec7c0" (UID: "12d8c1e7-c045-45ee-90ab-7b26087ec7c0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:29:06.128088 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.128052    5079 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/12d8c1e7-c045-45ee-90ab-7b26087ec7c0-trusted-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:06.591978 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.591934    5079 generic.go:356] "Generic (PLEG): container finished" podID="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" containerID="242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993" exitCode=0
Nov 04 05:29:06.592175 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.591991    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77865897f5-8m6ds" event={"ID":"12d8c1e7-c045-45ee-90ab-7b26087ec7c0","Type":"ContainerDied","Data":"242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993"}
Nov 04 05:29:06.592175 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.592061    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77865897f5-8m6ds" event={"ID":"12d8c1e7-c045-45ee-90ab-7b26087ec7c0","Type":"ContainerDied","Data":"9569d6026deb3f3b98c195e939d65bd93492ca5220c76bdc8eb3224258a04dcd"}
Nov 04 05:29:06.592175 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.592006    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77865897f5-8m6ds"
Nov 04 05:29:06.592175 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.592094    5079 scope.go:122] "RemoveContainer" containerID="242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993"
Nov 04 05:29:06.601807 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.601784    5079 scope.go:122] "RemoveContainer" containerID="242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993"
Nov 04 05:29:06.602130 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:29:06.602110    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993\": container with ID starting with 242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993 not found: ID does not exist" containerID="242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993"
Nov 04 05:29:06.602207 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.602160    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993"} err="failed to get container status \"242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993\": rpc error: code = NotFound desc = could not find container \"242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993\": container with ID starting with 242aa55d573fa16ffd213ac23029d1a0008cdf6e333c6755b27d75b176904993 not found: ID does not exist"
Nov 04 05:29:06.613711 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.613676    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77865897f5-8m6ds"]
Nov 04 05:29:06.617459 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:06.617431    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77865897f5-8m6ds"]
Nov 04 05:29:07.124523 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:07.124454    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:07.225109 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:07.225075    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:07.294657 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:07.294621    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" path="/var/lib/kubelet/pods/12d8c1e7-c045-45ee-90ab-7b26087ec7c0/volumes"
Nov 04 05:29:10.657637 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:10.657595    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:10.731825 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:10.731796    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:14.911175 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:14.911137    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:15.011541 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:15.011483    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:16.657440 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:29:16.657351    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:29:19.360197 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:19.360160    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:19.459893 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:19.459859    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:25.307715 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.307672    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-588d496878-vbp7s" podUID="b0b21212-89e5-40ce-8bbd-75f93265da0e" containerName="registry" containerID="cri-o://888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236" gracePeriod=30
Nov 04 05:29:25.543682 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.543656    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:29:25.573929 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.573899    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-kube-api-access-fgqtt\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-kube-api-access-fgqtt\") pod \"b0b21212-89e5-40ce-8bbd-75f93265da0e\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") "
Nov 04 05:29:25.574112 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.573946    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-image-registry-private-configuration\") pod \"b0b21212-89e5-40ce-8bbd-75f93265da0e\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") "
Nov 04 05:29:25.574112 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.573988    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\") pod \"b0b21212-89e5-40ce-8bbd-75f93265da0e\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") "
Nov 04 05:29:25.574112 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.574034    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-installation-pull-secrets\") pod \"b0b21212-89e5-40ce-8bbd-75f93265da0e\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") "
Nov 04 05:29:25.574297 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.574213    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0b21212-89e5-40ce-8bbd-75f93265da0e-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b21212-89e5-40ce-8bbd-75f93265da0e-ca-trust-extracted\") pod \"b0b21212-89e5-40ce-8bbd-75f93265da0e\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") "
Nov 04 05:29:25.574297 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.574278    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-bound-sa-token\") pod \"b0b21212-89e5-40ce-8bbd-75f93265da0e\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") "
Nov 04 05:29:25.574410 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.574313    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-trusted-ca\") pod \"b0b21212-89e5-40ce-8bbd-75f93265da0e\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") "
Nov 04 05:29:25.574410 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.574340    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-certificates\") pod \"b0b21212-89e5-40ce-8bbd-75f93265da0e\" (UID: \"b0b21212-89e5-40ce-8bbd-75f93265da0e\") "
Nov 04 05:29:25.574894 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.574847    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-trusted-ca" pod "b0b21212-89e5-40ce-8bbd-75f93265da0e" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:29:25.575020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.574940    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-certificates" pod "b0b21212-89e5-40ce-8bbd-75f93265da0e" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:29:25.576631 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.576603    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-image-registry-private-configuration" pod "b0b21212-89e5-40ce-8bbd-75f93265da0e" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:29:25.576977 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.576925    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-kube-api-access-fgqtt" pod "b0b21212-89e5-40ce-8bbd-75f93265da0e" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e"). InnerVolumeSpecName "kube-api-access-fgqtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:29:25.577077 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.576982    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-installation-pull-secrets" pod "b0b21212-89e5-40ce-8bbd-75f93265da0e" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:29:25.577077 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.577029    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-bound-sa-token" pod "b0b21212-89e5-40ce-8bbd-75f93265da0e" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:29:25.577585 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.577564    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls" pod "b0b21212-89e5-40ce-8bbd-75f93265da0e" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:29:25.581869 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.581783    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b21212-89e5-40ce-8bbd-75f93265da0e-ca-trust-extracted" pod "b0b21212-89e5-40ce-8bbd-75f93265da0e" (UID: "b0b21212-89e5-40ce-8bbd-75f93265da0e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:29:25.669289 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.669251    5079 generic.go:356] "Generic (PLEG): container finished" podID="b0b21212-89e5-40ce-8bbd-75f93265da0e" containerID="888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236" exitCode=0
Nov 04 05:29:25.669466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.669305    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-588d496878-vbp7s"
Nov 04 05:29:25.669466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.669326    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588d496878-vbp7s" event={"ID":"b0b21212-89e5-40ce-8bbd-75f93265da0e","Type":"ContainerDied","Data":"888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236"}
Nov 04 05:29:25.669466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.669375    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-588d496878-vbp7s" event={"ID":"b0b21212-89e5-40ce-8bbd-75f93265da0e","Type":"ContainerDied","Data":"4c56b0161f1cf470f5b7694de8341c29045b16d6b6f7461a93ced0cd55492e96"}
Nov 04 05:29:25.669466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.669403    5079 scope.go:122] "RemoveContainer" containerID="888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236"
Nov 04 05:29:25.675223 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.675198    5079 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b21212-89e5-40ce-8bbd-75f93265da0e-ca-trust-extracted\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:25.675223 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.675220    5079 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-bound-sa-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:25.675379 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.675232    5079 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-trusted-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:25.675379 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.675243    5079 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-certificates\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:25.675379 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.675252    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgqtt\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-kube-api-access-fgqtt\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:25.675379 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.675262    5079 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-image-registry-private-configuration\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:25.675379 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.675270    5079 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b21212-89e5-40ce-8bbd-75f93265da0e-registry-tls\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:25.675379 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.675280    5079 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b21212-89e5-40ce-8bbd-75f93265da0e-installation-pull-secrets\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:25.678712 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.678693    5079 scope.go:122] "RemoveContainer" containerID="888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236"
Nov 04 05:29:25.679011 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:29:25.678995    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236\": container with ID starting with 888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236 not found: ID does not exist" containerID="888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236"
Nov 04 05:29:25.679054 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.679022    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236"} err="failed to get container status \"888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236\": rpc error: code = NotFound desc = could not find container \"888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236\": container with ID starting with 888f9da215083ac885feaff5f77f6958551cec8f5c8ae6adffed128692a21236 not found: ID does not exist"
Nov 04 05:29:25.691482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.691448    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-588d496878-vbp7s"]
Nov 04 05:29:25.695302 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:25.695276    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-588d496878-vbp7s"]
Nov 04 05:29:26.298845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:26.298806    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:26.377066 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:26.377030    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:27.294680 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:27.294650    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b0b21212-89e5-40ce-8bbd-75f93265da0e" path="/var/lib/kubelet/pods/b0b21212-89e5-40ce-8bbd-75f93265da0e/volumes"
Nov 04 05:29:27.513201 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:27.513160    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:27.582038 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:27.581938    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:29.174624 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:29.174566    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:29.254106 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:29.254072    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:29.810095 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:29.810062    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:29.896848 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:29.896813    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:34.363196 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:34.363156    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:34.463073 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:34.463025    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:44.083822 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:44.083743    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:44.184101 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:44.184067    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:44.258358 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:44.258328    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:29:44.748178 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:44.748144    5079 generic.go:356] "Generic (PLEG): container finished" podID="8b5b0789-263a-476a-ba8e-5119eceec889" containerID="9d63815f51dd72c656194ab35d5cb4b573c3c53d02479a05a8306abbfe507f56" exitCode=0
Nov 04 05:29:44.748347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:44.748218    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-pcv9f-qnplw" event={"ID":"8b5b0789-263a-476a-ba8e-5119eceec889","Type":"ContainerDied","Data":"9d63815f51dd72c656194ab35d5cb4b573c3c53d02479a05a8306abbfe507f56"}
Nov 04 05:29:45.753775 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.753743    5079 generic.go:356] "Generic (PLEG): container finished" podID="5794b522-36b9-4e80-b852-deff2905e1c7" containerID="a80a125ab808bf5456a7ed9d3a542a465998e42151230fd833b5a1b81a4fcf88" exitCode=0
Nov 04 05:29:45.754295 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.753819    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-5skd7" event={"ID":"5794b522-36b9-4e80-b852-deff2905e1c7","Type":"ContainerDied","Data":"a80a125ab808bf5456a7ed9d3a542a465998e42151230fd833b5a1b81a4fcf88"}
Nov 04 05:29:45.754295 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.754257    5079 scope.go:122] "RemoveContainer" containerID="a80a125ab808bf5456a7ed9d3a542a465998e42151230fd833b5a1b81a4fcf88"
Nov 04 05:29:45.890919 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.890894    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:29:45.938590 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.938550    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-trusted-ca-bundle\") pod \"8b5b0789-263a-476a-ba8e-5119eceec889\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") "
Nov 04 05:29:45.938770 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.938628    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b5b0789-263a-476a-ba8e-5119eceec889-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8b5b0789-263a-476a-ba8e-5119eceec889-archives-path\") pod \"8b5b0789-263a-476a-ba8e-5119eceec889\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") "
Nov 04 05:29:45.938770 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.938654    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-service-ca-bundle\") pod \"8b5b0789-263a-476a-ba8e-5119eceec889\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") "
Nov 04 05:29:45.938770 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.938749    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b5b0789-263a-476a-ba8e-5119eceec889-kube-api-access-tt8cx\" (UniqueName: \"kubernetes.io/projected/8b5b0789-263a-476a-ba8e-5119eceec889-kube-api-access-tt8cx\") pod \"8b5b0789-263a-476a-ba8e-5119eceec889\" (UID: \"8b5b0789-263a-476a-ba8e-5119eceec889\") "
Nov 04 05:29:45.939038 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.939014    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5b0789-263a-476a-ba8e-5119eceec889-archives-path" pod "8b5b0789-263a-476a-ba8e-5119eceec889" (UID: "8b5b0789-263a-476a-ba8e-5119eceec889"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:29:45.939129 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.939037    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-trusted-ca-bundle" pod "8b5b0789-263a-476a-ba8e-5119eceec889" (UID: "8b5b0789-263a-476a-ba8e-5119eceec889"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:29:45.939129 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.939093    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-service-ca-bundle" pod "8b5b0789-263a-476a-ba8e-5119eceec889" (UID: "8b5b0789-263a-476a-ba8e-5119eceec889"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:29:45.941105 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:45.941083    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5b0789-263a-476a-ba8e-5119eceec889-kube-api-access-tt8cx" pod "8b5b0789-263a-476a-ba8e-5119eceec889" (UID: "8b5b0789-263a-476a-ba8e-5119eceec889"). InnerVolumeSpecName "kube-api-access-tt8cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:29:46.039679 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.039576    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt8cx\" (UniqueName: \"kubernetes.io/projected/8b5b0789-263a-476a-ba8e-5119eceec889-kube-api-access-tt8cx\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:46.039679 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.039615    5079 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-trusted-ca-bundle\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:46.039679 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.039630    5079 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/8b5b0789-263a-476a-ba8e-5119eceec889-archives-path\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:46.039679 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.039644    5079 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b5b0789-263a-476a-ba8e-5119eceec889-service-ca-bundle\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:29:46.150985 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.150945    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-pcv9f-qnplw"]
Nov 04 05:29:46.152963 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.152938    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-pcv9f-qnplw"]
Nov 04 05:29:46.216460 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.216427    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-6nbrq-l9jvf"]
Nov 04 05:29:46.216771 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.216757    5079 cpu_manager.go:414] "containerMap: removing container" podUID="b0b21212-89e5-40ce-8bbd-75f93265da0e" containerName="registry"
Nov 04 05:29:46.216819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.216772    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0b21212-89e5-40ce-8bbd-75f93265da0e" containerName="registry"
Nov 04 05:29:46.216819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.216794    5079 cpu_manager.go:414] "containerMap: removing container" podUID="8b5b0789-263a-476a-ba8e-5119eceec889" containerName="insights-gathering"
Nov 04 05:29:46.216819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.216799    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b5b0789-263a-476a-ba8e-5119eceec889" containerName="insights-gathering"
Nov 04 05:29:46.216819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.216806    5079 cpu_manager.go:414] "containerMap: removing container" podUID="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" containerName="registry"
Nov 04 05:29:46.216819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.216811    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" containerName="registry"
Nov 04 05:29:46.216967 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.216868    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b5b0789-263a-476a-ba8e-5119eceec889" containerName="insights-gathering"
Nov 04 05:29:46.216967 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.216875    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="12d8c1e7-c045-45ee-90ab-7b26087ec7c0" containerName="registry"
Nov 04 05:29:46.216967 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.216883    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0b21212-89e5-40ce-8bbd-75f93265da0e" containerName="registry"
Nov 04 05:29:46.219850 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.219833    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.226794 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.226763    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-6nbrq-l9jvf"]
Nov 04 05:29:46.341403 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.341307    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2ecc44fb-b2c4-408f-8d31-860181ce53b7-archives-path\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.341403 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.341365    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-service-ca-bundle\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.341630 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.341463    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8x25\" (UniqueName: \"kubernetes.io/projected/2ecc44fb-b2c4-408f-8d31-860181ce53b7-kube-api-access-r8x25\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.341630 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.341606    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-trusted-ca-bundle\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.442738 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.442695    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-trusted-ca-bundle\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.442738 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.442745    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2ecc44fb-b2c4-408f-8d31-860181ce53b7-archives-path\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.442983 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.442775    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-service-ca-bundle\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.442983 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.442794    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8x25\" (UniqueName: \"kubernetes.io/projected/2ecc44fb-b2c4-408f-8d31-860181ce53b7-kube-api-access-r8x25\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.443214 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.443191    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2ecc44fb-b2c4-408f-8d31-860181ce53b7-archives-path\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.443527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.443476    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-service-ca-bundle\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.443758 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.443741    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-trusted-ca-bundle\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.451560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.451540    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8x25\" (UniqueName: \"kubernetes.io/projected/2ecc44fb-b2c4-408f-8d31-860181ce53b7-kube-api-access-r8x25\") pod \"periodic-gathering-6nbrq-l9jvf\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") " pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.533560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.533521    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:29:46.657018 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:29:46.656936    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:29:46.759314 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.759285    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bce46cb4ae575446a63ffde37b795952fe90f240ef86408b93603a1734718bd"
Nov 04 05:29:46.759314 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.759293    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:29:46.761245 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.761218    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-5skd7" event={"ID":"5794b522-36b9-4e80-b852-deff2905e1c7","Type":"ContainerStarted","Data":"97fd05e57ebea72260e0220cfcdff931fc9e07666cc1014efed9ab41aa7f5d66"}
Nov 04 05:29:46.779573 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:29:46.779542    5079 status_manager.go:1045] "Failed to get status for pod" err="pods \"periodic-gathering-pcv9f-qnplw\" is forbidden: User \"system:node:ip-10-0-141-135.us-east-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-141-135.us-east-2.compute.internal' and this object" podUID="8b5b0789-263a-476a-ba8e-5119eceec889" pod="openshift-insights/periodic-gathering-pcv9f-qnplw"
Nov 04 05:29:46.804056 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:46.804023    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-6nbrq-l9jvf"]
Nov 04 05:29:46.807581 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:29:46.807551    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecc44fb_b2c4_408f_8d31_860181ce53b7.slice/crio-daa010ffb92567a535bc840a98519f4d9ff7b1dd411dae4f14b7bbb7d765ad9a WatchSource:0}: Error finding container daa010ffb92567a535bc840a98519f4d9ff7b1dd411dae4f14b7bbb7d765ad9a: Status 404 returned error can't find the container with id daa010ffb92567a535bc840a98519f4d9ff7b1dd411dae4f14b7bbb7d765ad9a
Nov 04 05:29:47.293925 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:47.293895    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8b5b0789-263a-476a-ba8e-5119eceec889" path="/var/lib/kubelet/pods/8b5b0789-263a-476a-ba8e-5119eceec889/volumes"
Nov 04 05:29:47.768102 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:47.768066    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-6nbrq-l9jvf" event={"ID":"2ecc44fb-b2c4-408f-8d31-860181ce53b7","Type":"ContainerStarted","Data":"ca6a2b1de1a2473319eefbd303108c209664055792467d2856d389832c0466e8"}
Nov 04 05:29:47.768489 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:47.768118    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-6nbrq-l9jvf" event={"ID":"2ecc44fb-b2c4-408f-8d31-860181ce53b7","Type":"ContainerStarted","Data":"daa010ffb92567a535bc840a98519f4d9ff7b1dd411dae4f14b7bbb7d765ad9a"}
Nov 04 05:29:47.785082 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:29:47.785017    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-6nbrq-l9jvf" podStartSLOduration=1.784997273 podStartE2EDuration="1.784997273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:29:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:29:47.78338828 +0000 UTC m=+82.641376117" watchObservedRunningTime="2026-11-04 05:29:47.784997273 +0000 UTC m=+82.642985104"
Nov 04 05:30:14.950243 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:30:14.950204    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:30:16.656675 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:30:16.656591    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:30:46.655973 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:30:46.655887    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:30:55.953331 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:30:55.953291    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:31:07.856721 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:07.856679    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:31:07.983370 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:07.983327    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:31:11.098998 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:11.098969    5079 generic.go:356] "Generic (PLEG): container finished" podID="2ecc44fb-b2c4-408f-8d31-860181ce53b7" containerID="ca6a2b1de1a2473319eefbd303108c209664055792467d2856d389832c0466e8" exitCode=0
Nov 04 05:31:11.099391 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:11.099009    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-6nbrq-l9jvf" event={"ID":"2ecc44fb-b2c4-408f-8d31-860181ce53b7","Type":"ContainerDied","Data":"ca6a2b1de1a2473319eefbd303108c209664055792467d2856d389832c0466e8"}
Nov 04 05:31:12.231405 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.231370    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:31:12.338143 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.338105    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ecc44fb-b2c4-408f-8d31-860181ce53b7-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2ecc44fb-b2c4-408f-8d31-860181ce53b7-archives-path\") pod \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") "
Nov 04 05:31:12.338143 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.338157    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-service-ca-bundle\") pod \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") "
Nov 04 05:31:12.338360 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.338179    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ecc44fb-b2c4-408f-8d31-860181ce53b7-kube-api-access-r8x25\" (UniqueName: \"kubernetes.io/projected/2ecc44fb-b2c4-408f-8d31-860181ce53b7-kube-api-access-r8x25\") pod \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") "
Nov 04 05:31:12.338360 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.338209    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-trusted-ca-bundle\") pod \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\" (UID: \"2ecc44fb-b2c4-408f-8d31-860181ce53b7\") "
Nov 04 05:31:12.338636 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.338579    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-service-ca-bundle" pod "2ecc44fb-b2c4-408f-8d31-860181ce53b7" (UID: "2ecc44fb-b2c4-408f-8d31-860181ce53b7"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:31:12.338636 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.338576    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ecc44fb-b2c4-408f-8d31-860181ce53b7-archives-path" pod "2ecc44fb-b2c4-408f-8d31-860181ce53b7" (UID: "2ecc44fb-b2c4-408f-8d31-860181ce53b7"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:31:12.338636 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.338603    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-trusted-ca-bundle" pod "2ecc44fb-b2c4-408f-8d31-860181ce53b7" (UID: "2ecc44fb-b2c4-408f-8d31-860181ce53b7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:31:12.340330 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.340306    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ecc44fb-b2c4-408f-8d31-860181ce53b7-kube-api-access-r8x25" pod "2ecc44fb-b2c4-408f-8d31-860181ce53b7" (UID: "2ecc44fb-b2c4-408f-8d31-860181ce53b7"). InnerVolumeSpecName "kube-api-access-r8x25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:31:12.438753 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.438719    5079 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-service-ca-bundle\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:31:12.438753 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.438750    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8x25\" (UniqueName: \"kubernetes.io/projected/2ecc44fb-b2c4-408f-8d31-860181ce53b7-kube-api-access-r8x25\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:31:12.438950 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.438761    5079 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ecc44fb-b2c4-408f-8d31-860181ce53b7-trusted-ca-bundle\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:31:12.438950 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:12.438772    5079 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2ecc44fb-b2c4-408f-8d31-860181ce53b7-archives-path\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:31:13.108433 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:13.108398    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-6nbrq-l9jvf" event={"ID":"2ecc44fb-b2c4-408f-8d31-860181ce53b7","Type":"ContainerDied","Data":"daa010ffb92567a535bc840a98519f4d9ff7b1dd411dae4f14b7bbb7d765ad9a"}
Nov 04 05:31:13.108433 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:13.108429    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-6nbrq-l9jvf"
Nov 04 05:31:13.108668 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:13.108446    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daa010ffb92567a535bc840a98519f4d9ff7b1dd411dae4f14b7bbb7d765ad9a"
Nov 04 05:31:13.376159 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:13.376074    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:31:13.468568 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:13.468528    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:31:14.994303 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:14.994266    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:31:16.656331 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:31:16.656289    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:31:46.285487 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:46.285451    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:31:46.357030 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:31:46.356998    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:31:46.656761 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:31:46.656675    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:32:15.076291 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:32:15.076210    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:32:16.656054 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:32:16.656013    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:32:34.656841 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:32:34.656802    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:32:39.449549 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:32:39.449480    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:32:39.556825 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:32:39.556792    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:32:42.396763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:32:42.396727    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:32:42.466036 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:32:42.465999    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:32:46.151111 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:32:46.151073    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:32:46.655766 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:32:46.655732    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:33:04.355965 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:33:04.355927    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:33:04.454839 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:33:04.454799    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:33:04.562738 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:33:04.562699    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:33:15.088439 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:33:15.088390    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:33:16.657534 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:33:16.657484    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:33:20.982648 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:33:20.982611    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:33:21.054285 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:33:21.054247    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:33:25.311394 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:33:25.311363    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:33:25.312138 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:33:25.312120    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:33:25.315595 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:33:25.315571    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:33:25.316208 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:33:25.316190    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:33:46.656918 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:33:46.656826    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:34:15.136923 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:34:15.136884    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:34:16.657374 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:34:16.657329    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:34:25.301866 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:34:25.301838    5079 scope.go:122] "RemoveContainer" containerID="9d63815f51dd72c656194ab35d5cb4b573c3c53d02479a05a8306abbfe507f56"
Nov 04 05:34:46.656484 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:34:46.656439    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:35:15.182011 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:35:15.181909    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:35:16.656120 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:35:16.656082    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:35:46.658234 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:35:46.658192    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:36:02.453311 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:02.453274    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:02.564735 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:02.564699    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:02.699408 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:02.699370    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:03.669829 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:03.669785    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:03.779115 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:03.779080    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:04.726153 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:04.726119    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:07.653745 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:07.653697    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:07.792341 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:07.792299    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:08.313769 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.313734    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"]
Nov 04 05:36:08.314134 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.314115    5079 cpu_manager.go:414] "containerMap: removing container" podUID="2ecc44fb-b2c4-408f-8d31-860181ce53b7" containerName="insights-gathering"
Nov 04 05:36:08.314227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.314136    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ecc44fb-b2c4-408f-8d31-860181ce53b7" containerName="insights-gathering"
Nov 04 05:36:08.314283 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.314229    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ecc44fb-b2c4-408f-8d31-860181ce53b7" containerName="insights-gathering"
Nov 04 05:36:08.317193 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.317164    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.323008 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.322984    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 04 05:36:08.323125 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.323101    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-j9xrs\""
Nov 04 05:36:08.327599 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.327487    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"]
Nov 04 05:36:08.365080 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.365045    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:08.382529 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.382486    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"]
Nov 04 05:36:08.386565 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.386537    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.399430 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.399404    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"]
Nov 04 05:36:08.403360 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.403334    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-6rdpg\""
Nov 04 05:36:08.420758 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.420731    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.420912 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.420761    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.420912 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.420784    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.420912 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.420854    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.421044 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.420958    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.421044 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.420992    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.421044 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421012    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.421184 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421050    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.421184 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421121    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.421184 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421149    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.421184 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421167    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.421345 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421247    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87kvt\" (UniqueName: \"kubernetes.io/projected/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-kube-api-access-87kvt\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.421345 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421281    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.421345 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421306    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.421345 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421331    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqsfz\" (UniqueName: \"kubernetes.io/projected/ffe94fbe-c512-43cf-976f-f64c6dc2c358-kube-api-access-zqsfz\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.421511 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421358    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.421511 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421375    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.421511 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.421389    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.463684 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.463650    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:08.522225 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522190    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.522225 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522228    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.522482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522250    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.522482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522270    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.522482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522291    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.522482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522320    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.522482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522346    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.522482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522365    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87kvt\" (UniqueName: \"kubernetes.io/projected/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-kube-api-access-87kvt\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.522482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522389    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.522482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522421    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.522482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522457    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqsfz\" (UniqueName: \"kubernetes.io/projected/ffe94fbe-c512-43cf-976f-f64c6dc2c358-kube-api-access-zqsfz\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.522968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522489    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.522968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522536    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.522968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522561    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.522968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522618    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.522968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522641    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.522968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522675    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.522968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522703    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.522968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522774    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.522968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522787    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.522968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522772    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.522968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.522854    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.523527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.523038    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.523527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.523044    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.523527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.523136    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.523527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.523232    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.523527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.523296    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.523841 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.523818    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.524999 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.524972    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.525632 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.525604    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.525726 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.525703    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.525927 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.525907    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.535544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.535491    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqsfz\" (UniqueName: \"kubernetes.io/projected/ffe94fbe-c512-43cf-976f-f64c6dc2c358-kube-api-access-zqsfz\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.535544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.535528    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffe94fbe-c512-43cf-976f-f64c6dc2c358-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-6m8sf\" (UID: \"ffe94fbe-c512-43cf-976f-f64c6dc2c358\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.535681 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.535595    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.536047 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.536030    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87kvt\" (UniqueName: \"kubernetes.io/projected/4fee91e3-f9b7-4de9-9ec0-ac215dbca143-kube-api-access-87kvt\") pod \"openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc\" (UID: \"4fee91e3-f9b7-4de9-9ec0-ac215dbca143\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.577980 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.577890    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:08.630556 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.630519    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:08.703205 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.703171    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:08.905298 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.905215    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"]
Nov 04 05:36:08.908783 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:36:08.908751    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe94fbe_c512_43cf_976f_f64c6dc2c358.slice/crio-60cbe7676a55572f0edf5c15feec49b76f6dc85916e864935b3985adb1d325a5 WatchSource:0}: Error finding container 60cbe7676a55572f0edf5c15feec49b76f6dc85916e864935b3985adb1d325a5: Status 404 returned error can't find the container with id 60cbe7676a55572f0edf5c15feec49b76f6dc85916e864935b3985adb1d325a5
Nov 04 05:36:08.910738 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.910720    5079 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:36:08.975565 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:08.975381    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"]
Nov 04 05:36:08.978053 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:36:08.978026    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fee91e3_f9b7_4de9_9ec0_ac215dbca143.slice/crio-f4740c215b116585691920e0576781f9921cf6b035ab6f11b8ddd4d35724ce63 WatchSource:0}: Error finding container f4740c215b116585691920e0576781f9921cf6b035ab6f11b8ddd4d35724ce63: Status 404 returned error can't find the container with id f4740c215b116585691920e0576781f9921cf6b035ab6f11b8ddd4d35724ce63
Nov 04 05:36:09.265316 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:09.265281    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf" event={"ID":"ffe94fbe-c512-43cf-976f-f64c6dc2c358","Type":"ContainerStarted","Data":"60cbe7676a55572f0edf5c15feec49b76f6dc85916e864935b3985adb1d325a5"}
Nov 04 05:36:09.266474 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:09.266449    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc" event={"ID":"4fee91e3-f9b7-4de9-9ec0-ac215dbca143","Type":"ContainerStarted","Data":"f4740c215b116585691920e0576781f9921cf6b035ab6f11b8ddd4d35724ce63"}
Nov 04 05:36:10.913669 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:10.913633    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:12.269456 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:12.269419    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:36:12.269902 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:12.269546    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:36:12.269902 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:12.269602    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:36:13.055383 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:13.055350    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:36:13.055513 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:13.055419    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:36:13.055513 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:13.055449    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:36:13.293773 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:13.293740    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc" event={"ID":"4fee91e3-f9b7-4de9-9ec0-ac215dbca143","Type":"ContainerStarted","Data":"a25eb261755b2acbd7e881dca688a56c17d5a171eeea796a1c99d87086bba811"}
Nov 04 05:36:13.294181 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:13.293796    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf" event={"ID":"ffe94fbe-c512-43cf-976f-f64c6dc2c358","Type":"ContainerStarted","Data":"75d8b089a5612b02addf6482961f43f18956056055a73cf1cb591d6c34a8affa"}
Nov 04 05:36:13.310106 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:13.310007    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc" podStartSLOduration=1.235342495 podStartE2EDuration="5.309992828s" totalImagesPullingTime="4.074650333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:36:13.308727799 +0000 UTC m=+468.166715632" watchObservedRunningTime="2026-11-04 05:36:13.309992828 +0000 UTC m=+468.167980657"
Nov 04 05:36:13.326036 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:13.325982    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf" podStartSLOduration=1.9682349860000001 podStartE2EDuration="5.32596887s" totalImagesPullingTime="3.357733884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:36:13.325023615 +0000 UTC m=+468.183011445" watchObservedRunningTime="2026-11-04 05:36:13.32596887 +0000 UTC m=+468.183956691"
Nov 04 05:36:13.631322 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:13.631293    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:13.636491 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:13.636465    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:13.703940 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:13.703902    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:14.296865 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:14.296831    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:14.297784 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:14.297764    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:36:14.709999 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:14.709969    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:15.227993 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.227955    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:15.239546 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.239516    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"]
Nov 04 05:36:15.243321 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.243305    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:15.251842 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.250300    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 04 05:36:15.251842 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.250521    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-h69mf\""
Nov 04 05:36:15.251842 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.250606    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 04 05:36:15.251842 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.251776    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"]
Nov 04 05:36:15.300624 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.300591    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:15.301598 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.301578    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc"
Nov 04 05:36:15.381634 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.381601    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:15.382030 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.381999    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrctb\" (UniqueName: \"kubernetes.io/projected/490c80d6-7335-4334-ad7c-84df61b9a826-kube-api-access-vrctb\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:15.382252 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.382225    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:15.483589 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.483457    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:15.483589 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.483554    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrctb\" (UniqueName: \"kubernetes.io/projected/490c80d6-7335-4334-ad7c-84df61b9a826-kube-api-access-vrctb\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:15.483589 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.483582    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:15.483898 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.483855    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:15.483963 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.483925    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:15.491237 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.491214    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrctb\" (UniqueName: \"kubernetes.io/projected/490c80d6-7335-4334-ad7c-84df61b9a826-kube-api-access-vrctb\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:15.502667 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.502638    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"]
Nov 04 05:36:15.506613 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.506590    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:15.512802 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.512779    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-9scnv\""
Nov 04 05:36:15.514149 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.514085    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"]
Nov 04 05:36:15.560443 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.560407    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:15.584642 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.584609    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:15.584791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.584725    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:15.584791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.584765    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr9wk\" (UniqueName: \"kubernetes.io/projected/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-kube-api-access-fr9wk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:15.685256 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.685217    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:15.685434 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.685265    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr9wk\" (UniqueName: \"kubernetes.io/projected/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-kube-api-access-fr9wk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:15.685434 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.685319    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:15.685644 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.685623    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:15.685687 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.685654    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:15.694343 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.694313    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr9wk\" (UniqueName: \"kubernetes.io/projected/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-kube-api-access-fr9wk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:15.827347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.827272    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:15.831807 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:15.831783    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"]
Nov 04 05:36:15.834133 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:36:15.834099    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490c80d6_7335_4334_ad7c_84df61b9a826.slice/crio-f0661318efbe96a7655a0493d3c26e63afb6adb700c6d888fed9bd034c5a810b WatchSource:0}: Error finding container f0661318efbe96a7655a0493d3c26e63afb6adb700c6d888fed9bd034c5a810b: Status 404 returned error can't find the container with id f0661318efbe96a7655a0493d3c26e63afb6adb700c6d888fed9bd034c5a810b
Nov 04 05:36:16.103457 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:16.103371    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"]
Nov 04 05:36:16.106446 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:36:16.106420    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c063dd_eb0f_43dc_a397_80049b7c2cc2.slice/crio-a48bca420157034d5b34990f7822bae87ea2554dc3b55f1e8a1fa11775c36a67 WatchSource:0}: Error finding container a48bca420157034d5b34990f7822bae87ea2554dc3b55f1e8a1fa11775c36a67: Status 404 returned error can't find the container with id a48bca420157034d5b34990f7822bae87ea2554dc3b55f1e8a1fa11775c36a67
Nov 04 05:36:16.307359 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:16.307273    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss" event={"ID":"f7c063dd-eb0f-43dc-a397-80049b7c2cc2","Type":"ContainerStarted","Data":"a48bca420157034d5b34990f7822bae87ea2554dc3b55f1e8a1fa11775c36a67"}
Nov 04 05:36:16.308441 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:16.308415    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq" event={"ID":"490c80d6-7335-4334-ad7c-84df61b9a826","Type":"ContainerStarted","Data":"f0661318efbe96a7655a0493d3c26e63afb6adb700c6d888fed9bd034c5a810b"}
Nov 04 05:36:16.663116 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:36:16.663077    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:36:17.991724 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:17.991684    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"]
Nov 04 05:36:17.995809 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:17.995783    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:18.002223 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.002169    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-rvwxw\""
Nov 04 05:36:18.005533 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.005486    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"]
Nov 04 05:36:18.107759 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.107717    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:18.107956 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.107770    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hqdg\" (UniqueName: \"kubernetes.io/projected/7e33901e-f601-44d3-9756-dbdf9212a562-kube-api-access-9hqdg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:18.107956 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.107809    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:18.208973 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.208899    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:18.209170 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.208995    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hqdg\" (UniqueName: \"kubernetes.io/projected/7e33901e-f601-44d3-9756-dbdf9212a562-kube-api-access-9hqdg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:18.209170 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.209036    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:18.209395 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.209346    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:18.209560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.209539    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:18.218475 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.218431    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hqdg\" (UniqueName: \"kubernetes.io/projected/7e33901e-f601-44d3-9756-dbdf9212a562-kube-api-access-9hqdg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:18.323477 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.318060    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:18.605293 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:18.605169    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"]
Nov 04 05:36:18.611310 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:36:18.611281    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e33901e_f601_44d3_9756_dbdf9212a562.slice/crio-e4957e51f85bc626dd40adf08ac87e5d3ef4325a60591e512f1d4a76fb5d521a WatchSource:0}: Error finding container e4957e51f85bc626dd40adf08ac87e5d3ef4325a60591e512f1d4a76fb5d521a: Status 404 returned error can't find the container with id e4957e51f85bc626dd40adf08ac87e5d3ef4325a60591e512f1d4a76fb5d521a
Nov 04 05:36:19.329240 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:19.329192    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s" event={"ID":"7e33901e-f601-44d3-9756-dbdf9212a562","Type":"ContainerStarted","Data":"e4957e51f85bc626dd40adf08ac87e5d3ef4325a60591e512f1d4a76fb5d521a"}
Nov 04 05:36:23.352628 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:23.352529    5079 generic.go:356] "Generic (PLEG): container finished" podID="f7c063dd-eb0f-43dc-a397-80049b7c2cc2" containerID="78178911c19acca85c00d82bbf308a786d348b4a85f406d8dfd218c65aa7367b" exitCode=0
Nov 04 05:36:23.352628 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:23.352613    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss" event={"ID":"f7c063dd-eb0f-43dc-a397-80049b7c2cc2","Type":"ContainerDied","Data":"78178911c19acca85c00d82bbf308a786d348b4a85f406d8dfd218c65aa7367b"}
Nov 04 05:36:23.354327 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:23.354297    5079 generic.go:356] "Generic (PLEG): container finished" podID="490c80d6-7335-4334-ad7c-84df61b9a826" containerID="16f76dc9ea7938c9dc81e32996f34a007c49462c36143ba61bb59c6da5f055bb" exitCode=0
Nov 04 05:36:23.354432 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:23.354387    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq" event={"ID":"490c80d6-7335-4334-ad7c-84df61b9a826","Type":"ContainerDied","Data":"16f76dc9ea7938c9dc81e32996f34a007c49462c36143ba61bb59c6da5f055bb"}
Nov 04 05:36:23.355998 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:23.355975    5079 generic.go:356] "Generic (PLEG): container finished" podID="7e33901e-f601-44d3-9756-dbdf9212a562" containerID="88fba07576086545b16b68763516ab3b62190dc1d6a4667191a7bd5f9866c7e7" exitCode=0
Nov 04 05:36:23.356126 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:23.356014    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s" event={"ID":"7e33901e-f601-44d3-9756-dbdf9212a562","Type":"ContainerDied","Data":"88fba07576086545b16b68763516ab3b62190dc1d6a4667191a7bd5f9866c7e7"}
Nov 04 05:36:24.363375 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:24.363333    5079 generic.go:356] "Generic (PLEG): container finished" podID="f7c063dd-eb0f-43dc-a397-80049b7c2cc2" containerID="40e625a0622d9bb75167b627b77d69d1fc9a82e02f1220873d721413c054009a" exitCode=0
Nov 04 05:36:24.363912 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:24.363517    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss" event={"ID":"f7c063dd-eb0f-43dc-a397-80049b7c2cc2","Type":"ContainerDied","Data":"40e625a0622d9bb75167b627b77d69d1fc9a82e02f1220873d721413c054009a"}
Nov 04 05:36:26.376337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:26.376294    5079 generic.go:356] "Generic (PLEG): container finished" podID="490c80d6-7335-4334-ad7c-84df61b9a826" containerID="fc42b8cb7279319929dd3fc21179c3b4ba27f2ad1c8fb5c834f3ba7f2542a974" exitCode=0
Nov 04 05:36:26.376837 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:26.376387    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq" event={"ID":"490c80d6-7335-4334-ad7c-84df61b9a826","Type":"ContainerDied","Data":"fc42b8cb7279319929dd3fc21179c3b4ba27f2ad1c8fb5c834f3ba7f2542a974"}
Nov 04 05:36:31.410707 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:31.410675    5079 generic.go:356] "Generic (PLEG): container finished" podID="f7c063dd-eb0f-43dc-a397-80049b7c2cc2" containerID="c4d5d77dc9685d0545d3228d7f881c619cd744e5ae51e00610f52eda886947d4" exitCode=0
Nov 04 05:36:31.411077 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:31.410754    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss" event={"ID":"f7c063dd-eb0f-43dc-a397-80049b7c2cc2","Type":"ContainerDied","Data":"c4d5d77dc9685d0545d3228d7f881c619cd744e5ae51e00610f52eda886947d4"}
Nov 04 05:36:32.418600 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.418559    5079 generic.go:356] "Generic (PLEG): container finished" podID="7e33901e-f601-44d3-9756-dbdf9212a562" containerID="42228b9e6f93237aa5ac574709ac6641e97c859dfaec3cc5676f0000a7ca1505" exitCode=0
Nov 04 05:36:32.419095 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.418639    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s" event={"ID":"7e33901e-f601-44d3-9756-dbdf9212a562","Type":"ContainerDied","Data":"42228b9e6f93237aa5ac574709ac6641e97c859dfaec3cc5676f0000a7ca1505"}
Nov 04 05:36:32.561622 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.561591    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:32.654713 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.654677    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-bundle\") pod \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") "
Nov 04 05:36:32.654867 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.654741    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-util\" (UniqueName: \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-util\") pod \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") "
Nov 04 05:36:32.654867 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.654771    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-kube-api-access-fr9wk\" (UniqueName: \"kubernetes.io/projected/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-kube-api-access-fr9wk\") pod \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\" (UID: \"f7c063dd-eb0f-43dc-a397-80049b7c2cc2\") "
Nov 04 05:36:32.655311 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.655288    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-bundle" pod "f7c063dd-eb0f-43dc-a397-80049b7c2cc2" (UID: "f7c063dd-eb0f-43dc-a397-80049b7c2cc2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:36:32.657089 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.657067    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-kube-api-access-fr9wk" pod "f7c063dd-eb0f-43dc-a397-80049b7c2cc2" (UID: "f7c063dd-eb0f-43dc-a397-80049b7c2cc2"). InnerVolumeSpecName "kube-api-access-fr9wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:36:32.661005 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.660971    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-util" pod "f7c063dd-eb0f-43dc-a397-80049b7c2cc2" (UID: "f7c063dd-eb0f-43dc-a397-80049b7c2cc2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:36:32.756013 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.755991    5079 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-bundle\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:36:32.756083 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.756018    5079 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-util\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:36:32.756083 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:32.756029    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr9wk\" (UniqueName: \"kubernetes.io/projected/f7c063dd-eb0f-43dc-a397-80049b7c2cc2-kube-api-access-fr9wk\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:36:33.238026 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:33.237991    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:33.425115 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:33.425083    5079 generic.go:356] "Generic (PLEG): container finished" podID="490c80d6-7335-4334-ad7c-84df61b9a826" containerID="88a97f744f1cf9f8fa0a34dfc692f7aebc491c7ed6bbe00c8b180c4c9bcac5d6" exitCode=0
Nov 04 05:36:33.425591 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:33.425161    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq" event={"ID":"490c80d6-7335-4334-ad7c-84df61b9a826","Type":"ContainerDied","Data":"88a97f744f1cf9f8fa0a34dfc692f7aebc491c7ed6bbe00c8b180c4c9bcac5d6"}
Nov 04 05:36:33.427332 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:33.427311    5079 generic.go:356] "Generic (PLEG): container finished" podID="7e33901e-f601-44d3-9756-dbdf9212a562" containerID="fd4fc554a2091d1c1ae317fd5cc8dc6d2d9a3b025f27778e6168a6f20b63abd7" exitCode=0
Nov 04 05:36:33.427431 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:33.427389    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s" event={"ID":"7e33901e-f601-44d3-9756-dbdf9212a562","Type":"ContainerDied","Data":"fd4fc554a2091d1c1ae317fd5cc8dc6d2d9a3b025f27778e6168a6f20b63abd7"}
Nov 04 05:36:33.429312 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:33.429291    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss" event={"ID":"f7c063dd-eb0f-43dc-a397-80049b7c2cc2","Type":"ContainerDied","Data":"a48bca420157034d5b34990f7822bae87ea2554dc3b55f1e8a1fa11775c36a67"}
Nov 04 05:36:33.429417 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:33.429318    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71zjdss"
Nov 04 05:36:33.429417 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:33.429325    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a48bca420157034d5b34990f7822bae87ea2554dc3b55f1e8a1fa11775c36a67"
Nov 04 05:36:34.564618 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.564592    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:34.595761 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.595731    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:34.674120 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.674086    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-bundle\" (UniqueName: \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-bundle\") pod \"490c80d6-7335-4334-ad7c-84df61b9a826\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") "
Nov 04 05:36:34.674120 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.674127    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-util\" (UniqueName: \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-util\") pod \"490c80d6-7335-4334-ad7c-84df61b9a826\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") "
Nov 04 05:36:34.674328 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.674169    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/490c80d6-7335-4334-ad7c-84df61b9a826-kube-api-access-vrctb\" (UniqueName: \"kubernetes.io/projected/490c80d6-7335-4334-ad7c-84df61b9a826-kube-api-access-vrctb\") pod \"490c80d6-7335-4334-ad7c-84df61b9a826\" (UID: \"490c80d6-7335-4334-ad7c-84df61b9a826\") "
Nov 04 05:36:34.674781 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.674757    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-bundle" pod "490c80d6-7335-4334-ad7c-84df61b9a826" (UID: "490c80d6-7335-4334-ad7c-84df61b9a826"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:36:34.676434 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.676406    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490c80d6-7335-4334-ad7c-84df61b9a826-kube-api-access-vrctb" pod "490c80d6-7335-4334-ad7c-84df61b9a826" (UID: "490c80d6-7335-4334-ad7c-84df61b9a826"). InnerVolumeSpecName "kube-api-access-vrctb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:36:34.679649 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.679629    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-util" pod "490c80d6-7335-4334-ad7c-84df61b9a826" (UID: "490c80d6-7335-4334-ad7c-84df61b9a826"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:36:34.774884 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.774777    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-util\" (UniqueName: \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-util\") pod \"7e33901e-f601-44d3-9756-dbdf9212a562\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") "
Nov 04 05:36:34.774884 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.774848    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-bundle\") pod \"7e33901e-f601-44d3-9756-dbdf9212a562\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") "
Nov 04 05:36:34.774884 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.774874    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e33901e-f601-44d3-9756-dbdf9212a562-kube-api-access-9hqdg\" (UniqueName: \"kubernetes.io/projected/7e33901e-f601-44d3-9756-dbdf9212a562-kube-api-access-9hqdg\") pod \"7e33901e-f601-44d3-9756-dbdf9212a562\" (UID: \"7e33901e-f601-44d3-9756-dbdf9212a562\") "
Nov 04 05:36:34.775193 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.775041    5079 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-bundle\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:36:34.775193 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.775053    5079 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/490c80d6-7335-4334-ad7c-84df61b9a826-util\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:36:34.775193 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.775063    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrctb\" (UniqueName: \"kubernetes.io/projected/490c80d6-7335-4334-ad7c-84df61b9a826-kube-api-access-vrctb\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:36:34.775477 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.775447    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-bundle" pod "7e33901e-f601-44d3-9756-dbdf9212a562" (UID: "7e33901e-f601-44d3-9756-dbdf9212a562"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:36:34.777034 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.777008    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e33901e-f601-44d3-9756-dbdf9212a562-kube-api-access-9hqdg" pod "7e33901e-f601-44d3-9756-dbdf9212a562" (UID: "7e33901e-f601-44d3-9756-dbdf9212a562"). InnerVolumeSpecName "kube-api-access-9hqdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:36:34.779209 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.779180    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-util" pod "7e33901e-f601-44d3-9756-dbdf9212a562" (UID: "7e33901e-f601-44d3-9756-dbdf9212a562"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:36:34.875774 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.875731    5079 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-util\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:36:34.875774 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.875766    5079 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e33901e-f601-44d3-9756-dbdf9212a562-bundle\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:36:34.875774 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:34.875776    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hqdg\" (UniqueName: \"kubernetes.io/projected/7e33901e-f601-44d3-9756-dbdf9212a562-kube-api-access-9hqdg\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:36:35.439182 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:35.439144    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq" event={"ID":"490c80d6-7335-4334-ad7c-84df61b9a826","Type":"ContainerDied","Data":"f0661318efbe96a7655a0493d3c26e63afb6adb700c6d888fed9bd034c5a810b"}
Nov 04 05:36:35.439182 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:35.439170    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cj9nbq"
Nov 04 05:36:35.439430 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:35.439196    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0661318efbe96a7655a0493d3c26e63afb6adb700c6d888fed9bd034c5a810b"
Nov 04 05:36:35.441340 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:35.441311    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s" event={"ID":"7e33901e-f601-44d3-9756-dbdf9212a562","Type":"ContainerDied","Data":"e4957e51f85bc626dd40adf08ac87e5d3ef4325a60591e512f1d4a76fb5d521a"}
Nov 04 05:36:35.441536 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:35.441338    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847agt79s"
Nov 04 05:36:35.441536 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:35.441358    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4957e51f85bc626dd40adf08ac87e5d3ef4325a60591e512f1d4a76fb5d521a"
Nov 04 05:36:36.933687 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:36.933656    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:38.146548 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:38.146494    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:39.435311 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435277    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w"]
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435627    5079 cpu_manager.go:414] "containerMap: removing container" podUID="490c80d6-7335-4334-ad7c-84df61b9a826" containerName="pull"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435642    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="490c80d6-7335-4334-ad7c-84df61b9a826" containerName="pull"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435658    5079 cpu_manager.go:414] "containerMap: removing container" podUID="7e33901e-f601-44d3-9756-dbdf9212a562" containerName="util"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435663    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e33901e-f601-44d3-9756-dbdf9212a562" containerName="util"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435673    5079 cpu_manager.go:414] "containerMap: removing container" podUID="490c80d6-7335-4334-ad7c-84df61b9a826" containerName="extract"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435678    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="490c80d6-7335-4334-ad7c-84df61b9a826" containerName="extract"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435687    5079 cpu_manager.go:414] "containerMap: removing container" podUID="f7c063dd-eb0f-43dc-a397-80049b7c2cc2" containerName="util"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435707    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7c063dd-eb0f-43dc-a397-80049b7c2cc2" containerName="util"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435716    5079 cpu_manager.go:414] "containerMap: removing container" podUID="f7c063dd-eb0f-43dc-a397-80049b7c2cc2" containerName="extract"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435721    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7c063dd-eb0f-43dc-a397-80049b7c2cc2" containerName="extract"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435737    5079 cpu_manager.go:414] "containerMap: removing container" podUID="490c80d6-7335-4334-ad7c-84df61b9a826" containerName="util"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435742    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="490c80d6-7335-4334-ad7c-84df61b9a826" containerName="util"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435748    5079 cpu_manager.go:414] "containerMap: removing container" podUID="f7c063dd-eb0f-43dc-a397-80049b7c2cc2" containerName="pull"
Nov 04 05:36:39.435748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435753    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7c063dd-eb0f-43dc-a397-80049b7c2cc2" containerName="pull"
Nov 04 05:36:39.436150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435763    5079 cpu_manager.go:414] "containerMap: removing container" podUID="7e33901e-f601-44d3-9756-dbdf9212a562" containerName="pull"
Nov 04 05:36:39.436150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435768    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e33901e-f601-44d3-9756-dbdf9212a562" containerName="pull"
Nov 04 05:36:39.436150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435773    5079 cpu_manager.go:414] "containerMap: removing container" podUID="7e33901e-f601-44d3-9756-dbdf9212a562" containerName="extract"
Nov 04 05:36:39.436150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435779    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e33901e-f601-44d3-9756-dbdf9212a562" containerName="extract"
Nov 04 05:36:39.436150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435830    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e33901e-f601-44d3-9756-dbdf9212a562" containerName="extract"
Nov 04 05:36:39.436150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435840    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="490c80d6-7335-4334-ad7c-84df61b9a826" containerName="extract"
Nov 04 05:36:39.436150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.435846    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7c063dd-eb0f-43dc-a397-80049b7c2cc2" containerName="extract"
Nov 04 05:36:39.445675 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.445651    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w"
Nov 04 05:36:39.451568 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.451538    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w"]
Nov 04 05:36:39.453544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.453523    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Nov 04 05:36:39.453753 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.453739    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Nov 04 05:36:39.453849 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.453572    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5mczw\""
Nov 04 05:36:39.512483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.512448    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sph4b\" (UniqueName: \"kubernetes.io/projected/5e374217-ee10-4f79-ac34-f792c66cfc08-kube-api-access-sph4b\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-f845w\" (UID: \"5e374217-ee10-4f79-ac34-f792c66cfc08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w"
Nov 04 05:36:39.512483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.512490    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e374217-ee10-4f79-ac34-f792c66cfc08-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-f845w\" (UID: \"5e374217-ee10-4f79-ac34-f792c66cfc08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w"
Nov 04 05:36:39.613419 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.613386    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e374217-ee10-4f79-ac34-f792c66cfc08-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-f845w\" (UID: \"5e374217-ee10-4f79-ac34-f792c66cfc08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w"
Nov 04 05:36:39.613642 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.613471    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sph4b\" (UniqueName: \"kubernetes.io/projected/5e374217-ee10-4f79-ac34-f792c66cfc08-kube-api-access-sph4b\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-f845w\" (UID: \"5e374217-ee10-4f79-ac34-f792c66cfc08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w"
Nov 04 05:36:39.613805 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.613784    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e374217-ee10-4f79-ac34-f792c66cfc08-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-f845w\" (UID: \"5e374217-ee10-4f79-ac34-f792c66cfc08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w"
Nov 04 05:36:39.621475 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.621447    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sph4b\" (UniqueName: \"kubernetes.io/projected/5e374217-ee10-4f79-ac34-f792c66cfc08-kube-api-access-sph4b\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-f845w\" (UID: \"5e374217-ee10-4f79-ac34-f792c66cfc08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w"
Nov 04 05:36:39.774933 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:39.774846    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w"
Nov 04 05:36:40.065137 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:40.065110    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w"]
Nov 04 05:36:40.066801 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:36:40.066773    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e374217_ee10_4f79_ac34_f792c66cfc08.slice/crio-b69d752001885919ee211b85c1108d7f2ff56ffe5e8d59fe623f49d9eda67204 WatchSource:0}: Error finding container b69d752001885919ee211b85c1108d7f2ff56ffe5e8d59fe623f49d9eda67204: Status 404 returned error can't find the container with id b69d752001885919ee211b85c1108d7f2ff56ffe5e8d59fe623f49d9eda67204
Nov 04 05:36:40.468797 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:40.468763    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w" event={"ID":"5e374217-ee10-4f79-ac34-f792c66cfc08","Type":"ContainerStarted","Data":"b69d752001885919ee211b85c1108d7f2ff56ffe5e8d59fe623f49d9eda67204"}
Nov 04 05:36:41.545560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:41.545493    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:41.655990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:41.655952    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:42.145164 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:42.145130    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:42.329398 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:42.329355    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:42.479690 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:42.479649    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w" event={"ID":"5e374217-ee10-4f79-ac34-f792c66cfc08","Type":"ContainerStarted","Data":"ea10f76a9ce9c8bcf8cc8a8dc131f80e12fdf46ac24d1676912189e8ac942b48"}
Nov 04 05:36:42.501526 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:42.501454    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-f845w" podStartSLOduration=1.83798241 podStartE2EDuration="3.501437622s" totalImagesPullingTime="1.663455212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:36:42.498819822 +0000 UTC m=+497.356807642" watchObservedRunningTime="2026-11-04 05:36:42.501437622 +0000 UTC m=+497.359425452"
Nov 04 05:36:43.438989 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.438959    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:43.566117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.566077    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:43.580491 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.580461    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"]
Nov 04 05:36:43.583402 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.583385    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.590273 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.589964    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 04 05:36:43.590273 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.590151    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 04 05:36:43.590273 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.590213    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-vkh6g\""
Nov 04 05:36:43.591535 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.591511    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 04 05:36:43.594916 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.594896    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 04 05:36:43.595159 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.595145    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 04 05:36:43.627622 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.627591    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"]
Nov 04 05:36:43.646297 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.646264    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e721b740-6386-42e4-a1fb-dfbc1137928a-metrics-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.646477 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.646345    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr64f\" (UniqueName: \"kubernetes.io/projected/e721b740-6386-42e4-a1fb-dfbc1137928a-kube-api-access-hr64f\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.646477 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.646407    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e721b740-6386-42e4-a1fb-dfbc1137928a-manifests\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.646602 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.646472    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e721b740-6386-42e4-a1fb-dfbc1137928a-tmp\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.646602 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.646527    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e721b740-6386-42e4-a1fb-dfbc1137928a-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.646602 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.646560    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e721b740-6386-42e4-a1fb-dfbc1137928a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.747340 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.747252    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr64f\" (UniqueName: \"kubernetes.io/projected/e721b740-6386-42e4-a1fb-dfbc1137928a-kube-api-access-hr64f\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.747340 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.747294    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e721b740-6386-42e4-a1fb-dfbc1137928a-manifests\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.747340 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.747328    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e721b740-6386-42e4-a1fb-dfbc1137928a-tmp\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.747666 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.747356    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e721b740-6386-42e4-a1fb-dfbc1137928a-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.747666 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.747396    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e721b740-6386-42e4-a1fb-dfbc1137928a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.747666 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.747433    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e721b740-6386-42e4-a1fb-dfbc1137928a-metrics-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.747816 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.747788    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e721b740-6386-42e4-a1fb-dfbc1137928a-manifests\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.749901 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.749874    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e721b740-6386-42e4-a1fb-dfbc1137928a-tmp\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.750025 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.749957    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e721b740-6386-42e4-a1fb-dfbc1137928a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.750097 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.750078    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e721b740-6386-42e4-a1fb-dfbc1137928a-webhook-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.750097 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.750089    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e721b740-6386-42e4-a1fb-dfbc1137928a-metrics-cert\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.765971 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.765947    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr64f\" (UniqueName: \"kubernetes.io/projected/e721b740-6386-42e4-a1fb-dfbc1137928a-kube-api-access-hr64f\") pod \"opendatahub-operator-controller-manager-56cd9ffd8-nfw2h\" (UID: \"e721b740-6386-42e4-a1fb-dfbc1137928a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:43.778855 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.778826    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:43.880487 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.880453    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:43.898942 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:43.898916    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:44.009972 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:44.009884    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:44.111904 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:44.111868    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:44.274055 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:44.273962    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:44.276706 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:44.276682    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"]
Nov 04 05:36:44.278033 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:36:44.278003    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode721b740_6386_42e4_a1fb_dfbc1137928a.slice/crio-8a1b736d1a0cb17bab23d33b50e4e229c13efb75bee20da8b0e51a821cc5af97 WatchSource:0}: Error finding container 8a1b736d1a0cb17bab23d33b50e4e229c13efb75bee20da8b0e51a821cc5af97: Status 404 returned error can't find the container with id 8a1b736d1a0cb17bab23d33b50e4e229c13efb75bee20da8b0e51a821cc5af97
Nov 04 05:36:44.391801 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:44.391740    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:44.488887 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:44.488850    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h" event={"ID":"e721b740-6386-42e4-a1fb-dfbc1137928a","Type":"ContainerStarted","Data":"8a1b736d1a0cb17bab23d33b50e4e229c13efb75bee20da8b0e51a821cc5af97"}
Nov 04 05:36:45.620852 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:45.620814    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:45.838893 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:45.838855    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:46.660748 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:36:46.660683    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:36:46.744276 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:46.744238    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:46.844772 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:46.844732    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:47.506678 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:47.506638    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h" event={"ID":"e721b740-6386-42e4-a1fb-dfbc1137928a","Type":"ContainerStarted","Data":"b8e7198e6e2cbd122eac5c25f04f68e5673049d07145c3b2bb58f2e00fc6189f"}
Nov 04 05:36:48.513218 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:48.513184    5079 generic.go:356] "Generic (PLEG): container finished" podID="e721b740-6386-42e4-a1fb-dfbc1137928a" containerID="b8e7198e6e2cbd122eac5c25f04f68e5673049d07145c3b2bb58f2e00fc6189f" exitCode=0
Nov 04 05:36:48.513643 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:48.513255    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h" event={"ID":"e721b740-6386-42e4-a1fb-dfbc1137928a","Type":"ContainerDied","Data":"b8e7198e6e2cbd122eac5c25f04f68e5673049d07145c3b2bb58f2e00fc6189f"}
Nov 04 05:36:49.524358 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:49.524314    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h" event={"ID":"e721b740-6386-42e4-a1fb-dfbc1137928a","Type":"ContainerStarted","Data":"9c7494157a8a5460dcd638d30dbeee6208e6e9b2fd0159329a7b68776dbd947d"}
Nov 04 05:36:49.524829 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:49.524486    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:36:49.566787 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:49.566734    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h" podStartSLOduration=2.636071882 podStartE2EDuration="6.566719837s" totalImagesPullingTime="3.400812061s" totalInitContainerRuntime="529.835894ms" isStatefulPod=false podCreationTimestamp="2026-11-04 05:36:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:36:49.564244973 +0000 UTC m=+504.422232803" watchObservedRunningTime="2026-11-04 05:36:49.566719837 +0000 UTC m=+504.424707658"
Nov 04 05:36:49.937870 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:49.937839    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:50.841785 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:50.841748    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:50.940696 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:50.940640    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:51.072111 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:51.072084    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:52.548953 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:52.548921    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:52.652479 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:52.652442    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:53.832002 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:53.831968    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:55.232699 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:55.232665    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk"]
Nov 04 05:36:55.239239 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:55.239214    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk"
Nov 04 05:36:55.243749 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:55.243713    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 04 05:36:55.243749 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:55.243730    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 04 05:36:55.244848 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:55.244830    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-w5sm6\""
Nov 04 05:36:55.248578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:55.248557    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk"]
Nov 04 05:36:55.355921 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:55.355887    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kddsj\" (UniqueName: \"kubernetes.io/projected/332adc32-bf35-47e2-ae29-4eaf1bcef74a-kube-api-access-kddsj\") pod \"authorino-operator-7b7bb4bc77-pfgtk\" (UID: \"332adc32-bf35-47e2-ae29-4eaf1bcef74a\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk"
Nov 04 05:36:55.456707 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:55.456670    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kddsj\" (UniqueName: \"kubernetes.io/projected/332adc32-bf35-47e2-ae29-4eaf1bcef74a-kube-api-access-kddsj\") pod \"authorino-operator-7b7bb4bc77-pfgtk\" (UID: \"332adc32-bf35-47e2-ae29-4eaf1bcef74a\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk"
Nov 04 05:36:55.464886 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:55.464861    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kddsj\" (UniqueName: \"kubernetes.io/projected/332adc32-bf35-47e2-ae29-4eaf1bcef74a-kube-api-access-kddsj\") pod \"authorino-operator-7b7bb4bc77-pfgtk\" (UID: \"332adc32-bf35-47e2-ae29-4eaf1bcef74a\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk"
Nov 04 05:36:55.554263 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:55.554181    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk"
Nov 04 05:36:55.831929 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:55.831903    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk"]
Nov 04 05:36:55.834330 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:36:55.834301    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332adc32_bf35_47e2_ae29_4eaf1bcef74a.slice/crio-c5c65d55789fc640f6388583efdb87006311f470c4aa5a4f3400a3fdbc439e6d WatchSource:0}: Error finding container c5c65d55789fc640f6388583efdb87006311f470c4aa5a4f3400a3fdbc439e6d: Status 404 returned error can't find the container with id c5c65d55789fc640f6388583efdb87006311f470c4aa5a4f3400a3fdbc439e6d
Nov 04 05:36:56.162915 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:56.162824    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:56.269898 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:56.269863    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:56.552544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:56.552492    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:56.555420 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:56.555390    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk" event={"ID":"332adc32-bf35-47e2-ae29-4eaf1bcef74a","Type":"ContainerStarted","Data":"c5c65d55789fc640f6388583efdb87006311f470c4aa5a4f3400a3fdbc439e6d"}
Nov 04 05:36:58.166677 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:58.166641    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:36:59.571395 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.571342    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk" event={"ID":"332adc32-bf35-47e2-ae29-4eaf1bcef74a","Type":"ContainerStarted","Data":"8d0e33f3584d53ab652921ef5905c0da5fc987c837574c5ff919d2be09fd1698"}
Nov 04 05:36:59.571852 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.571438    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk"
Nov 04 05:36:59.592190 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.592139    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk" podStartSLOduration=1.733082958 podStartE2EDuration="4.592125034s" totalImagesPullingTime="2.859042076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:36:59.590229535 +0000 UTC m=+514.448217365" watchObservedRunningTime="2026-11-04 05:36:59.592125034 +0000 UTC m=+514.450112857"
Nov 04 05:36:59.649419 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.649385    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk"]
Nov 04 05:36:59.652873 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.652852    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk"
Nov 04 05:36:59.656255 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.656227    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Nov 04 05:36:59.656255 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.656237    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-h5mm5\""
Nov 04 05:36:59.664994 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.664970    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk"]
Nov 04 05:36:59.800636 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.800599    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrwnv\" (UniqueName: \"kubernetes.io/projected/cc28d785-961f-4cc6-8346-a9439d7dfa7d-kube-api-access-rrwnv\") pod \"dns-operator-controller-manager-8557cbdb84-pfrmk\" (UID: \"cc28d785-961f-4cc6-8346-a9439d7dfa7d\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk"
Nov 04 05:36:59.901894 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.901807    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrwnv\" (UniqueName: \"kubernetes.io/projected/cc28d785-961f-4cc6-8346-a9439d7dfa7d-kube-api-access-rrwnv\") pod \"dns-operator-controller-manager-8557cbdb84-pfrmk\" (UID: \"cc28d785-961f-4cc6-8346-a9439d7dfa7d\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk"
Nov 04 05:36:59.910178 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.910147    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrwnv\" (UniqueName: \"kubernetes.io/projected/cc28d785-961f-4cc6-8346-a9439d7dfa7d-kube-api-access-rrwnv\") pod \"dns-operator-controller-manager-8557cbdb84-pfrmk\" (UID: \"cc28d785-961f-4cc6-8346-a9439d7dfa7d\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk"
Nov 04 05:36:59.966121 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:36:59.966085    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk"
Nov 04 05:37:00.243765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:00.243713    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk"]
Nov 04 05:37:00.246373 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:37:00.246348    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc28d785_961f_4cc6_8346_a9439d7dfa7d.slice/crio-a752f5e36b0265a9b73c8ca5fc17f99071d0d1ed86bbefdf18b83c7ce337d8b0 WatchSource:0}: Error finding container a752f5e36b0265a9b73c8ca5fc17f99071d0d1ed86bbefdf18b83c7ce337d8b0: Status 404 returned error can't find the container with id a752f5e36b0265a9b73c8ca5fc17f99071d0d1ed86bbefdf18b83c7ce337d8b0
Nov 04 05:37:00.531496 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:00.531419    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-56cd9ffd8-nfw2h"
Nov 04 05:37:00.577437 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:00.577386    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk" event={"ID":"cc28d785-961f-4cc6-8346-a9439d7dfa7d","Type":"ContainerStarted","Data":"a752f5e36b0265a9b73c8ca5fc17f99071d0d1ed86bbefdf18b83c7ce337d8b0"}
Nov 04 05:37:00.786244 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:00.786155    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:00.946133 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:00.946100    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:03.400022 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:03.399983    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:03.597257 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:03.597202    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk" event={"ID":"cc28d785-961f-4cc6-8346-a9439d7dfa7d","Type":"ContainerStarted","Data":"26a4026a0eddcb606dc04bff44e1319ce1fc6b4271b4f0ca1398740880000182"}
Nov 04 05:37:03.597468 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:03.597447    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk"
Nov 04 05:37:03.619747 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:03.619696    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk" podStartSLOduration=2.171956738 podStartE2EDuration="4.619677984s" totalImagesPullingTime="2.447721246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:37:03.617642571 +0000 UTC m=+518.475630413" watchObservedRunningTime="2026-11-04 05:37:03.619677984 +0000 UTC m=+518.477665814"
Nov 04 05:37:03.893658 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:03.893618    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg"]
Nov 04 05:37:03.895896 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:03.895878    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg"
Nov 04 05:37:03.904265 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:03.904237    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-nd9t9\""
Nov 04 05:37:03.906643 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:03.906618    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg"]
Nov 04 05:37:04.041900 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:04.041858    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scwsv\" (UniqueName: \"kubernetes.io/projected/f1e10797-fe13-4d1b-99d1-f45d6ea59671-kube-api-access-scwsv\") pod \"limitador-operator-controller-manager-5778bb4449-sgjcg\" (UID: \"f1e10797-fe13-4d1b-99d1-f45d6ea59671\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg"
Nov 04 05:37:04.142697 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:04.142654    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scwsv\" (UniqueName: \"kubernetes.io/projected/f1e10797-fe13-4d1b-99d1-f45d6ea59671-kube-api-access-scwsv\") pod \"limitador-operator-controller-manager-5778bb4449-sgjcg\" (UID: \"f1e10797-fe13-4d1b-99d1-f45d6ea59671\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg"
Nov 04 05:37:04.151954 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:04.151885    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scwsv\" (UniqueName: \"kubernetes.io/projected/f1e10797-fe13-4d1b-99d1-f45d6ea59671-kube-api-access-scwsv\") pod \"limitador-operator-controller-manager-5778bb4449-sgjcg\" (UID: \"f1e10797-fe13-4d1b-99d1-f45d6ea59671\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg"
Nov 04 05:37:04.208627 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:04.208590    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg"
Nov 04 05:37:04.479888 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:04.479861    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg"]
Nov 04 05:37:04.482258 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:37:04.482233    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e10797_fe13_4d1b_99d1_f45d6ea59671.slice/crio-492c3a4cd3be655def13aa7a0c7550589dde9a2ea186f995e52e2d0f93c3c018 WatchSource:0}: Error finding container 492c3a4cd3be655def13aa7a0c7550589dde9a2ea186f995e52e2d0f93c3c018: Status 404 returned error can't find the container with id 492c3a4cd3be655def13aa7a0c7550589dde9a2ea186f995e52e2d0f93c3c018
Nov 04 05:37:04.603513 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:04.603475    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg" event={"ID":"f1e10797-fe13-4d1b-99d1-f45d6ea59671","Type":"ContainerStarted","Data":"492c3a4cd3be655def13aa7a0c7550589dde9a2ea186f995e52e2d0f93c3c018"}
Nov 04 05:37:04.725704 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:04.725668    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:05.187973 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:05.187935    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:05.562778 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:05.562696    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:05.680843 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:05.680810    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:06.136102 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:06.136061    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:06.239246 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:06.239217    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:07.619054 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:07.619012    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg" event={"ID":"f1e10797-fe13-4d1b-99d1-f45d6ea59671","Type":"ContainerStarted","Data":"66ce8d58e8348f0d5e6acdfa3af03d858aac8592aeda39e39b2ca3b17ff7c468"}
Nov 04 05:37:07.619467 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:07.619087    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg"
Nov 04 05:37:07.635926 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:07.635879    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg" podStartSLOduration=2.472969283 podStartE2EDuration="4.635864772s" totalImagesPullingTime="2.162895489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:37:07.635442488 +0000 UTC m=+522.493430320" watchObservedRunningTime="2026-11-04 05:37:07.635864772 +0000 UTC m=+522.493852601"
Nov 04 05:37:09.720795 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:09.720760    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"]
Nov 04 05:37:09.724370 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:09.724350    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"
Nov 04 05:37:09.735636 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:09.735605    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2dg95\""
Nov 04 05:37:09.738647 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:09.738618    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"]
Nov 04 05:37:09.895099 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:09.895067    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9975e9d8-c75c-4088-9750-aa17233fc931-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-qq5sn\" (UID: \"9975e9d8-c75c-4088-9750-aa17233fc931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"
Nov 04 05:37:09.895099 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:09.895102    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7m6w\" (UniqueName: \"kubernetes.io/projected/9975e9d8-c75c-4088-9750-aa17233fc931-kube-api-access-r7m6w\") pod \"kuadrant-operator-controller-manager-678d87766f-qq5sn\" (UID: \"9975e9d8-c75c-4088-9750-aa17233fc931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"
Nov 04 05:37:09.996713 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:09.996607    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9975e9d8-c75c-4088-9750-aa17233fc931-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-qq5sn\" (UID: \"9975e9d8-c75c-4088-9750-aa17233fc931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"
Nov 04 05:37:09.996713 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:09.996654    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7m6w\" (UniqueName: \"kubernetes.io/projected/9975e9d8-c75c-4088-9750-aa17233fc931-kube-api-access-r7m6w\") pod \"kuadrant-operator-controller-manager-678d87766f-qq5sn\" (UID: \"9975e9d8-c75c-4088-9750-aa17233fc931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"
Nov 04 05:37:09.997027 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:09.997001    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9975e9d8-c75c-4088-9750-aa17233fc931-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-qq5sn\" (UID: \"9975e9d8-c75c-4088-9750-aa17233fc931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"
Nov 04 05:37:10.004449 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:10.004414    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7m6w\" (UniqueName: \"kubernetes.io/projected/9975e9d8-c75c-4088-9750-aa17233fc931-kube-api-access-r7m6w\") pod \"kuadrant-operator-controller-manager-678d87766f-qq5sn\" (UID: \"9975e9d8-c75c-4088-9750-aa17233fc931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"
Nov 04 05:37:10.045107 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:10.045071    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"
Nov 04 05:37:10.324030 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:10.324002    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"]
Nov 04 05:37:10.326571 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:37:10.326537    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9975e9d8_c75c_4088_9750_aa17233fc931.slice/crio-2a7eac8314139e49c9c8f28f7e0a56d41650ba5ebc497bd1f5f2e2f9568cb87a WatchSource:0}: Error finding container 2a7eac8314139e49c9c8f28f7e0a56d41650ba5ebc497bd1f5f2e2f9568cb87a: Status 404 returned error can't find the container with id 2a7eac8314139e49c9c8f28f7e0a56d41650ba5ebc497bd1f5f2e2f9568cb87a
Nov 04 05:37:10.580190 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:10.580106    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pfgtk"
Nov 04 05:37:10.634855 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:10.634817    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn" event={"ID":"9975e9d8-c75c-4088-9750-aa17233fc931","Type":"ContainerStarted","Data":"2a7eac8314139e49c9c8f28f7e0a56d41650ba5ebc497bd1f5f2e2f9568cb87a"}
Nov 04 05:37:12.927269 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:12.927213    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:13.027699 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:13.027606    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:13.534357 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:13.534315    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:13.635177 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:13.635081    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:14.606309 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:14.606280    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-pfrmk"
Nov 04 05:37:14.658746 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:14.658692    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:14.762900 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:14.762856    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:15.076994 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.076958    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:15.213606 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.213268    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:15.220660 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.217829    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"]
Nov 04 05:37:15.222722 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.222698    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.235084 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.229641    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ztmw7\""
Nov 04 05:37:15.239200 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.239126    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"]
Nov 04 05:37:15.324284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.320231    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:15.349406 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.349310    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.349406 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.349360    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.349643 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.349445    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.349643 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.349476    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.349643 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.349576    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.349643 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.349604    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.349643 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.349624    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxs64\" (UniqueName: \"kubernetes.io/projected/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-kube-api-access-wxs64\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.349832 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.349774    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.349877 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.349830    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.418659 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.418582    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:15.450359 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.450319    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.450577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.450549    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.450657 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.450623    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.451438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.450763    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.451438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.450797    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.451438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.450852    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.451438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.450879    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.451438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.450911    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxs64\" (UniqueName: \"kubernetes.io/projected/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-kube-api-access-wxs64\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.451438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.450961    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.451438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.451093    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.451438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.451254    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.452100 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.452057    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.452192 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.452080    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.452737 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.452716    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.454052 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.454025    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.454271 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.454248    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.459630 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.459602    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxs64\" (UniqueName: \"kubernetes.io/projected/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-kube-api-access-wxs64\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.460422 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.460395    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-c4c65fbf-dllds\" (UID: \"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.547785 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.547747    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:15.603849 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.603374    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:15.662960 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.662924    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn" event={"ID":"9975e9d8-c75c-4088-9750-aa17233fc931","Type":"ContainerStarted","Data":"7d22a909319d276e2fc28ee0034d8314450702037693d88652d7e87e5580e252"}
Nov 04 05:37:15.663718 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.663688    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"
Nov 04 05:37:15.683458 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.683394    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn" podStartSLOduration=1.888462936 podStartE2EDuration="6.683372582s" totalImagesPullingTime="4.794909646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:37:15.681404001 +0000 UTC m=+530.539391830" watchObservedRunningTime="2026-11-04 05:37:15.683372582 +0000 UTC m=+530.541360412"
Nov 04 05:37:15.901333 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.901302    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"]
Nov 04 05:37:15.903603 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:37:15.903571    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03592be9_67c3_46ca_b3c0_dc6ca7f5ac2a.slice/crio-e9c48cc84511feef6eab00b709470f07696706900c25a0df2b5f8460f0f30fc8 WatchSource:0}: Error finding container e9c48cc84511feef6eab00b709470f07696706900c25a0df2b5f8460f0f30fc8: Status 404 returned error can't find the container with id e9c48cc84511feef6eab00b709470f07696706900c25a0df2b5f8460f0f30fc8
Nov 04 05:37:15.905781 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.905752    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:37:15.905880 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.905815    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:37:15.905880 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:15.905847    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:37:16.071689 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.071636    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:16.190306 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.190270    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:16.289290 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.289255    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:16.584141 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.584064    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:37:16.589074 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.589046    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"
Nov 04 05:37:16.595108 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.594985    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:37:16.596206 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.596180    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Nov 04 05:37:16.608648 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.608620    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:37:16.632243 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.632200    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nldtc\""
Nov 04 05:37:16.660270 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:37:16.660228    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:37:16.671685 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.671648    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds" event={"ID":"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a","Type":"ContainerStarted","Data":"a7806b05f89cca50138f8a3dbbe9b90b3af046f51487dacd0a7e2ee3bf3e2b09"}
Nov 04 05:37:16.672129 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.671712    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds" event={"ID":"03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a","Type":"ContainerStarted","Data":"e9c48cc84511feef6eab00b709470f07696706900c25a0df2b5f8460f0f30fc8"}
Nov 04 05:37:16.691840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.691778    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds" podStartSLOduration=1.691756629 podStartE2EDuration="1.691756629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:37:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:37:16.690001685 +0000 UTC m=+531.547989509" watchObservedRunningTime="2026-11-04 05:37:16.691756629 +0000 UTC m=+531.549744467"
Nov 04 05:37:16.724534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.724474    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:16.765016 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.764982    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11975d98-03f4-44e2-9c6a-ada5d2b9f4ab-config-file\") pod \"limitador-limitador-7c9b87d574-dqbgz\" (UID: \"11975d98-03f4-44e2-9c6a-ada5d2b9f4ab\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"
Nov 04 05:37:16.765249 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.765035    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxc46\" (UniqueName: \"kubernetes.io/projected/11975d98-03f4-44e2-9c6a-ada5d2b9f4ab-kube-api-access-lxc46\") pod \"limitador-limitador-7c9b87d574-dqbgz\" (UID: \"11975d98-03f4-44e2-9c6a-ada5d2b9f4ab\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"
Nov 04 05:37:16.824626 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.824580    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:16.866165 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.866075    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11975d98-03f4-44e2-9c6a-ada5d2b9f4ab-config-file\") pod \"limitador-limitador-7c9b87d574-dqbgz\" (UID: \"11975d98-03f4-44e2-9c6a-ada5d2b9f4ab\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"
Nov 04 05:37:16.866165 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.866138    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxc46\" (UniqueName: \"kubernetes.io/projected/11975d98-03f4-44e2-9c6a-ada5d2b9f4ab-kube-api-access-lxc46\") pod \"limitador-limitador-7c9b87d574-dqbgz\" (UID: \"11975d98-03f4-44e2-9c6a-ada5d2b9f4ab\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"
Nov 04 05:37:16.866850 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.866829    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11975d98-03f4-44e2-9c6a-ada5d2b9f4ab-config-file\") pod \"limitador-limitador-7c9b87d574-dqbgz\" (UID: \"11975d98-03f4-44e2-9c6a-ada5d2b9f4ab\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"
Nov 04 05:37:16.877775 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.877736    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxc46\" (UniqueName: \"kubernetes.io/projected/11975d98-03f4-44e2-9c6a-ada5d2b9f4ab-kube-api-access-lxc46\") pod \"limitador-limitador-7c9b87d574-dqbgz\" (UID: \"11975d98-03f4-44e2-9c6a-ada5d2b9f4ab\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"
Nov 04 05:37:16.909245 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.909208    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"
Nov 04 05:37:16.943488 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:16.943450    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:17.087471 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.087438    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:17.193163 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.193098    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:37:17.195775 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:37:17.195743    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11975d98_03f4_44e2_9c6a_ada5d2b9f4ab.slice/crio-c426a13b8e26572417904f0e9f27f271f844fb81165b02e50c13fb978f42392f WatchSource:0}: Error finding container c426a13b8e26572417904f0e9f27f271f844fb81165b02e50c13fb978f42392f: Status 404 returned error can't find the container with id c426a13b8e26572417904f0e9f27f271f844fb81165b02e50c13fb978f42392f
Nov 04 05:37:17.438286 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.438254    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dfh4s"]
Nov 04 05:37:17.443075 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.443006    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s"
Nov 04 05:37:17.448085 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.448058    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dfh4s"]
Nov 04 05:37:17.450226 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.450199    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mp9cq\""
Nov 04 05:37:17.548658 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.548624    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:17.553474 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.553428    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:17.573534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.573476    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctqvf\" (UniqueName: \"kubernetes.io/projected/45c15ffc-f24e-418b-a7b3-4d8c82e921b9-kube-api-access-ctqvf\") pod \"authorino-56c6c9ddd5-dfh4s\" (UID: \"45c15ffc-f24e-418b-a7b3-4d8c82e921b9\") " pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s"
Nov 04 05:37:17.575178 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.575150    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:17.674372 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.674341    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctqvf\" (UniqueName: \"kubernetes.io/projected/45c15ffc-f24e-418b-a7b3-4d8c82e921b9-kube-api-access-ctqvf\") pod \"authorino-56c6c9ddd5-dfh4s\" (UID: \"45c15ffc-f24e-418b-a7b3-4d8c82e921b9\") " pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s"
Nov 04 05:37:17.677648 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.677618    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz" event={"ID":"11975d98-03f4-44e2-9c6a-ada5d2b9f4ab","Type":"ContainerStarted","Data":"c426a13b8e26572417904f0e9f27f271f844fb81165b02e50c13fb978f42392f"}
Nov 04 05:37:17.677856 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.677840    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:17.679280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.679257    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-c4c65fbf-dllds"
Nov 04 05:37:17.682332 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.682311    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctqvf\" (UniqueName: \"kubernetes.io/projected/45c15ffc-f24e-418b-a7b3-4d8c82e921b9-kube-api-access-ctqvf\") pod \"authorino-56c6c9ddd5-dfh4s\" (UID: \"45c15ffc-f24e-418b-a7b3-4d8c82e921b9\") " pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s"
Nov 04 05:37:17.683965 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.683940    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:17.767593 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.767511    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s"
Nov 04 05:37:17.989563 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:17.989528    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:18.050113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:18.050021    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dfh4s"]
Nov 04 05:37:18.052564 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:37:18.052528    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45c15ffc_f24e_418b_a7b3_4d8c82e921b9.slice/crio-168c2cdec161d4623d2554e967f0d2b224de91071d9406a7da7cec5f2641f5ea WatchSource:0}: Error finding container 168c2cdec161d4623d2554e967f0d2b224de91071d9406a7da7cec5f2641f5ea: Status 404 returned error can't find the container with id 168c2cdec161d4623d2554e967f0d2b224de91071d9406a7da7cec5f2641f5ea
Nov 04 05:37:18.626076 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:18.626048    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-sgjcg"
Nov 04 05:37:18.685721 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:18.685685    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s" event={"ID":"45c15ffc-f24e-418b-a7b3-4d8c82e921b9","Type":"ContainerStarted","Data":"168c2cdec161d4623d2554e967f0d2b224de91071d9406a7da7cec5f2641f5ea"}
Nov 04 05:37:19.693123 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:19.693081    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz" event={"ID":"11975d98-03f4-44e2-9c6a-ada5d2b9f4ab","Type":"ContainerStarted","Data":"f7a9f4b7c4c9ea7b497157aae3e7b42eb917728166a0b23c853c38985126bcd8"}
Nov 04 05:37:19.693556 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:19.693334    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"
Nov 04 05:37:19.710834 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:19.710775    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz" podStartSLOduration=2.235953146 podStartE2EDuration="3.710759898s" totalImagesPullingTime="1.474806752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:37:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:37:19.708543774 +0000 UTC m=+534.566531605" watchObservedRunningTime="2026-11-04 05:37:19.710759898 +0000 UTC m=+534.568747777"
Nov 04 05:37:20.700362 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:20.700315    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s" event={"ID":"45c15ffc-f24e-418b-a7b3-4d8c82e921b9","Type":"ContainerStarted","Data":"db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd"}
Nov 04 05:37:20.715941 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:20.715891    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s" podStartSLOduration=1.790729174 podStartE2EDuration="3.715875875s" totalImagesPullingTime="1.925146701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:37:20.714564222 +0000 UTC m=+535.572552052" watchObservedRunningTime="2026-11-04 05:37:20.715875875 +0000 UTC m=+535.573863703"
Nov 04 05:37:20.942227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:20.942188    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:21.042317 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:21.042235    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:25.675613 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:25.675574    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:25.774322 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:25.774284    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:27.353666 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:27.353629    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:27.680824 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:27.680789    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-qq5sn"
Nov 04 05:37:30.701412 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:30.701372    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"
Nov 04 05:37:32.045840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:32.045801    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:32.151521 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:32.151477    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:32.708337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:32.708300    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:32.797411 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:32.797376    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:32.875016 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:32.874979    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:32.977031 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:32.976937    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:36.652577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:36.652540    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:36.724248 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:36.724217    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:40.852972 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:40.852940    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:40.953842 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:40.953808    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:45.441208 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:45.441162    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:45.538590 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:37:45.538549    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:37:46.656580 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:37:46.656544    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:38:00.469876 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.469837    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:00.545619 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.545585    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8b95c9c66-mbkfh"]
Nov 04 05:38:00.552220 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.552194    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:00.557347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.557311    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 04 05:38:00.558602 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.558574    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 04 05:38:00.558790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.558591    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 04 05:38:00.558790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.558683    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 04 05:38:00.558790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.558737    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 04 05:38:00.558790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.558743    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4tnqg\""
Nov 04 05:38:00.562038 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.562011    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-mbkfh"]
Nov 04 05:38:00.656545 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.656482    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-webhook-cert\") pod \"maas-controller-8b95c9c66-mbkfh\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") " pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:00.656725 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.656594    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-metrics-certs\") pod \"maas-controller-8b95c9c66-mbkfh\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") " pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:00.656725 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.656677    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb52v\" (UniqueName: \"kubernetes.io/projected/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-kube-api-access-pb52v\") pod \"maas-controller-8b95c9c66-mbkfh\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") " pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:00.758181 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.758089    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb52v\" (UniqueName: \"kubernetes.io/projected/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-kube-api-access-pb52v\") pod \"maas-controller-8b95c9c66-mbkfh\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") " pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:00.758181 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.758155    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-webhook-cert\") pod \"maas-controller-8b95c9c66-mbkfh\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") " pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:00.758181 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.758183    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-metrics-certs\") pod \"maas-controller-8b95c9c66-mbkfh\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") " pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:00.760824 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.760796    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-webhook-cert\") pod \"maas-controller-8b95c9c66-mbkfh\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") " pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:00.760948 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.760860    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-metrics-certs\") pod \"maas-controller-8b95c9c66-mbkfh\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") " pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:00.766111 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.766086    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb52v\" (UniqueName: \"kubernetes.io/projected/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-kube-api-access-pb52v\") pod \"maas-controller-8b95c9c66-mbkfh\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") " pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:00.868462 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:00.868427    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:01.145495 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:01.145419    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-mbkfh"]
Nov 04 05:38:01.147835 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:38:01.147805    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5d2e26_e76d_4fa1_8688_0afe8212b28a.slice/crio-8b3b3ea310848277d00d195ed7b9a344b3ba44186e3463d52247e91d554a33e4 WatchSource:0}: Error finding container 8b3b3ea310848277d00d195ed7b9a344b3ba44186e3463d52247e91d554a33e4: Status 404 returned error can't find the container with id 8b3b3ea310848277d00d195ed7b9a344b3ba44186e3463d52247e91d554a33e4
Nov 04 05:38:01.897763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:01.897724    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-mbkfh" event={"ID":"ea5d2e26-e76d-4fa1-8688-0afe8212b28a","Type":"ContainerStarted","Data":"8b3b3ea310848277d00d195ed7b9a344b3ba44186e3463d52247e91d554a33e4"}
Nov 04 05:38:01.981591 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:01.981555    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:03.891285 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:03.891248    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:03.911094 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:03.911056    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-mbkfh" event={"ID":"ea5d2e26-e76d-4fa1-8688-0afe8212b28a","Type":"ContainerStarted","Data":"7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246"}
Nov 04 05:38:03.911269 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:03.911242    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:03.929836 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:03.929782    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-8b95c9c66-mbkfh" podStartSLOduration=1.3901854679999999 podStartE2EDuration="3.929767878s" totalImagesPullingTime="2.53958241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:38:03.928589672 +0000 UTC m=+578.786577503" watchObservedRunningTime="2026-11-04 05:38:03.929767878 +0000 UTC m=+578.787755707"
Nov 04 05:38:03.988556 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:03.988456    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:04.936571 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:04.936535    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:05.034278 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:05.034234    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:12.112334 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.112242    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:12.231402 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.231365    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:12.277056 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.277021    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-jfdzn"]
Nov 04 05:38:12.283124 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.283098    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn"
Nov 04 05:38:12.305783 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.305229    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-jfdzn"]
Nov 04 05:38:12.307139 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.307107    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-qrwmn"]
Nov 04 05:38:12.314753 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.310963    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:12.323492 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.323459    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-qrwmn"]
Nov 04 05:38:12.354304 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.354274    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-4lzkw\""
Nov 04 05:38:12.354517 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.354350    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Nov 04 05:38:12.354517 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.354445    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Nov 04 05:38:12.354663 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.354559    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qsglg\""
Nov 04 05:38:12.354663 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.354619    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Nov 04 05:38:12.356053 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.356019    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:12.367141 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.367048    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpbdp\" (UniqueName: \"kubernetes.io/projected/732ab79a-2426-4dab-a1ba-e1e12c5ab51b-kube-api-access-bpbdp\") pod \"odh-model-controller-769875db56-qrwmn\" (UID: \"732ab79a-2426-4dab-a1ba-e1e12c5ab51b\") " pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:12.367141 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.367118    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/732ab79a-2426-4dab-a1ba-e1e12c5ab51b-cert\") pod \"odh-model-controller-769875db56-qrwmn\" (UID: \"732ab79a-2426-4dab-a1ba-e1e12c5ab51b\") " pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:12.367311 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.367208    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e42d496-8250-4c50-ad2b-8ad68b603fd5-tls-certs\") pod \"model-serving-api-75bd89fdfc-jfdzn\" (UID: \"8e42d496-8250-4c50-ad2b-8ad68b603fd5\") " pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn"
Nov 04 05:38:12.367311 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.367234    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjq7c\" (UniqueName: \"kubernetes.io/projected/8e42d496-8250-4c50-ad2b-8ad68b603fd5-kube-api-access-fjq7c\") pod \"model-serving-api-75bd89fdfc-jfdzn\" (UID: \"8e42d496-8250-4c50-ad2b-8ad68b603fd5\") " pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn"
Nov 04 05:38:12.367311 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.367252    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732ab79a-2426-4dab-a1ba-e1e12c5ab51b-metrics-certs\") pod \"odh-model-controller-769875db56-qrwmn\" (UID: \"732ab79a-2426-4dab-a1ba-e1e12c5ab51b\") " pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:12.450754 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.450716    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:12.468426 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.468392    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/732ab79a-2426-4dab-a1ba-e1e12c5ab51b-cert\") pod \"odh-model-controller-769875db56-qrwmn\" (UID: \"732ab79a-2426-4dab-a1ba-e1e12c5ab51b\") " pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:12.468426 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.468428    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e42d496-8250-4c50-ad2b-8ad68b603fd5-tls-certs\") pod \"model-serving-api-75bd89fdfc-jfdzn\" (UID: \"8e42d496-8250-4c50-ad2b-8ad68b603fd5\") " pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn"
Nov 04 05:38:12.468726 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.468448    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjq7c\" (UniqueName: \"kubernetes.io/projected/8e42d496-8250-4c50-ad2b-8ad68b603fd5-kube-api-access-fjq7c\") pod \"model-serving-api-75bd89fdfc-jfdzn\" (UID: \"8e42d496-8250-4c50-ad2b-8ad68b603fd5\") " pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn"
Nov 04 05:38:12.468726 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.468464    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732ab79a-2426-4dab-a1ba-e1e12c5ab51b-metrics-certs\") pod \"odh-model-controller-769875db56-qrwmn\" (UID: \"732ab79a-2426-4dab-a1ba-e1e12c5ab51b\") " pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:12.468726 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.468552    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpbdp\" (UniqueName: \"kubernetes.io/projected/732ab79a-2426-4dab-a1ba-e1e12c5ab51b-kube-api-access-bpbdp\") pod \"odh-model-controller-769875db56-qrwmn\" (UID: \"732ab79a-2426-4dab-a1ba-e1e12c5ab51b\") " pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:12.471705 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.471666    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/732ab79a-2426-4dab-a1ba-e1e12c5ab51b-cert\") pod \"odh-model-controller-769875db56-qrwmn\" (UID: \"732ab79a-2426-4dab-a1ba-e1e12c5ab51b\") " pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:12.471705 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.471684    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e42d496-8250-4c50-ad2b-8ad68b603fd5-tls-certs\") pod \"model-serving-api-75bd89fdfc-jfdzn\" (UID: \"8e42d496-8250-4c50-ad2b-8ad68b603fd5\") " pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn"
Nov 04 05:38:12.471705 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.471701    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/732ab79a-2426-4dab-a1ba-e1e12c5ab51b-metrics-certs\") pod \"odh-model-controller-769875db56-qrwmn\" (UID: \"732ab79a-2426-4dab-a1ba-e1e12c5ab51b\") " pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:12.479061 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.479035    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpbdp\" (UniqueName: \"kubernetes.io/projected/732ab79a-2426-4dab-a1ba-e1e12c5ab51b-kube-api-access-bpbdp\") pod \"odh-model-controller-769875db56-qrwmn\" (UID: \"732ab79a-2426-4dab-a1ba-e1e12c5ab51b\") " pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:12.479322 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.479297    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjq7c\" (UniqueName: \"kubernetes.io/projected/8e42d496-8250-4c50-ad2b-8ad68b603fd5-kube-api-access-fjq7c\") pod \"model-serving-api-75bd89fdfc-jfdzn\" (UID: \"8e42d496-8250-4c50-ad2b-8ad68b603fd5\") " pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn"
Nov 04 05:38:12.553112 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.553074    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:12.618992 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.618902    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn"
Nov 04 05:38:12.640469 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.640437    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:12.941744 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.941686    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-jfdzn"]
Nov 04 05:38:12.944102 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:38:12.944071    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e42d496_8250_4c50_ad2b_8ad68b603fd5.slice/crio-d136a631ca570275826382aa5411765eab75fc9b186ee8ba3877d3fd80ba3491 WatchSource:0}: Error finding container d136a631ca570275826382aa5411765eab75fc9b186ee8ba3877d3fd80ba3491: Status 404 returned error can't find the container with id d136a631ca570275826382aa5411765eab75fc9b186ee8ba3877d3fd80ba3491
Nov 04 05:38:12.949865 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.949842    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-qrwmn"]
Nov 04 05:38:12.951660 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:38:12.951632    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732ab79a_2426_4dab_a1ba_e1e12c5ab51b.slice/crio-7ec043720cb980c4a273be5243e6cc1b323218554b9b6be8658bf6dec4fe47a5 WatchSource:0}: Error finding container 7ec043720cb980c4a273be5243e6cc1b323218554b9b6be8658bf6dec4fe47a5: Status 404 returned error can't find the container with id 7ec043720cb980c4a273be5243e6cc1b323218554b9b6be8658bf6dec4fe47a5
Nov 04 05:38:12.963284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.963251    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-qrwmn" event={"ID":"732ab79a-2426-4dab-a1ba-e1e12c5ab51b","Type":"ContainerStarted","Data":"7ec043720cb980c4a273be5243e6cc1b323218554b9b6be8658bf6dec4fe47a5"}
Nov 04 05:38:12.964390 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:12.964369    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn" event={"ID":"8e42d496-8250-4c50-ad2b-8ad68b603fd5","Type":"ContainerStarted","Data":"d136a631ca570275826382aa5411765eab75fc9b186ee8ba3877d3fd80ba3491"}
Nov 04 05:38:13.217684 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:13.217593    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:13.315267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:13.315233    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:13.415537 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:13.415479    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:14.924031 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:14.923992    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:15.350005 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.349915    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:15.429409 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.429376    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-mbkfh"]
Nov 04 05:38:15.429678 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.429618    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-8b95c9c66-mbkfh" podUID="ea5d2e26-e76d-4fa1-8688-0afe8212b28a" containerName="manager" containerID="cri-o://7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246" gracePeriod=30
Nov 04 05:38:15.726113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.726077    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:15.815122 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.815082    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-webhook-cert\") pod \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") "
Nov 04 05:38:15.815312 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.815137    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-metrics-certs\") pod \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") "
Nov 04 05:38:15.815312 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.815203    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-kube-api-access-pb52v\" (UniqueName: \"kubernetes.io/projected/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-kube-api-access-pb52v\") pod \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\" (UID: \"ea5d2e26-e76d-4fa1-8688-0afe8212b28a\") "
Nov 04 05:38:15.818609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.818575    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-metrics-certs" pod "ea5d2e26-e76d-4fa1-8688-0afe8212b28a" (UID: "ea5d2e26-e76d-4fa1-8688-0afe8212b28a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:38:15.818782 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.818730    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-kube-api-access-pb52v" pod "ea5d2e26-e76d-4fa1-8688-0afe8212b28a" (UID: "ea5d2e26-e76d-4fa1-8688-0afe8212b28a"). InnerVolumeSpecName "kube-api-access-pb52v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:38:15.818868 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.818850    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-webhook-cert" pod "ea5d2e26-e76d-4fa1-8688-0afe8212b28a" (UID: "ea5d2e26-e76d-4fa1-8688-0afe8212b28a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:38:15.916915 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.916826    5079 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-webhook-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:15.916915 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.916865    5079 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-metrics-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:15.916915 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.916881    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb52v\" (UniqueName: \"kubernetes.io/projected/ea5d2e26-e76d-4fa1-8688-0afe8212b28a-kube-api-access-pb52v\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:15.986739 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.986421    5079 generic.go:356] "Generic (PLEG): container finished" podID="ea5d2e26-e76d-4fa1-8688-0afe8212b28a" containerID="7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246" exitCode=0
Nov 04 05:38:15.986739 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.986492    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-mbkfh"
Nov 04 05:38:15.986739 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.986530    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-mbkfh" event={"ID":"ea5d2e26-e76d-4fa1-8688-0afe8212b28a","Type":"ContainerDied","Data":"7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246"}
Nov 04 05:38:15.986739 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.986585    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-mbkfh" event={"ID":"ea5d2e26-e76d-4fa1-8688-0afe8212b28a","Type":"ContainerDied","Data":"8b3b3ea310848277d00d195ed7b9a344b3ba44186e3463d52247e91d554a33e4"}
Nov 04 05:38:15.986739 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.986611    5079 scope.go:122] "RemoveContainer" containerID="7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246"
Nov 04 05:38:15.997812 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.997789    5079 scope.go:122] "RemoveContainer" containerID="7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246"
Nov 04 05:38:15.998228 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:38:15.998193    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246\": container with ID starting with 7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246 not found: ID does not exist" containerID="7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246"
Nov 04 05:38:15.998337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:15.998243    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246"} err="failed to get container status \"7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246\": rpc error: code = NotFound desc = could not find container \"7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246\": container with ID starting with 7132b07d6e73f8e4a38dd68abe33b9ab5e705972c770b37995caad350e3c3246 not found: ID does not exist"
Nov 04 05:38:16.018667 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:16.018641    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-mbkfh"]
Nov 04 05:38:16.020270 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:16.020247    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-mbkfh"]
Nov 04 05:38:16.658116 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:38:16.658020    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:38:16.994208 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:16.994166    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn" event={"ID":"8e42d496-8250-4c50-ad2b-8ad68b603fd5","Type":"ContainerStarted","Data":"93b9e8826497755edefb733440312284567531d418bb81218e4ae7b9b1e73165"}
Nov 04 05:38:16.994704 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:16.994325    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn"
Nov 04 05:38:16.996885 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:16.996863    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-qrwmn" event={"ID":"732ab79a-2426-4dab-a1ba-e1e12c5ab51b","Type":"ContainerStarted","Data":"47be3b6715c57eac6e0601d9a02abc8d188fbb3fef394ddacedf580a3951cbd9"}
Nov 04 05:38:16.997028 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:16.996997    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:17.012425 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:17.012377    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn" podStartSLOduration=2.005466675 podStartE2EDuration="5.012363526s" totalImagesPullingTime="3.006896851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:38:17.011548945 +0000 UTC m=+591.869536775" watchObservedRunningTime="2026-11-04 05:38:17.012363526 +0000 UTC m=+591.870351355"
Nov 04 05:38:17.027650 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:17.027607    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-qrwmn" podStartSLOduration=1.8279251460000001 podStartE2EDuration="5.027593303s" totalImagesPullingTime="3.199668157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:38:17.026748844 +0000 UTC m=+591.884736675" watchObservedRunningTime="2026-11-04 05:38:17.027593303 +0000 UTC m=+591.885581134"
Nov 04 05:38:17.295811 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:17.295715    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea5d2e26-e76d-4fa1-8688-0afe8212b28a" path="/var/lib/kubelet/pods/ea5d2e26-e76d-4fa1-8688-0afe8212b28a/volumes"
Nov 04 05:38:25.345136 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:25.345107    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:38:25.345603 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:25.345321    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:38:25.349468 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:25.349449    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:38:25.349647 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:25.349628    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:38:28.005076 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:28.005042    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-qrwmn"
Nov 04 05:38:28.006827 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:28.006803    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-jfdzn"
Nov 04 05:38:31.768479 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:31.768437    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:31.868116 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:31.868084    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:33.088774 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:33.088730    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:33.191582 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:33.191542    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:33.275176 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:33.275135    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:33.954380 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:33.954331    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:38:41.987595 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:41.987558    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:42.084784 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.084740    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:38:42.273839 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.273747    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dd76875b5-rk49g"]
Nov 04 05:38:42.274169 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.274151    5079 cpu_manager.go:414] "containerMap: removing container" podUID="ea5d2e26-e76d-4fa1-8688-0afe8212b28a" containerName="manager"
Nov 04 05:38:42.274169 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.274168    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea5d2e26-e76d-4fa1-8688-0afe8212b28a" containerName="manager"
Nov 04 05:38:42.274334 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.274233    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea5d2e26-e76d-4fa1-8688-0afe8212b28a" containerName="manager"
Nov 04 05:38:42.277478 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.277455    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-rk49g"
Nov 04 05:38:42.284336 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.284310    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 04 05:38:42.287114 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.287084    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-rk49g"]
Nov 04 05:38:42.317883 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.317841    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-rk49g"]
Nov 04 05:38:42.318152 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:38:42.318121    5079 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zw792 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6dd76875b5-rk49g" podUID="b14e1a07-b9bf-4282-8723-0d782a6cf431"
Nov 04 05:38:42.370401 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.370360    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b14e1a07-b9bf-4282-8723-0d782a6cf431-tls-cert\") pod \"authorino-6dd76875b5-rk49g\" (UID: \"b14e1a07-b9bf-4282-8723-0d782a6cf431\") " pod="kuadrant-system/authorino-6dd76875b5-rk49g"
Nov 04 05:38:42.370596 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.370420    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw792\" (UniqueName: \"kubernetes.io/projected/b14e1a07-b9bf-4282-8723-0d782a6cf431-kube-api-access-zw792\") pod \"authorino-6dd76875b5-rk49g\" (UID: \"b14e1a07-b9bf-4282-8723-0d782a6cf431\") " pod="kuadrant-system/authorino-6dd76875b5-rk49g"
Nov 04 05:38:42.471167 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.471133    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b14e1a07-b9bf-4282-8723-0d782a6cf431-tls-cert\") pod \"authorino-6dd76875b5-rk49g\" (UID: \"b14e1a07-b9bf-4282-8723-0d782a6cf431\") " pod="kuadrant-system/authorino-6dd76875b5-rk49g"
Nov 04 05:38:42.471344 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.471178    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw792\" (UniqueName: \"kubernetes.io/projected/b14e1a07-b9bf-4282-8723-0d782a6cf431-kube-api-access-zw792\") pod \"authorino-6dd76875b5-rk49g\" (UID: \"b14e1a07-b9bf-4282-8723-0d782a6cf431\") " pod="kuadrant-system/authorino-6dd76875b5-rk49g"
Nov 04 05:38:42.474059 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.474027    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b14e1a07-b9bf-4282-8723-0d782a6cf431-tls-cert\") pod \"authorino-6dd76875b5-rk49g\" (UID: \"b14e1a07-b9bf-4282-8723-0d782a6cf431\") " pod="kuadrant-system/authorino-6dd76875b5-rk49g"
Nov 04 05:38:42.479227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.479203    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw792\" (UniqueName: \"kubernetes.io/projected/b14e1a07-b9bf-4282-8723-0d782a6cf431-kube-api-access-zw792\") pod \"authorino-6dd76875b5-rk49g\" (UID: \"b14e1a07-b9bf-4282-8723-0d782a6cf431\") " pod="kuadrant-system/authorino-6dd76875b5-rk49g"
Nov 04 05:38:42.681784 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.681746    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dd68dc655-2xl4v"]
Nov 04 05:38:42.685345 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.685327    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd68dc655-2xl4v"
Nov 04 05:38:42.692554 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.692529    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dd68dc655-2xl4v"]
Nov 04 05:38:42.774552 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.774496    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ccecd88-f267-464e-939b-b0c30899cef9-tls-cert\") pod \"authorino-5dd68dc655-2xl4v\" (UID: \"8ccecd88-f267-464e-939b-b0c30899cef9\") " pod="kuadrant-system/authorino-5dd68dc655-2xl4v"
Nov 04 05:38:42.774746 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.774565    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv59n\" (UniqueName: \"kubernetes.io/projected/8ccecd88-f267-464e-939b-b0c30899cef9-kube-api-access-zv59n\") pod \"authorino-5dd68dc655-2xl4v\" (UID: \"8ccecd88-f267-464e-939b-b0c30899cef9\") " pod="kuadrant-system/authorino-5dd68dc655-2xl4v"
Nov 04 05:38:42.875449 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.875410    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ccecd88-f267-464e-939b-b0c30899cef9-tls-cert\") pod \"authorino-5dd68dc655-2xl4v\" (UID: \"8ccecd88-f267-464e-939b-b0c30899cef9\") " pod="kuadrant-system/authorino-5dd68dc655-2xl4v"
Nov 04 05:38:42.875449 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.875450    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv59n\" (UniqueName: \"kubernetes.io/projected/8ccecd88-f267-464e-939b-b0c30899cef9-kube-api-access-zv59n\") pod \"authorino-5dd68dc655-2xl4v\" (UID: \"8ccecd88-f267-464e-939b-b0c30899cef9\") " pod="kuadrant-system/authorino-5dd68dc655-2xl4v"
Nov 04 05:38:42.877983 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.877956    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ccecd88-f267-464e-939b-b0c30899cef9-tls-cert\") pod \"authorino-5dd68dc655-2xl4v\" (UID: \"8ccecd88-f267-464e-939b-b0c30899cef9\") " pod="kuadrant-system/authorino-5dd68dc655-2xl4v"
Nov 04 05:38:42.883036 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:42.883009    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv59n\" (UniqueName: \"kubernetes.io/projected/8ccecd88-f267-464e-939b-b0c30899cef9-kube-api-access-zv59n\") pod \"authorino-5dd68dc655-2xl4v\" (UID: \"8ccecd88-f267-464e-939b-b0c30899cef9\") " pod="kuadrant-system/authorino-5dd68dc655-2xl4v"
Nov 04 05:38:43.000890 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.000810    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd68dc655-2xl4v"
Nov 04 05:38:43.136968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.136872    5079 generic.go:356] "Generic (PLEG): container finished" podID="ffe94fbe-c512-43cf-976f-f64c6dc2c358" containerID="75d8b089a5612b02addf6482961f43f18956056055a73cf1cb591d6c34a8affa" exitCode=0
Nov 04 05:38:43.136968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.136943    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf" event={"ID":"ffe94fbe-c512-43cf-976f-f64c6dc2c358","Type":"ContainerDied","Data":"75d8b089a5612b02addf6482961f43f18956056055a73cf1cb591d6c34a8affa"}
Nov 04 05:38:43.136968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.136965    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-rk49g"
Nov 04 05:38:43.137320 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.137302    5079 scope.go:122] "RemoveContainer" containerID="75d8b089a5612b02addf6482961f43f18956056055a73cf1cb591d6c34a8affa"
Nov 04 05:38:43.138389 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.138364    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:38:43.138449 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.138431    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:38:43.138483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.138467    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:38:43.144790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.144766    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-rk49g"
Nov 04 05:38:43.272166 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.272082    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dd68dc655-2xl4v"]
Nov 04 05:38:43.274981 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:38:43.274946    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ccecd88_f267_464e_939b_b0c30899cef9.slice/crio-59c2645b24953d234e66e1f9a58a8bb4c8c92d6fb5723fc3b286f4b026b1fe58 WatchSource:0}: Error finding container 59c2645b24953d234e66e1f9a58a8bb4c8c92d6fb5723fc3b286f4b026b1fe58: Status 404 returned error can't find the container with id 59c2645b24953d234e66e1f9a58a8bb4c8c92d6fb5723fc3b286f4b026b1fe58
Nov 04 05:38:43.280330 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.280305    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b14e1a07-b9bf-4282-8723-0d782a6cf431-kube-api-access-zw792\" (UniqueName: \"kubernetes.io/projected/b14e1a07-b9bf-4282-8723-0d782a6cf431-kube-api-access-zw792\") pod \"b14e1a07-b9bf-4282-8723-0d782a6cf431\" (UID: \"b14e1a07-b9bf-4282-8723-0d782a6cf431\") "
Nov 04 05:38:43.280442 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.280414    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b14e1a07-b9bf-4282-8723-0d782a6cf431-tls-cert\" (UniqueName: \"kubernetes.io/secret/b14e1a07-b9bf-4282-8723-0d782a6cf431-tls-cert\") pod \"b14e1a07-b9bf-4282-8723-0d782a6cf431\" (UID: \"b14e1a07-b9bf-4282-8723-0d782a6cf431\") "
Nov 04 05:38:43.282610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.282585    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14e1a07-b9bf-4282-8723-0d782a6cf431-tls-cert" pod "b14e1a07-b9bf-4282-8723-0d782a6cf431" (UID: "b14e1a07-b9bf-4282-8723-0d782a6cf431"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:38:43.282723 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.282643    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14e1a07-b9bf-4282-8723-0d782a6cf431-kube-api-access-zw792" pod "b14e1a07-b9bf-4282-8723-0d782a6cf431" (UID: "b14e1a07-b9bf-4282-8723-0d782a6cf431"). InnerVolumeSpecName "kube-api-access-zw792". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:38:43.382165 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.382124    5079 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b14e1a07-b9bf-4282-8723-0d782a6cf431-tls-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:43.382165 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:43.382166    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw792\" (UniqueName: \"kubernetes.io/projected/b14e1a07-b9bf-4282-8723-0d782a6cf431-kube-api-access-zw792\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:44.145311 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:44.145272    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd68dc655-2xl4v" event={"ID":"8ccecd88-f267-464e-939b-b0c30899cef9","Type":"ContainerStarted","Data":"59c2645b24953d234e66e1f9a58a8bb4c8c92d6fb5723fc3b286f4b026b1fe58"}
Nov 04 05:38:44.147870 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:44.147838    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf" event={"ID":"ffe94fbe-c512-43cf-976f-f64c6dc2c358","Type":"ContainerStarted","Data":"89e52cb290f854debcd6d9122a3c546ee68309b78dde5142d2048b90d8c9728f"}
Nov 04 05:38:44.147870 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:44.147866    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-rk49g"
Nov 04 05:38:44.219313 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:44.219275    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-rk49g"]
Nov 04 05:38:44.222210 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:44.222132    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-rk49g"]
Nov 04 05:38:44.298692 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:44.298599    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:38:44.631892 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:44.631807    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:38:44.633325 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:44.633284    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6m8sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:38:44.633484 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:44.633354    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf" podUID="ffe94fbe-c512-43cf-976f-f64c6dc2c358" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Nov 04 05:38:45.155437 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:45.155393    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd68dc655-2xl4v" event={"ID":"8ccecd88-f267-464e-939b-b0c30899cef9","Type":"ContainerStarted","Data":"96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6"}
Nov 04 05:38:45.175527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:45.171703    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5dd68dc655-2xl4v" podStartSLOduration=2.418915818 podStartE2EDuration="3.171684569s" totalImagesPullingTime="752.768751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:38:45.169111912 +0000 UTC m=+620.027099741" watchObservedRunningTime="2026-11-04 05:38:45.171684569 +0000 UTC m=+620.029672402"
Nov 04 05:38:45.202547 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:45.196613    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dfh4s"]
Nov 04 05:38:45.202547 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:45.196836    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s" podUID="45c15ffc-f24e-418b-a7b3-4d8c82e921b9" containerName="authorino" containerID="cri-o://db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd" gracePeriod=30
Nov 04 05:38:45.304292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:45.304259    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b14e1a07-b9bf-4282-8723-0d782a6cf431" path="/var/lib/kubelet/pods/b14e1a07-b9bf-4282-8723-0d782a6cf431/volumes"
Nov 04 05:38:45.508809 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:45.508781    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s"
Nov 04 05:38:45.617242 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:45.617193    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45c15ffc-f24e-418b-a7b3-4d8c82e921b9-kube-api-access-ctqvf\" (UniqueName: \"kubernetes.io/projected/45c15ffc-f24e-418b-a7b3-4d8c82e921b9-kube-api-access-ctqvf\") pod \"45c15ffc-f24e-418b-a7b3-4d8c82e921b9\" (UID: \"45c15ffc-f24e-418b-a7b3-4d8c82e921b9\") "
Nov 04 05:38:45.619703 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:45.619666    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45c15ffc-f24e-418b-a7b3-4d8c82e921b9-kube-api-access-ctqvf" pod "45c15ffc-f24e-418b-a7b3-4d8c82e921b9" (UID: "45c15ffc-f24e-418b-a7b3-4d8c82e921b9"). InnerVolumeSpecName "kube-api-access-ctqvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:38:45.631767 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:45.631738    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6m8sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:38:45.631892 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:45.631790    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf" podUID="ffe94fbe-c512-43cf-976f-f64c6dc2c358" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Nov 04 05:38:45.718396 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:45.718304    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctqvf\" (UniqueName: \"kubernetes.io/projected/45c15ffc-f24e-418b-a7b3-4d8c82e921b9-kube-api-access-ctqvf\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:38:46.161673 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:46.161578    5079 generic.go:356] "Generic (PLEG): container finished" podID="45c15ffc-f24e-418b-a7b3-4d8c82e921b9" containerID="db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd" exitCode=0
Nov 04 05:38:46.161673 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:46.161631    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s"
Nov 04 05:38:46.161673 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:46.161664    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s" event={"ID":"45c15ffc-f24e-418b-a7b3-4d8c82e921b9","Type":"ContainerDied","Data":"db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd"}
Nov 04 05:38:46.162212 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:46.161711    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-dfh4s" event={"ID":"45c15ffc-f24e-418b-a7b3-4d8c82e921b9","Type":"ContainerDied","Data":"168c2cdec161d4623d2554e967f0d2b224de91071d9406a7da7cec5f2641f5ea"}
Nov 04 05:38:46.162212 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:46.161732    5079 scope.go:122] "RemoveContainer" containerID="db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd"
Nov 04 05:38:46.192760 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:46.186761    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dfh4s"]
Nov 04 05:38:46.192760 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:46.191362    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-dfh4s"]
Nov 04 05:38:46.196637 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:46.194668    5079 scope.go:122] "RemoveContainer" containerID="db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd"
Nov 04 05:38:46.196637 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:38:46.195114    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd\": container with ID starting with db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd not found: ID does not exist" containerID="db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd"
Nov 04 05:38:46.196637 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:46.195150    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd"} err="failed to get container status \"db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd\": rpc error: code = NotFound desc = could not find container \"db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd\": container with ID starting with db51a4c3ce3d1c8fc67f7338214784df47d6a5d27ca57936e4d3f1abb0b6a4bd not found: ID does not exist"
Nov 04 05:38:46.631632 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:46.631599    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6m8sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:38:46.631823 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:46.631668    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf" podUID="ffe94fbe-c512-43cf-976f-f64c6dc2c358" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Nov 04 05:38:46.656393 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:38:46.656361    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:38:47.301704 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:47.301662    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45c15ffc-f24e-418b-a7b3-4d8c82e921b9" path="/var/lib/kubelet/pods/45c15ffc-f24e-418b-a7b3-4d8c82e921b9/volumes"
Nov 04 05:38:47.631869 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:47.631778    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6m8sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:38:47.631869 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:47.631835    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf" podUID="ffe94fbe-c512-43cf-976f-f64c6dc2c358" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Nov 04 05:38:48.631805 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:48.631767    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-6m8sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Nov 04 05:38:48.632219 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:48.631821    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf" podUID="ffe94fbe-c512-43cf-976f-f64c6dc2c358" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Nov 04 05:38:49.635195 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:49.635163    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:38:49.636057 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:38:49.636037    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-6m8sf"
Nov 04 05:39:06.193856 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:06.193817    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:39:15.401241 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:15.401207    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:39:16.657418 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:39:16.657378    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:39:26.684515 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:26.684470    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:39:39.628523 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:39.628411    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:39:39.729005 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:39.728968    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:39:46.656795 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:39:46.656753    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:39:59.123580 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.123546    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"]
Nov 04 05:39:59.124141 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.124125    5079 cpu_manager.go:414] "containerMap: removing container" podUID="45c15ffc-f24e-418b-a7b3-4d8c82e921b9" containerName="authorino"
Nov 04 05:39:59.124186 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.124144    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45c15ffc-f24e-418b-a7b3-4d8c82e921b9" containerName="authorino"
Nov 04 05:39:59.124280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.124269    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="45c15ffc-f24e-418b-a7b3-4d8c82e921b9" containerName="authorino"
Nov 04 05:39:59.128002 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.127978    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.136454 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.136419    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Nov 04 05:39:59.136624 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.136495    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Nov 04 05:39:59.136694 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.136676    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Nov 04 05:39:59.136791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.136763    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7kdb8\""
Nov 04 05:39:59.137592 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.137564    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"]
Nov 04 05:39:59.156268 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.156225    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/769d7484-a452-422e-9966-3a0b2d3142ba-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.156432 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.156348    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.156432 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.156386    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.156432 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.156426    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.156593 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.156529    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrpdn\" (UniqueName: \"kubernetes.io/projected/769d7484-a452-422e-9966-3a0b2d3142ba-kube-api-access-vrpdn\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.156638 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.156590    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.173572 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.173540    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:39:59.257692 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.257652    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/769d7484-a452-422e-9966-3a0b2d3142ba-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.257900 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.257704    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.257900 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.257731    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.257900 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.257767    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.257900 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.257792    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrpdn\" (UniqueName: \"kubernetes.io/projected/769d7484-a452-422e-9966-3a0b2d3142ba-kube-api-access-vrpdn\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.257900 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.257819    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.258192 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.258171    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.258253 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.258236    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.258296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.258250    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.260144 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.260118    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/769d7484-a452-422e-9966-3a0b2d3142ba-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.260373 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.260350    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/769d7484-a452-422e-9966-3a0b2d3142ba-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.266873 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.266846    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrpdn\" (UniqueName: \"kubernetes.io/projected/769d7484-a452-422e-9966-3a0b2d3142ba-kube-api-access-vrpdn\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p\" (UID: \"769d7484-a452-422e-9966-3a0b2d3142ba\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.445180 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.445130    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:39:59.657773 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.657734    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:39:59.719276 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:39:59.719248    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"]
Nov 04 05:39:59.722358 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:39:59.722321    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769d7484_a452_422e_9966_3a0b2d3142ba.slice/crio-eac87311ce0f1d9b21f2981c0272c3b577a084662d7bb48c66cf5850ecdda5d9 WatchSource:0}: Error finding container eac87311ce0f1d9b21f2981c0272c3b577a084662d7bb48c66cf5850ecdda5d9: Status 404 returned error can't find the container with id eac87311ce0f1d9b21f2981c0272c3b577a084662d7bb48c66cf5850ecdda5d9
Nov 04 05:40:00.554190 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:00.554148    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p" event={"ID":"769d7484-a452-422e-9966-3a0b2d3142ba","Type":"ContainerStarted","Data":"eac87311ce0f1d9b21f2981c0272c3b577a084662d7bb48c66cf5850ecdda5d9"}
Nov 04 05:40:01.261808 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:01.261783    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:01.561788 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:01.561693    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p" event={"ID":"769d7484-a452-422e-9966-3a0b2d3142ba","Type":"ContainerStarted","Data":"f588e41e8d6e9f63a535222b6c9b7b13f523a03a01dc6cae32535c1b9898567f"}
Nov 04 05:40:01.578585 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:01.578527    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p" podStartSLOduration=1.043814191 podStartE2EDuration="2.578487259s" totalImagesPullingTime="1.534673068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:01.577127168 +0000 UTC m=+696.435115011" watchObservedRunningTime="2026-11-04 05:40:01.578487259 +0000 UTC m=+696.436475086"
Nov 04 05:40:01.742940 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:01.742895    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:40:02.445548 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.445488    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:40:02.712547 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.712458    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"]
Nov 04 05:40:02.716907 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.716879    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.722336 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.722309    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"]
Nov 04 05:40:02.723511 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.723451    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Nov 04 05:40:02.760731 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.760682    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:02.796112 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.796078    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.796300 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.796123    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.796300 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.796144    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21870e7a-ac3d-432e-af7f-96b33002f7f5-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.796300 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.796280    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.796419 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.796318    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvw4z\" (UniqueName: \"kubernetes.io/projected/21870e7a-ac3d-432e-af7f-96b33002f7f5-kube-api-access-gvw4z\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.796457 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.796414    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.897474 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.897433    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.897689 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.897485    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvw4z\" (UniqueName: \"kubernetes.io/projected/21870e7a-ac3d-432e-af7f-96b33002f7f5-kube-api-access-gvw4z\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.897689 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.897562    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.897689 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.897614    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.897689 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.897660    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.897951 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.897797    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21870e7a-ac3d-432e-af7f-96b33002f7f5-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.897951 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.897897    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.898071 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.897983    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.898071 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.898032    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.900102 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.900077    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21870e7a-ac3d-432e-af7f-96b33002f7f5-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.900568 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.900547    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21870e7a-ac3d-432e-af7f-96b33002f7f5-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:02.905274 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:02.905250    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvw4z\" (UniqueName: \"kubernetes.io/projected/21870e7a-ac3d-432e-af7f-96b33002f7f5-kube-api-access-gvw4z\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-g8l57\" (UID: \"21870e7a-ac3d-432e-af7f-96b33002f7f5\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:03.039269 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.039177    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:03.316306 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.316281    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"]
Nov 04 05:40:03.318152 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:40:03.318120    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21870e7a_ac3d_432e_af7f_96b33002f7f5.slice/crio-9ac500be506311b944c77b3e92e085f1a973127be701423ea63cb22aa5de5b41 WatchSource:0}: Error finding container 9ac500be506311b944c77b3e92e085f1a973127be701423ea63cb22aa5de5b41: Status 404 returned error can't find the container with id 9ac500be506311b944c77b3e92e085f1a973127be701423ea63cb22aa5de5b41
Nov 04 05:40:03.415788 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.415750    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:40:03.578232 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.578143    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57" event={"ID":"21870e7a-ac3d-432e-af7f-96b33002f7f5","Type":"ContainerStarted","Data":"9ac500be506311b944c77b3e92e085f1a973127be701423ea63cb22aa5de5b41"}
Nov 04 05:40:03.703323 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.703287    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"]
Nov 04 05:40:03.731132 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.731013    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.741631 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.741288    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Nov 04 05:40:03.779560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.776596    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:03.781019 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.780983    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"]
Nov 04 05:40:03.829340 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.829244    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c94q\" (UniqueName: \"kubernetes.io/projected/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-kube-api-access-6c94q\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.829340 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.829305    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.829340 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.829337    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.829688 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.829392    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.829688 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.829415    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.829688 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.829430    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.930556 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.930512    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.930744 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.930597    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.930744 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.930684    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.930744 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.930725    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.930920 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.930750    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.930920 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.930784    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c94q\" (UniqueName: \"kubernetes.io/projected/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-kube-api-access-6c94q\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.931026 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.931008    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.931077 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.931026    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.931150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.931124    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.933115 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.933086    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.933492 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.933471    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:03.939204 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:03.939176    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c94q\" (UniqueName: \"kubernetes.io/projected/b88e9ac9-df69-4b39-ba8a-62a91f0402b1-kube-api-access-6c94q\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-j56jh\" (UID: \"b88e9ac9-df69-4b39-ba8a-62a91f0402b1\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:04.080118 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.080024    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:04.377023 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.376929    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"]
Nov 04 05:40:04.381198 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:40:04.381164    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88e9ac9_df69_4b39_ba8a_62a91f0402b1.slice/crio-0bc30a325b524317b6925e485b31ea14ebfc4856548ff37aad265c0ab67e2e9c WatchSource:0}: Error finding container 0bc30a325b524317b6925e485b31ea14ebfc4856548ff37aad265c0ab67e2e9c: Status 404 returned error can't find the container with id 0bc30a325b524317b6925e485b31ea14ebfc4856548ff37aad265c0ab67e2e9c
Nov 04 05:40:04.577273 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.576052    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"]
Nov 04 05:40:04.588116 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.588081    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.598289 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.598240    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Nov 04 05:40:04.604926 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.604824    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"]
Nov 04 05:40:04.605170 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.605145    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57" event={"ID":"21870e7a-ac3d-432e-af7f-96b33002f7f5","Type":"ContainerStarted","Data":"c2ff6b0b6b859178d03885008db27ab5cdeaf806e2da8e81d1282634f58a3597"}
Nov 04 05:40:04.613877 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.613759    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh" event={"ID":"b88e9ac9-df69-4b39-ba8a-62a91f0402b1","Type":"ContainerStarted","Data":"0bc30a325b524317b6925e485b31ea14ebfc4856548ff37aad265c0ab67e2e9c"}
Nov 04 05:40:04.628872 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.628763    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57" podStartSLOduration=2.342611768 podStartE2EDuration="2.628746806s" totalImagesPullingTime="286.135038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:04.626442989 +0000 UTC m=+699.484430825" watchObservedRunningTime="2026-11-04 05:40:04.628746806 +0000 UTC m=+699.486734630"
Nov 04 05:40:04.668134 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.668077    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1be94026-28dc-4059-94c4-77b63205298a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.668322 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.668148    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2m57\" (UniqueName: \"kubernetes.io/projected/1be94026-28dc-4059-94c4-77b63205298a-kube-api-access-g2m57\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.668322 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.668246    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.668322 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.668274    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.668444 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.668376    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.668444 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.668420    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.694142 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.694047    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:04.769010 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.768979    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1be94026-28dc-4059-94c4-77b63205298a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.769463 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.769067    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2m57\" (UniqueName: \"kubernetes.io/projected/1be94026-28dc-4059-94c4-77b63205298a-kube-api-access-g2m57\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.769463 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.769106    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.769463 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.769122    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.769463 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.769202    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.769463 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.769234    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.769760 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.769593    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.769760 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.769700    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.769905 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.769884    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.772713 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.772658    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1be94026-28dc-4059-94c4-77b63205298a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.780762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.780700    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2m57\" (UniqueName: \"kubernetes.io/projected/1be94026-28dc-4059-94c4-77b63205298a-kube-api-access-g2m57\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.781441 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.781418    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1be94026-28dc-4059-94c4-77b63205298a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj\" (UID: \"1be94026-28dc-4059-94c4-77b63205298a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:04.915613 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:04.915348    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:05.041522 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:05.040116    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:05.206896 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:05.206867    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"]
Nov 04 05:40:05.209752 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:40:05.209718    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be94026_28dc_4059_94c4_77b63205298a.slice/crio-706666b0734334e2fe8552d72762646bf0b0461bdf052804ab852864f21e9c92 WatchSource:0}: Error finding container 706666b0734334e2fe8552d72762646bf0b0461bdf052804ab852864f21e9c92: Status 404 returned error can't find the container with id 706666b0734334e2fe8552d72762646bf0b0461bdf052804ab852864f21e9c92
Nov 04 05:40:05.627575 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:05.623768    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh" event={"ID":"b88e9ac9-df69-4b39-ba8a-62a91f0402b1","Type":"ContainerStarted","Data":"40ccc2b031b1db8d360eb07b65dd63e359c33798faa9e73fad87611d2b7fb5a9"}
Nov 04 05:40:05.627575 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:05.625835    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj" event={"ID":"1be94026-28dc-4059-94c4-77b63205298a","Type":"ContainerStarted","Data":"ba7d58908821e00da6f3a011b21f69cae6dafaed9c8cfccdc42b91ed6723ec13"}
Nov 04 05:40:05.627575 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:05.625897    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj" event={"ID":"1be94026-28dc-4059-94c4-77b63205298a","Type":"ContainerStarted","Data":"706666b0734334e2fe8552d72762646bf0b0461bdf052804ab852864f21e9c92"}
Nov 04 05:40:05.641126 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:05.641069    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh" podStartSLOduration=2.3417715230000002 podStartE2EDuration="2.641054576s" totalImagesPullingTime="299.283053ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:05.639964003 +0000 UTC m=+700.497951835" watchObservedRunningTime="2026-11-04 05:40:05.641054576 +0000 UTC m=+700.499042405"
Nov 04 05:40:05.658284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:05.658219    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj" podStartSLOduration=1.365498412 podStartE2EDuration="1.658200102s" totalImagesPullingTime="292.70169ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:05.656737351 +0000 UTC m=+700.514725183" watchObservedRunningTime="2026-11-04 05:40:05.658200102 +0000 UTC m=+700.516187935"
Nov 04 05:40:05.916907 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:05.916811    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:06.081231 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:06.081188    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:06.270374 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:06.270328    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:40:08.503267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:08.503230    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:09.445358 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:09.445325    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:40:09.458018 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:09.457981    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:40:09.659589 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:09.659561    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p"
Nov 04 05:40:09.841900 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:09.841812    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:40:10.953070 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:10.953037    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:11.579712 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:11.579672    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:13.040128 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:13.040084    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:13.057941 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:13.057911    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:13.693721 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:13.693675    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-g8l57"
Nov 04 05:40:14.080401 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:14.080353    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:14.100481 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:14.100450    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:14.679432 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:14.679397    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:40:14.697977 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:14.697947    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-j56jh"
Nov 04 05:40:14.916065 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:14.916026    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:14.930575 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:14.930440    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:15.437172 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:15.437141    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:15.703249 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:15.703159    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj"
Nov 04 05:40:16.663389 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:40:16.663349    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:40:24.191781 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:24.191745    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:38.651719 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.651681    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"]
Nov 04 05:40:38.655540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.655519    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.666789 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.666755    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"]
Nov 04 05:40:38.700126 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.700091    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.700296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.700142    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.700296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.700199    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.700296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.700270    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.700415 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.700318    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.700415 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.700377    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.700415 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.700398    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.700543 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.700458    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.700543 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.700490    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzcsg\" (UniqueName: \"kubernetes.io/projected/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-kube-api-access-nzcsg\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.801139 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.801098    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.801347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.801161    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.801347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.801193    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.801347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.801211    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.801347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.801233    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.801347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.801255    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzcsg\" (UniqueName: \"kubernetes.io/projected/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-kube-api-access-nzcsg\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.801347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.801295    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.801347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.801349    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.801776 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.801387    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.801910 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.801883    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.802061 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.802038    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.802127 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.802052    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.802127 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.802102    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.802235 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.802215    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.803663 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.803641    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.803953 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.803936    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.809454 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.809433    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.809598 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.809579    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzcsg\" (UniqueName: \"kubernetes.io/projected/c3be71ef-7da5-4d37-972e-e62a7ef9a8ba-kube-api-access-nzcsg\") pod \"maas-default-gateway-openshift-default-694db55c87-vbkzk\" (UID: \"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:38.971665 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:38.971626    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:39.105704 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:39.105665    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:39.205754 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:39.205711    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:39.250457 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:39.250429    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"]
Nov 04 05:40:39.252145 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:40:39.252118    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3be71ef_7da5_4d37_972e_e62a7ef9a8ba.slice/crio-22b02722ba8d7169cf17406f13923349f5523170e63402437a013ee54d25fd45 WatchSource:0}: Error finding container 22b02722ba8d7169cf17406f13923349f5523170e63402437a013ee54d25fd45: Status 404 returned error can't find the container with id 22b02722ba8d7169cf17406f13923349f5523170e63402437a013ee54d25fd45
Nov 04 05:40:39.254329 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:39.254298    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:40:39.254408 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:39.254360    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:40:39.254408 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:39.254388    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:40:39.826617 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:39.826578    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk" event={"ID":"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba","Type":"ContainerStarted","Data":"b100a09ade6ca579624f47a4511a75e2979a6c7eb94b85d493854fc2488af1ba"}
Nov 04 05:40:39.827254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:39.826669    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk" event={"ID":"c3be71ef-7da5-4d37-972e-e62a7ef9a8ba","Type":"ContainerStarted","Data":"22b02722ba8d7169cf17406f13923349f5523170e63402437a013ee54d25fd45"}
Nov 04 05:40:39.849103 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:39.849052    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk" podStartSLOduration=1.849038258 podStartE2EDuration="1.849038258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:39.846720115 +0000 UTC m=+734.704707946" watchObservedRunningTime="2026-11-04 05:40:39.849038258 +0000 UTC m=+734.707026066"
Nov 04 05:40:39.991526 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:39.973593    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:40.994672 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:40.994630    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-vbkzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:40:40.995100 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:40.994704    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk" podUID="c3be71ef-7da5-4d37-972e-e62a7ef9a8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 05:40:41.980527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:41.973950    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-vbkzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:40:41.980527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:41.974035    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk" podUID="c3be71ef-7da5-4d37-972e-e62a7ef9a8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 05:40:42.972996 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:42.972953    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-vbkzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:40:42.974377 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:42.974345    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk" podUID="c3be71ef-7da5-4d37-972e-e62a7ef9a8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 05:40:43.988527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:43.984964    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-vbkzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:40:43.988527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:43.985031    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk" podUID="c3be71ef-7da5-4d37-972e-e62a7ef9a8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 05:40:44.985994 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:44.985937    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-vbkzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:40:44.986286 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:44.986258    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk" podUID="c3be71ef-7da5-4d37-972e-e62a7ef9a8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 05:40:45.971993 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:45.971950    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-vbkzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:40:45.972399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:45.972010    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk" podUID="c3be71ef-7da5-4d37-972e-e62a7ef9a8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 05:40:46.660043 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:40:46.659999    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:40:46.972739 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:46.972695    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-vbkzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 05:40:46.973149 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:46.972780    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk" podUID="c3be71ef-7da5-4d37-972e-e62a7ef9a8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 05:40:47.977205 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:47.977175    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:47.977681 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:47.977456    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:47.978285 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:47.978265    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-vbkzk"
Nov 04 05:40:51.513603 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:51.513524    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58f5b47bf6-c4rt8"]
Nov 04 05:40:51.517784 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:51.517759    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f5b47bf6-c4rt8"
Nov 04 05:40:51.524567 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:51.524535    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f5b47bf6-c4rt8"]
Nov 04 05:40:51.626381 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:51.626339    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b1d03acd-2d0f-4053-a284-031b589768e2-tls-cert\") pod \"authorino-58f5b47bf6-c4rt8\" (UID: \"b1d03acd-2d0f-4053-a284-031b589768e2\") " pod="kuadrant-system/authorino-58f5b47bf6-c4rt8"
Nov 04 05:40:51.626601 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:51.626478    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtsht\" (UniqueName: \"kubernetes.io/projected/b1d03acd-2d0f-4053-a284-031b589768e2-kube-api-access-qtsht\") pod \"authorino-58f5b47bf6-c4rt8\" (UID: \"b1d03acd-2d0f-4053-a284-031b589768e2\") " pod="kuadrant-system/authorino-58f5b47bf6-c4rt8"
Nov 04 05:40:51.667037 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:51.667006    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:40:51.728001 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:51.727965    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b1d03acd-2d0f-4053-a284-031b589768e2-tls-cert\") pod \"authorino-58f5b47bf6-c4rt8\" (UID: \"b1d03acd-2d0f-4053-a284-031b589768e2\") " pod="kuadrant-system/authorino-58f5b47bf6-c4rt8"
Nov 04 05:40:51.728217 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:51.728026    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtsht\" (UniqueName: \"kubernetes.io/projected/b1d03acd-2d0f-4053-a284-031b589768e2-kube-api-access-qtsht\") pod \"authorino-58f5b47bf6-c4rt8\" (UID: \"b1d03acd-2d0f-4053-a284-031b589768e2\") " pod="kuadrant-system/authorino-58f5b47bf6-c4rt8"
Nov 04 05:40:51.730539 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:51.730492    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b1d03acd-2d0f-4053-a284-031b589768e2-tls-cert\") pod \"authorino-58f5b47bf6-c4rt8\" (UID: \"b1d03acd-2d0f-4053-a284-031b589768e2\") " pod="kuadrant-system/authorino-58f5b47bf6-c4rt8"
Nov 04 05:40:51.738350 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:51.738321    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtsht\" (UniqueName: \"kubernetes.io/projected/b1d03acd-2d0f-4053-a284-031b589768e2-kube-api-access-qtsht\") pod \"authorino-58f5b47bf6-c4rt8\" (UID: \"b1d03acd-2d0f-4053-a284-031b589768e2\") " pod="kuadrant-system/authorino-58f5b47bf6-c4rt8"
Nov 04 05:40:51.831786 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:51.831687    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f5b47bf6-c4rt8"
Nov 04 05:40:52.107001 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:52.106902    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f5b47bf6-c4rt8"]
Nov 04 05:40:52.900187 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:52.900147    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f5b47bf6-c4rt8" event={"ID":"b1d03acd-2d0f-4053-a284-031b589768e2","Type":"ContainerStarted","Data":"a15eebb7acd2bbe7d706c07a71b992a962deb0260b189fd9d72023e9d4670190"}
Nov 04 05:40:53.684715 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.684683    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"]
Nov 04 05:40:53.760068 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.757137    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"]
Nov 04 05:40:53.760068 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.757324    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.853588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.852960    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.853588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.853031    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.853588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.853062    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5caedfb-913d-4da3-ac56-23844cad0558-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.853588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.853135    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5caedfb-913d-4da3-ac56-23844cad0558-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.853588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.853184    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.853588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.853231    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5caedfb-913d-4da3-ac56-23844cad0558-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.853588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.853294    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp5qm\" (UniqueName: \"kubernetes.io/projected/c5caedfb-913d-4da3-ac56-23844cad0558-kube-api-access-mp5qm\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.853588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.853327    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.853588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.853357    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.945583 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.944494    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58f5b47bf6-c4rt8" event={"ID":"b1d03acd-2d0f-4053-a284-031b589768e2","Type":"ContainerStarted","Data":"c9a2fd12117db3771f7691c0aa71a2774e46a7840229cb0c192c26969878df8c"}
Nov 04 05:40:53.954536 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.954457    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.954536 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.954528    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.954785 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.954559    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5caedfb-913d-4da3-ac56-23844cad0558-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.954785 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.954634    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5caedfb-913d-4da3-ac56-23844cad0558-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.954785 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.954674    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.954785 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.954722    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5caedfb-913d-4da3-ac56-23844cad0558-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.954987 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.954789    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp5qm\" (UniqueName: \"kubernetes.io/projected/c5caedfb-913d-4da3-ac56-23844cad0558-kube-api-access-mp5qm\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.954987 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.954826    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.954987 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.954857    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.954987 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.954947    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.955238 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.955217    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.955475 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.955457    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.955921 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.955862    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.956139 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.956115    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5caedfb-913d-4da3-ac56-23844cad0558-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.958020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.957996    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5caedfb-913d-4da3-ac56-23844cad0558-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.958662 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.958640    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5caedfb-913d-4da3-ac56-23844cad0558-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.968323 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.966863    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-58f5b47bf6-c4rt8" podStartSLOduration=1.942745298 podStartE2EDuration="2.966845827s" totalImagesPullingTime="1.024100529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:53.965454651 +0000 UTC m=+748.823442482" watchObservedRunningTime="2026-11-04 05:40:53.966845827 +0000 UTC m=+748.824833659"
Nov 04 05:40:53.978121 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.978055    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5caedfb-913d-4da3-ac56-23844cad0558-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:53.987536 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:53.984224    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp5qm\" (UniqueName: \"kubernetes.io/projected/c5caedfb-913d-4da3-ac56-23844cad0558-kube-api-access-mp5qm\") pod \"maas-default-gateway-openshift-default-694db55c87-49xlm\" (UID: \"c5caedfb-913d-4da3-ac56-23844cad0558\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:54.008540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.007417    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dd68dc655-2xl4v"]
Nov 04 05:40:54.056535 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.056052    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-5dd68dc655-2xl4v" podUID="8ccecd88-f267-464e-939b-b0c30899cef9" containerName="authorino" containerID="cri-o://96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6" gracePeriod=30
Nov 04 05:40:54.131575 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.130792    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:54.541580 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.540545    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"]
Nov 04 05:40:54.565666 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.564849    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:54.565666 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.564923    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"]
Nov 04 05:40:54.589091 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.578843    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:40:54.589091 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.585842    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Nov 04 05:40:54.589091 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.586628    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Nov 04 05:40:54.589091 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.586739    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-hw9rj\""
Nov 04 05:40:54.626545 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.625858    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"]
Nov 04 05:40:54.660543 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.660324    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:40:54.661029 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.660994    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:40:54.661452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.661425    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:40:54.731592 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.731404    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:40:54.765081 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.765047    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64c4bea1-fe1c-4e05-9661-bcfab7306454-metrics-certs\") pod \"ai-gateway-controller-7db955b5ff-7c8f9\" (UID: \"64c4bea1-fe1c-4e05-9661-bcfab7306454\") " pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:40:54.765703 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.765680    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk26n\" (UniqueName: \"kubernetes.io/projected/64c4bea1-fe1c-4e05-9661-bcfab7306454-kube-api-access-pk26n\") pod \"ai-gateway-controller-7db955b5ff-7c8f9\" (UID: \"64c4bea1-fe1c-4e05-9661-bcfab7306454\") " pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:40:54.792849 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.792764    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd68dc655-2xl4v"
Nov 04 05:40:54.866765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.866713    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk26n\" (UniqueName: \"kubernetes.io/projected/64c4bea1-fe1c-4e05-9661-bcfab7306454-kube-api-access-pk26n\") pod \"ai-gateway-controller-7db955b5ff-7c8f9\" (UID: \"64c4bea1-fe1c-4e05-9661-bcfab7306454\") " pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:40:54.866765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.866762    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64c4bea1-fe1c-4e05-9661-bcfab7306454-metrics-certs\") pod \"ai-gateway-controller-7db955b5ff-7c8f9\" (UID: \"64c4bea1-fe1c-4e05-9661-bcfab7306454\") " pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:40:54.869972 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.869938    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64c4bea1-fe1c-4e05-9661-bcfab7306454-metrics-certs\") pod \"ai-gateway-controller-7db955b5ff-7c8f9\" (UID: \"64c4bea1-fe1c-4e05-9661-bcfab7306454\") " pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:40:54.958392 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.958279    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk26n\" (UniqueName: \"kubernetes.io/projected/64c4bea1-fe1c-4e05-9661-bcfab7306454-kube-api-access-pk26n\") pod \"ai-gateway-controller-7db955b5ff-7c8f9\" (UID: \"64c4bea1-fe1c-4e05-9661-bcfab7306454\") " pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:40:54.968530 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.965917    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" event={"ID":"c5caedfb-913d-4da3-ac56-23844cad0558","Type":"ContainerStarted","Data":"2d06d8a1f0cf46dc7f4a7b169cafa90b5562b4ee7681d3396010d19b6b02581e"}
Nov 04 05:40:54.968530 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.966080    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" event={"ID":"c5caedfb-913d-4da3-ac56-23844cad0558","Type":"ContainerStarted","Data":"26439e78dd36fa9eebadb900c0e24db3beab1636fb677106a32159539a5d51ca"}
Nov 04 05:40:54.969119 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.968863    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ccecd88-f267-464e-939b-b0c30899cef9-kube-api-access-zv59n\" (UniqueName: \"kubernetes.io/projected/8ccecd88-f267-464e-939b-b0c30899cef9-kube-api-access-zv59n\") pod \"8ccecd88-f267-464e-939b-b0c30899cef9\" (UID: \"8ccecd88-f267-464e-939b-b0c30899cef9\") "
Nov 04 05:40:54.969119 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.968943    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ccecd88-f267-464e-939b-b0c30899cef9-tls-cert\" (UniqueName: \"kubernetes.io/secret/8ccecd88-f267-464e-939b-b0c30899cef9-tls-cert\") pod \"8ccecd88-f267-464e-939b-b0c30899cef9\" (UID: \"8ccecd88-f267-464e-939b-b0c30899cef9\") "
Nov 04 05:40:54.987942 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.986700    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ccecd88-f267-464e-939b-b0c30899cef9-kube-api-access-zv59n" pod "8ccecd88-f267-464e-939b-b0c30899cef9" (UID: "8ccecd88-f267-464e-939b-b0c30899cef9"). InnerVolumeSpecName "kube-api-access-zv59n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:40:55.015748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.997119    5079 generic.go:356] "Generic (PLEG): container finished" podID="8ccecd88-f267-464e-939b-b0c30899cef9" containerID="96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6" exitCode=0
Nov 04 05:40:55.015748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.997900    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd68dc655-2xl4v"
Nov 04 05:40:55.015748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.998042    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd68dc655-2xl4v" event={"ID":"8ccecd88-f267-464e-939b-b0c30899cef9","Type":"ContainerDied","Data":"96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6"}
Nov 04 05:40:55.015748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.998080    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd68dc655-2xl4v" event={"ID":"8ccecd88-f267-464e-939b-b0c30899cef9","Type":"ContainerDied","Data":"59c2645b24953d234e66e1f9a58a8bb4c8c92d6fb5723fc3b286f4b026b1fe58"}
Nov 04 05:40:55.015748 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:54.998104    5079 scope.go:122] "RemoveContainer" containerID="96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6"
Nov 04 05:40:55.026530 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.019305    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podStartSLOduration=2.01928501 podStartE2EDuration="2.01928501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:40:55.016103841 +0000 UTC m=+749.874091673" watchObservedRunningTime="2026-11-04 05:40:55.01928501 +0000 UTC m=+749.877272840"
Nov 04 05:40:55.045007 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.044705    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:40:55.102871 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.102824    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv59n\" (UniqueName: \"kubernetes.io/projected/8ccecd88-f267-464e-939b-b0c30899cef9-kube-api-access-zv59n\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:40:55.117733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.117692    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ccecd88-f267-464e-939b-b0c30899cef9-tls-cert" pod "8ccecd88-f267-464e-939b-b0c30899cef9" (UID: "8ccecd88-f267-464e-939b-b0c30899cef9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:40:55.148548 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.139479    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:40:55.148548 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.139630    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-49xlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Nov 04 05:40:55.148548 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.139678    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podUID="c5caedfb-913d-4da3-ac56-23844cad0558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Nov 04 05:40:55.153234 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.152912    5079 scope.go:122] "RemoveContainer" containerID="96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6"
Nov 04 05:40:55.154314 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:40:55.153446    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6\": container with ID starting with 96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6 not found: ID does not exist" containerID="96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6"
Nov 04 05:40:55.154486 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.153487    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6"} err="failed to get container status \"96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6\": rpc error: code = NotFound desc = could not find container \"96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6\": container with ID starting with 96af6255ecfd47cbc529b9db34a5676524142a861a30edfca2c0d705d4e28ff6 not found: ID does not exist"
Nov 04 05:40:55.206581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.206551    5079 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8ccecd88-f267-464e-939b-b0c30899cef9-tls-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:40:55.331724 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.331682    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dd68dc655-2xl4v"]
Nov 04 05:40:55.333890 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.333863    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dd68dc655-2xl4v"]
Nov 04 05:40:55.428362 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:55.428337    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"]
Nov 04 05:40:55.431343 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:40:55.431301    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c4bea1_fe1c_4e05_9661_bcfab7306454.slice/crio-ea29559a973f8675f46e39841f10ef4aebc2b28680aee812c002cabf3dbfe9a8 WatchSource:0}: Error finding container ea29559a973f8675f46e39841f10ef4aebc2b28680aee812c002cabf3dbfe9a8: Status 404 returned error can't find the container with id ea29559a973f8675f46e39841f10ef4aebc2b28680aee812c002cabf3dbfe9a8
Nov 04 05:40:56.009547 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:56.009289    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9" event={"ID":"64c4bea1-fe1c-4e05-9661-bcfab7306454","Type":"ContainerStarted","Data":"ea29559a973f8675f46e39841f10ef4aebc2b28680aee812c002cabf3dbfe9a8"}
Nov 04 05:40:56.131898 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:56.131861    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-49xlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Nov 04 05:40:56.132121 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:56.131923    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podUID="c5caedfb-913d-4da3-ac56-23844cad0558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Nov 04 05:40:57.131764 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:57.131725    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-49xlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Nov 04 05:40:57.132289 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:57.131789    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podUID="c5caedfb-913d-4da3-ac56-23844cad0558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Nov 04 05:40:57.315954 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:57.311997    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8ccecd88-f267-464e-939b-b0c30899cef9" path="/var/lib/kubelet/pods/8ccecd88-f267-464e-939b-b0c30899cef9/volumes"
Nov 04 05:40:58.131398 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:58.131359    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-49xlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Nov 04 05:40:58.131596 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:58.131423    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podUID="c5caedfb-913d-4da3-ac56-23844cad0558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Nov 04 05:40:59.131769 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:59.131690    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-49xlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Nov 04 05:40:59.131769 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:40:59.131760    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podUID="c5caedfb-913d-4da3-ac56-23844cad0558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Nov 04 05:41:00.057571 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.054644    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9" event={"ID":"64c4bea1-fe1c-4e05-9661-bcfab7306454","Type":"ContainerStarted","Data":"e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076"}
Nov 04 05:41:00.057571 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.055607    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:41:00.082548 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.082466    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9" podStartSLOduration=2.048377074 podStartE2EDuration="6.082448996s" totalImagesPullingTime="4.034071922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:41:00.08195724 +0000 UTC m=+754.939945072" watchObservedRunningTime="2026-11-04 05:41:00.082448996 +0000 UTC m=+754.940436827"
Nov 04 05:41:00.132296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.131982    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-49xlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Nov 04 05:41:00.132296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.132042    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podUID="c5caedfb-913d-4da3-ac56-23844cad0558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Nov 04 05:41:00.568252 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.568208    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:41:00.603264 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.603177    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-l8b4p"]
Nov 04 05:41:00.605167 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.604153    5079 cpu_manager.go:414] "containerMap: removing container" podUID="8ccecd88-f267-464e-939b-b0c30899cef9" containerName="authorino"
Nov 04 05:41:00.605376 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.605354    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ccecd88-f267-464e-939b-b0c30899cef9" containerName="authorino"
Nov 04 05:41:00.605674 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.605658    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ccecd88-f267-464e-939b-b0c30899cef9" containerName="authorino"
Nov 04 05:41:00.612287 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.612263    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-l8b4p"]
Nov 04 05:41:00.612477 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.612465    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"]
Nov 04 05:41:00.612636 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.612384    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-l8b4p"
Nov 04 05:41:00.621474 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.620439    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"
Nov 04 05:41:00.626321 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.624382    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-l4kfq\""
Nov 04 05:41:00.626321 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.624413    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Nov 04 05:41:00.628772 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.628747    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"]
Nov 04 05:41:00.665187 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.665146    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:41:00.717112 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.716742    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glzqv\" (UniqueName: \"kubernetes.io/projected/5e007401-e826-4127-af45-411d29d3fd97-kube-api-access-glzqv\") pod \"payload-pre-processing-7b98bb678c-w9hd8\" (UID: \"5e007401-e826-4127-af45-411d29d3fd97\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"
Nov 04 05:41:00.717112 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.716844    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e007401-e826-4127-af45-411d29d3fd97-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-w9hd8\" (UID: \"5e007401-e826-4127-af45-411d29d3fd97\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"
Nov 04 05:41:00.717112 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.716907    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d6dbed6-4d50-4d61-bb77-b907c1440446-plugins-config-volume\") pod \"payload-processing-7bb9489676-l8b4p\" (UID: \"4d6dbed6-4d50-4d61-bb77-b907c1440446\") " pod="openshift-ingress/payload-processing-7bb9489676-l8b4p"
Nov 04 05:41:00.717112 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.716937    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpfn5\" (UniqueName: \"kubernetes.io/projected/4d6dbed6-4d50-4d61-bb77-b907c1440446-kube-api-access-jpfn5\") pod \"payload-processing-7bb9489676-l8b4p\" (UID: \"4d6dbed6-4d50-4d61-bb77-b907c1440446\") " pod="openshift-ingress/payload-processing-7bb9489676-l8b4p"
Nov 04 05:41:00.820605 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.819076    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glzqv\" (UniqueName: \"kubernetes.io/projected/5e007401-e826-4127-af45-411d29d3fd97-kube-api-access-glzqv\") pod \"payload-pre-processing-7b98bb678c-w9hd8\" (UID: \"5e007401-e826-4127-af45-411d29d3fd97\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"
Nov 04 05:41:00.820605 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.819177    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e007401-e826-4127-af45-411d29d3fd97-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-w9hd8\" (UID: \"5e007401-e826-4127-af45-411d29d3fd97\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"
Nov 04 05:41:00.820605 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.819243    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d6dbed6-4d50-4d61-bb77-b907c1440446-plugins-config-volume\") pod \"payload-processing-7bb9489676-l8b4p\" (UID: \"4d6dbed6-4d50-4d61-bb77-b907c1440446\") " pod="openshift-ingress/payload-processing-7bb9489676-l8b4p"
Nov 04 05:41:00.820605 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.819274    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpfn5\" (UniqueName: \"kubernetes.io/projected/4d6dbed6-4d50-4d61-bb77-b907c1440446-kube-api-access-jpfn5\") pod \"payload-processing-7bb9489676-l8b4p\" (UID: \"4d6dbed6-4d50-4d61-bb77-b907c1440446\") " pod="openshift-ingress/payload-processing-7bb9489676-l8b4p"
Nov 04 05:41:00.821185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.821151    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e007401-e826-4127-af45-411d29d3fd97-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-w9hd8\" (UID: \"5e007401-e826-4127-af45-411d29d3fd97\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"
Nov 04 05:41:00.821767 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.821726    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d6dbed6-4d50-4d61-bb77-b907c1440446-plugins-config-volume\") pod \"payload-processing-7bb9489676-l8b4p\" (UID: \"4d6dbed6-4d50-4d61-bb77-b907c1440446\") " pod="openshift-ingress/payload-processing-7bb9489676-l8b4p"
Nov 04 05:41:00.829084 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.829054    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpfn5\" (UniqueName: \"kubernetes.io/projected/4d6dbed6-4d50-4d61-bb77-b907c1440446-kube-api-access-jpfn5\") pod \"payload-processing-7bb9489676-l8b4p\" (UID: \"4d6dbed6-4d50-4d61-bb77-b907c1440446\") " pod="openshift-ingress/payload-processing-7bb9489676-l8b4p"
Nov 04 05:41:00.839108 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.839037    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glzqv\" (UniqueName: \"kubernetes.io/projected/5e007401-e826-4127-af45-411d29d3fd97-kube-api-access-glzqv\") pod \"payload-pre-processing-7b98bb678c-w9hd8\" (UID: \"5e007401-e826-4127-af45-411d29d3fd97\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"
Nov 04 05:41:00.937893 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.937858    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-l8b4p"
Nov 04 05:41:00.947565 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:00.947537    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"
Nov 04 05:41:01.132419 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:01.132375    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-49xlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Nov 04 05:41:01.132931 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:01.132443    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podUID="c5caedfb-913d-4da3-ac56-23844cad0558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Nov 04 05:41:01.263578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:01.263535    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"]
Nov 04 05:41:01.273954 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:41:01.273908    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e007401_e826_4127_af45_411d29d3fd97.slice/crio-8c993e45b9ef7853958a6a9face077a9d7c0c7631f80a864f9c85c2e50c096a5 WatchSource:0}: Error finding container 8c993e45b9ef7853958a6a9face077a9d7c0c7631f80a864f9c85c2e50c096a5: Status 404 returned error can't find the container with id 8c993e45b9ef7853958a6a9face077a9d7c0c7631f80a864f9c85c2e50c096a5
Nov 04 05:41:01.280030 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:41:01.279808    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6dbed6_4d50_4d61_bb77_b907c1440446.slice/crio-47825cbb569b1ed3014b34cb69c85bc0b840b17ac9225e16e8fb2bb9ddc0533b WatchSource:0}: Error finding container 47825cbb569b1ed3014b34cb69c85bc0b840b17ac9225e16e8fb2bb9ddc0533b: Status 404 returned error can't find the container with id 47825cbb569b1ed3014b34cb69c85bc0b840b17ac9225e16e8fb2bb9ddc0533b
Nov 04 05:41:01.283903 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:01.283871    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-l8b4p"]
Nov 04 05:41:02.097521 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:02.097252    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-l8b4p" event={"ID":"4d6dbed6-4d50-4d61-bb77-b907c1440446","Type":"ContainerStarted","Data":"47825cbb569b1ed3014b34cb69c85bc0b840b17ac9225e16e8fb2bb9ddc0533b"}
Nov 04 05:41:02.099674 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:02.099606    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8" event={"ID":"5e007401-e826-4127-af45-411d29d3fd97","Type":"ContainerStarted","Data":"8c993e45b9ef7853958a6a9face077a9d7c0c7631f80a864f9c85c2e50c096a5"}
Nov 04 05:41:02.132952 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:02.132911    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-49xlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Nov 04 05:41:02.133449 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:02.133001    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podUID="c5caedfb-913d-4da3-ac56-23844cad0558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Nov 04 05:41:03.132106 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:03.132064    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-49xlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Nov 04 05:41:03.132304 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:03.132131    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podUID="c5caedfb-913d-4da3-ac56-23844cad0558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Nov 04 05:41:05.122568 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:05.122521    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8" event={"ID":"5e007401-e826-4127-af45-411d29d3fd97","Type":"ContainerStarted","Data":"fc498e5f9b030e14415e8e9cfb64603c7d8031a0d1a6d14bf50832dd79f046ee"}
Nov 04 05:41:05.123070 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:05.122740    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"
Nov 04 05:41:05.125232 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:05.125197    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-l8b4p" event={"ID":"4d6dbed6-4d50-4d61-bb77-b907c1440446","Type":"ContainerStarted","Data":"61bdcb68eed2a5332c9b778f71eeca9e825f67d87303f87f154976eca30474ef"}
Nov 04 05:41:05.125424 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:05.125274    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bb9489676-l8b4p"
Nov 04 05:41:05.132266 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:05.132226    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-49xlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:41:05.132400 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:05.132323    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podUID="c5caedfb-913d-4da3-ac56-23844cad0558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:41:05.139639 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:05.139580    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8" podStartSLOduration=2.105925739 podStartE2EDuration="5.139560495s" totalImagesPullingTime="3.033634756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:41:05.13627517 +0000 UTC m=+759.994263000" watchObservedRunningTime="2026-11-04 05:41:05.139560495 +0000 UTC m=+759.997548325"
Nov 04 05:41:05.153156 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:05.153101    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bb9489676-l8b4p" podStartSLOduration=2.039091552 podStartE2EDuration="5.153086592s" totalImagesPullingTime="3.11399504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:41:05.150354579 +0000 UTC m=+760.008342412" watchObservedRunningTime="2026-11-04 05:41:05.153086592 +0000 UTC m=+760.011074422"
Nov 04 05:41:06.173707 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:06.173663    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-49xlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:41:06.174094 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:06.173736    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm" podUID="c5caedfb-913d-4da3-ac56-23844cad0558" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:41:06.950721 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:06.950690    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:41:06.951142 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:06.951113    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:41:06.952115 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:06.952093    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-49xlm"
Nov 04 05:41:08.694207 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.694160    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"]
Nov 04 05:41:08.698559 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.698534    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.709004 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.708975    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"]
Nov 04 05:41:08.824977 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.824939    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.825151 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.824982    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.825151 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.825095    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.825245 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.825150    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.825294 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.825274    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.825333 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.825302    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.825386 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.825350    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.825468 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.825452    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.825526 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.825480    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2p4b\" (UniqueName: \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-kube-api-access-d2p4b\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.926515 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.926467    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.926716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.926524    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.926716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.926563    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.926716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.926588    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.926716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.926654    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.926716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.926677    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.926982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.926828    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.926982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.926889    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.926982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.926922    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2p4b\" (UniqueName: \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-kube-api-access-d2p4b\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.927099 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.926969    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.927099 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.926988    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-credential-socket\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.927230 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.927206    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-certs\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.927292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.927272    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-data\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.927411 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.927390    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.929159 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.929131    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.929280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.929199    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.933845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.933808    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-token\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:08.934010 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:08.933993    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2p4b\" (UniqueName: \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-kube-api-access-d2p4b\") pod \"maas-default-gateway-openshift-default-694db55c87-29554\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:09.017011 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:09.016912    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:09.296414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:09.296380    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"]
Nov 04 05:41:09.296551 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:41:09.296437    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0bff93b_b1b8_4041_a5a4_0ffcc2cf02e9.slice/crio-6eb8f93f5e420080c5b265dcf14881a0e95b1e0d27ff8945c0085feb5b48e3dd WatchSource:0}: Error finding container 6eb8f93f5e420080c5b265dcf14881a0e95b1e0d27ff8945c0085feb5b48e3dd: Status 404 returned error can't find the container with id 6eb8f93f5e420080c5b265dcf14881a0e95b1e0d27ff8945c0085feb5b48e3dd
Nov 04 05:41:09.298816 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:09.298784    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:41:09.298930 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:09.298862    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:41:09.298930 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:09.298904    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:41:10.155636 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:10.155602    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" event={"ID":"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9","Type":"ContainerStarted","Data":"51957645f64388ecd298c90372c0482dc77effc3018851e90572117f939be913"}
Nov 04 05:41:10.156056 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:10.155655    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" event={"ID":"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9","Type":"ContainerStarted","Data":"6eb8f93f5e420080c5b265dcf14881a0e95b1e0d27ff8945c0085feb5b48e3dd"}
Nov 04 05:41:10.195592 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:10.195531    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" podStartSLOduration=2.195515307 podStartE2EDuration="2.195515307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:41:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:41:10.188151887 +0000 UTC m=+765.046139718" watchObservedRunningTime="2026-11-04 05:41:10.195515307 +0000 UTC m=+765.053503131"
Nov 04 05:41:11.017397 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:11.017358    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:11.019167 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:11.019136    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-29554 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 05:41:11.019319 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:11.019188    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 05:41:12.017694 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:12.017651    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-29554 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 05:41:12.018112 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:12.017716    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 05:41:12.102654 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:12.102622    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:41:13.018195 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:13.018150    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-29554 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 05:41:13.018742 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:13.018208    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 05:41:14.017972 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:14.017939    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-29554 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 05:41:14.018167 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:14.018002    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 05:41:15.017883 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:15.017846    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-29554 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 05:41:15.018302 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:15.017904    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 05:41:15.490525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:15.490468    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:41:16.017334 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:16.017297    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-29554 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 05:41:16.017587 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:16.017357    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 05:41:16.135471 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:16.135441    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bb9489676-l8b4p"
Nov 04 05:41:16.136018 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:16.135549    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w9hd8"
Nov 04 05:41:16.659176 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:41:16.659128    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:41:17.017581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:17.017541    5079 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-694db55c87-29554 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 05:41:17.017773 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:17.017597    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 05:41:18.021728 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:18.021700    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:18.022169 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:18.021990    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:18.022715 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:18.022698    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:41:26.977406 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:26.977362    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"]
Nov 04 05:41:26.977970 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:26.977613    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9" podUID="64c4bea1-fe1c-4e05-9661-bcfab7306454" containerName="manager" containerID="cri-o://e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076" gracePeriod=30
Nov 04 05:41:27.241080 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.241011    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:41:27.276310 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.276270    5079 generic.go:356] "Generic (PLEG): container finished" podID="64c4bea1-fe1c-4e05-9661-bcfab7306454" containerID="e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076" exitCode=0
Nov 04 05:41:27.276533 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.276312    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"
Nov 04 05:41:27.276533 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.276335    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9" event={"ID":"64c4bea1-fe1c-4e05-9661-bcfab7306454","Type":"ContainerDied","Data":"e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076"}
Nov 04 05:41:27.276533 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.276392    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7db955b5ff-7c8f9" event={"ID":"64c4bea1-fe1c-4e05-9661-bcfab7306454","Type":"ContainerDied","Data":"ea29559a973f8675f46e39841f10ef4aebc2b28680aee812c002cabf3dbfe9a8"}
Nov 04 05:41:27.276533 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.276416    5079 scope.go:122] "RemoveContainer" containerID="e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076"
Nov 04 05:41:27.288049 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.288024    5079 scope.go:122] "RemoveContainer" containerID="e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076"
Nov 04 05:41:27.288425 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:41:27.288397    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076\": container with ID starting with e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076 not found: ID does not exist" containerID="e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076"
Nov 04 05:41:27.288705 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.288665    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076"} err="failed to get container status \"e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076\": rpc error: code = NotFound desc = could not find container \"e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076\": container with ID starting with e6fc8bd415332c5710528ff4aa328811a71cdf9eabab44714c9e58b814d38076 not found: ID does not exist"
Nov 04 05:41:27.329581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.329549    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64c4bea1-fe1c-4e05-9661-bcfab7306454-kube-api-access-pk26n\" (UniqueName: \"kubernetes.io/projected/64c4bea1-fe1c-4e05-9661-bcfab7306454-kube-api-access-pk26n\") pod \"64c4bea1-fe1c-4e05-9661-bcfab7306454\" (UID: \"64c4bea1-fe1c-4e05-9661-bcfab7306454\") "
Nov 04 05:41:27.329735 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.329650    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/64c4bea1-fe1c-4e05-9661-bcfab7306454-metrics-certs\" (UniqueName: \"kubernetes.io/secret/64c4bea1-fe1c-4e05-9661-bcfab7306454-metrics-certs\") pod \"64c4bea1-fe1c-4e05-9661-bcfab7306454\" (UID: \"64c4bea1-fe1c-4e05-9661-bcfab7306454\") "
Nov 04 05:41:27.331637 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.331600    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c4bea1-fe1c-4e05-9661-bcfab7306454-kube-api-access-pk26n" pod "64c4bea1-fe1c-4e05-9661-bcfab7306454" (UID: "64c4bea1-fe1c-4e05-9661-bcfab7306454"). InnerVolumeSpecName "kube-api-access-pk26n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:41:27.331787 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.331645    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64c4bea1-fe1c-4e05-9661-bcfab7306454-metrics-certs" pod "64c4bea1-fe1c-4e05-9661-bcfab7306454" (UID: "64c4bea1-fe1c-4e05-9661-bcfab7306454"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:41:27.431583 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.431539    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk26n\" (UniqueName: \"kubernetes.io/projected/64c4bea1-fe1c-4e05-9661-bcfab7306454-kube-api-access-pk26n\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:41:27.431583 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.431575    5079 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64c4bea1-fe1c-4e05-9661-bcfab7306454-metrics-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:41:27.600196 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.600159    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"]
Nov 04 05:41:27.604083 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:27.604052    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-7db955b5ff-7c8f9"]
Nov 04 05:41:29.294717 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:29.294682    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64c4bea1-fe1c-4e05-9661-bcfab7306454" path="/var/lib/kubelet/pods/64c4bea1-fe1c-4e05-9661-bcfab7306454/volumes"
Nov 04 05:41:38.665369 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:38.665308    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:41:39.187890 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:39.187854    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:41:46.658468 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:41:46.658429    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:41:47.956079 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:47.956045    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:41:48.059754 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:48.059698    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:41:49.503298 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:49.503245    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:41:49.603356 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:41:49.603322    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:15.535376 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:15.535341    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:16.657767 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:42:16.657728    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:42:20.671544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:20.671486    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:20.769406 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:20.769377    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:21.074783 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.074704    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"]
Nov 04 05:42:21.075754 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.075725    5079 cpu_manager.go:414] "containerMap: removing container" podUID="64c4bea1-fe1c-4e05-9661-bcfab7306454" containerName="manager"
Nov 04 05:42:21.075754 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.075753    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64c4bea1-fe1c-4e05-9661-bcfab7306454" containerName="manager"
Nov 04 05:42:21.075974 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.075932    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="64c4bea1-fe1c-4e05-9661-bcfab7306454" containerName="manager"
Nov 04 05:42:21.080646 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.080617    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.087101 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.087075    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-ade2e8-openshift-default-dockercfg-9dzpp\""
Nov 04 05:42:21.092935 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.092431    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"]
Nov 04 05:42:21.173458 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.173414    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.173661 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.173546    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d61a7c-e515-4835-af73-9a4177e08880-istiod-ca-cert\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.173731 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.173677    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-istio-token\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.173731 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.173720    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-credential-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.173872 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.173846    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-envoy\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.173928 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.173917    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-data\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.173998 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.173949    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-certs\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.174054 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.174026    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d61a7c-e515-4835-af73-9a4177e08880-istio-podinfo\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.174110 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.174084    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6bv\" (UniqueName: \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-kube-api-access-4b6bv\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.229909 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.229845    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:21.240533 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.240464    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"]
Nov 04 05:42:21.245286 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.245261    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.257308 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.257273    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"]
Nov 04 05:42:21.272826 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.272789    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-f9b4a9-openshift-default-dockercfg-7nw4r\""
Nov 04 05:42:21.275240 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.275212    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-istio-token\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.275398 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.275244    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-credential-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.275398 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.275279    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-envoy\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.275398 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.275305    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-data\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.275398 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.275334    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-certs\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.275398 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.275363    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d61a7c-e515-4835-af73-9a4177e08880-istio-podinfo\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.275755 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.275411    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6bv\" (UniqueName: \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-kube-api-access-4b6bv\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.275755 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.275472    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.275755 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.275571    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d61a7c-e515-4835-af73-9a4177e08880-istiod-ca-cert\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.275755 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.275705    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-credential-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.275975 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.275826    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-certs\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.276050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.276030    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-data\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.276302 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.276283    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-socket\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.276434 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.276302    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d61a7c-e515-4835-af73-9a4177e08880-istiod-ca-cert\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.277949 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.277930    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-envoy\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.278709 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.278690    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d61a7c-e515-4835-af73-9a4177e08880-istio-podinfo\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.307427 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.307393    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-istio-token\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.309940 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.309909    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6bv\" (UniqueName: \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-kube-api-access-4b6bv\") pod \"e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") " pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.335561 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.330035    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:21.377518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.376600    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxxdm\" (UniqueName: \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-kube-api-access-vxxdm\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.377518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.376666    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-data\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.377518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.376714    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.377518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.376759    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad1f6bc-3194-46b3-bab1-6182c6534597-istiod-ca-cert\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.377518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.376790    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-token\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.377518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.376823    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-podinfo\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.377518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.376888    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-credential-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.377518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.376988    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-certs\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.377518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.377019    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-envoy\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.402518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.401637    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"]
Nov 04 05:42:21.402518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.401775    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:21.408692 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.406210    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.419523 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.418260    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"]
Nov 04 05:42:21.419709 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.419604    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-9d808e-openshift-default-dockercfg-sqq5t\""
Nov 04 05:42:21.431519 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.430931    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:21.478193 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.478154    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-data\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.479885 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.479851    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.480126 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.480108    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.480619 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.480600    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad1f6bc-3194-46b3-bab1-6182c6534597-istiod-ca-cert\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.481462 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.481444    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-token\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.482334 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.482313    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-podinfo\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.483034 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.481386    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad1f6bc-3194-46b3-bab1-6182c6534597-istiod-ca-cert\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.483182 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.480530    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.483289 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.478906    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-data\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.483485 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.483003    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.483693 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.483674    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.483875 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.483859    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-credential-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.484440 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.484238    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-credential-socket\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.484787 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.484288    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.484959 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.484943    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.485142 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.485125    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.485333 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.485314    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdtrv\" (UniqueName: \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-kube-api-access-wdtrv\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.485478 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.485465    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-certs\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.485898 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.485881    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-envoy\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.486409 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.486382    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.487635 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.487562    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.487860 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.487832    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxxdm\" (UniqueName: \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-kube-api-access-vxxdm\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.488330 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.485818    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-certs\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.488454 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.487212    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-podinfo\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.489231 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.489208    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-envoy\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.491406 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.491381    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-token\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.510566 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.510490    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxxdm\" (UniqueName: \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-kube-api-access-vxxdm\") pod \"e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") " pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.564212 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.564162    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:21.573063 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.573032    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:21.589327 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.589256    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.589441 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.589356    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.589441 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.589400    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.589441 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.589429    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.589616 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.589460    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.589616 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.589532    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.589616 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.589595    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdtrv\" (UniqueName: \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-kube-api-access-wdtrv\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.589773 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.589661    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.589773 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.589689    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.589887 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.589783    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.589887 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.589806    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.590163 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.590143    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.590278 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.590235    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.590389 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.590366    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.592602 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.592583    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.592758 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.592730    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.635869 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.631067    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.635869 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.631176    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdtrv\" (UniqueName: \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-kube-api-access-wdtrv\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.667148 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.667114    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"]
Nov 04 05:42:21.673039 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.673003    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.682991 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.682804    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"]
Nov 04 05:42:21.683839 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.683817    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-27935d-openshift-default-dockercfg-72clk\""
Nov 04 05:42:21.707838 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.707685    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:21.731654 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.731624    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"]
Nov 04 05:42:21.737420 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.737379    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:21.737561 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.737467    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:21.737561 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.737544    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:21.752052 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.752026    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:21.800048 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.800001    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.800209 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.800088    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.800209 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.800122    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.800209 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.800165    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.800412 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.800222    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ks59\" (UniqueName: \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-kube-api-access-2ks59\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.800412 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.800288    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.800412 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.800356    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.800412 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.800387    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.800688 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.800441    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.836115 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.836075    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:21.860024 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.859961    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"]
Nov 04 05:42:21.866078 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:42:21.865008    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04 WatchSource:0}: Error finding container 2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04: Status 404 returned error can't find the container with id 2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04
Nov 04 05:42:21.891280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.883306    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:21.891280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.883404    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:21.891280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.883448    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.901937    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.902013    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.902070    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.902113    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.902173    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.902200    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.902242    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.902303    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ks59\" (UniqueName: \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-kube-api-access-2ks59\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.902371    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.903900    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.904196    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.904424    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.904657    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.912762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.905689    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.929849 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.921787    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.929849 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.923300    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.929849 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.924526    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ks59\" (UniqueName: \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-kube-api-access-2ks59\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.929849 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.926321    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:21.929849 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:21.926492    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:22.015138 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.015108    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:22.119061 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.118735    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:22.134164 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.134127    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"]
Nov 04 05:42:22.143542 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.143210    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:22.143542 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.143307    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:22.143542 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.143346    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:22.327943 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.327908    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"]
Nov 04 05:42:22.329321 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:42:22.329289    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870d4866_24fe_4fa0_89dc_63a5ed9b0e02.slice/crio-8ce9054e6b6693f6e687a35bd365d0ebad84e583f74510548ae3ae613fccf1aa WatchSource:0}: Error finding container 8ce9054e6b6693f6e687a35bd365d0ebad84e583f74510548ae3ae613fccf1aa: Status 404 returned error can't find the container with id 8ce9054e6b6693f6e687a35bd365d0ebad84e583f74510548ae3ae613fccf1aa
Nov 04 05:42:22.332214 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.332179    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:22.332311 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.332256    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:22.332311 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.332289    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:22.580771 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.580623    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" event={"ID":"dad1f6bc-3194-46b3-bab1-6182c6534597","Type":"ContainerStarted","Data":"58d50c4f1deaf0619d509e02eb5e6ff3c0fa85a2c8cbd152922941b6e20cd353"}
Nov 04 05:42:22.580771 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.580732    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" event={"ID":"dad1f6bc-3194-46b3-bab1-6182c6534597","Type":"ContainerStarted","Data":"2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04"}
Nov 04 05:42:22.583132 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.583083    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" event={"ID":"d4d61a7c-e515-4835-af73-9a4177e08880","Type":"ContainerStarted","Data":"a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768"}
Nov 04 05:42:22.583268 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.583144    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" event={"ID":"d4d61a7c-e515-4835-af73-9a4177e08880","Type":"ContainerStarted","Data":"32c86c43fa447c0a8b3ceff3f8a90ffbcc9e9f8b965a2e84bce1ad4710c5bd68"}
Nov 04 05:42:22.585708 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.585193    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" event={"ID":"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6","Type":"ContainerStarted","Data":"703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363"}
Nov 04 05:42:22.585708 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.585248    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" event={"ID":"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6","Type":"ContainerStarted","Data":"29594e23c13fbda4f720f54ab66fdf379851081e9bd582fc1e902f9df92190b4"}
Nov 04 05:42:22.588104 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.588075    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" event={"ID":"870d4866-24fe-4fa0-89dc-63a5ed9b0e02","Type":"ContainerStarted","Data":"3d8bfb9ff13df6f1bdccfd228a4a58ae7a6a1c610b04b35d23432393aa0fbff6"}
Nov 04 05:42:22.588236 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.588126    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" event={"ID":"870d4866-24fe-4fa0-89dc-63a5ed9b0e02","Type":"ContainerStarted","Data":"8ce9054e6b6693f6e687a35bd365d0ebad84e583f74510548ae3ae613fccf1aa"}
Nov 04 05:42:22.603113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.603051    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" podStartSLOduration=1.603035969 podStartE2EDuration="1.603035969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:22.599783195 +0000 UTC m=+837.457771039" watchObservedRunningTime="2026-11-04 05:42:22.603035969 +0000 UTC m=+837.461023799"
Nov 04 05:42:22.628411 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.628279    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" podStartSLOduration=1.628260269 podStartE2EDuration="1.628260269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:22.627562889 +0000 UTC m=+837.485550718" watchObservedRunningTime="2026-11-04 05:42:22.628260269 +0000 UTC m=+837.486248102"
Nov 04 05:42:22.647997 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.647937    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" podStartSLOduration=1.6479175160000001 podStartE2EDuration="1.647917516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:22.644285918 +0000 UTC m=+837.502273748" watchObservedRunningTime="2026-11-04 05:42:22.647917516 +0000 UTC m=+837.505905350"
Nov 04 05:42:22.665406 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.665345    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" podStartSLOduration=1.66532667 podStartE2EDuration="1.66532667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:22.662347635 +0000 UTC m=+837.520335466" watchObservedRunningTime="2026-11-04 05:42:22.66532667 +0000 UTC m=+837.523314500"
Nov 04 05:42:22.752889 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:22.752855    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:23.016489 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.016452    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:23.022054 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.022026    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:23.402920 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.402838    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:23.408130 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.408102    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:23.564972 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.564932    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:23.570033 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.570007    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:23.593990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.593871    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:23.593990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.593924    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:23.593990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.593947    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:23.594692 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.594666    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:23.594801 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.594733    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:23.594908 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.594892    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:23.759027 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:23.758995    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:24.559323 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:24.559284    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:24.601146 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:24.601110    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:24.601861 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:24.601841    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:24.666071 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:24.666042    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:24.769473 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:24.769441    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:24.877272 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:24.877183    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:24.983677 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:24.983632    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:25.091522 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:25.090557    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:25.224483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:25.224444    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:25.392075 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:25.392039    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:25.487292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:25.487199    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:25.767453 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:25.767359    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:25.882000 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:25.881956    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:26.426879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.426844    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:26.451572 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.451531    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"]
Nov 04 05:42:26.456053 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.456030    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:42:26.465192 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.465156    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-2b14d0\""
Nov 04 05:42:26.466267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.466245    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"]
Nov 04 05:42:26.478161 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.478133    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zb2p\" (UniqueName: \"kubernetes.io/projected/595c6133-3f19-4cb0-bf5f-b69e7554278b-kube-api-access-8zb2p\") pod \"payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg\" (UID: \"595c6133-3f19-4cb0-bf5f-b69e7554278b\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:42:26.478324 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.478177    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/595c6133-3f19-4cb0-bf5f-b69e7554278b-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg\" (UID: \"595c6133-3f19-4cb0-bf5f-b69e7554278b\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:42:26.517621 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.517577    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:26.580406 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.580367    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zb2p\" (UniqueName: \"kubernetes.io/projected/595c6133-3f19-4cb0-bf5f-b69e7554278b-kube-api-access-8zb2p\") pod \"payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg\" (UID: \"595c6133-3f19-4cb0-bf5f-b69e7554278b\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:42:26.580800 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.580746    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/595c6133-3f19-4cb0-bf5f-b69e7554278b-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg\" (UID: \"595c6133-3f19-4cb0-bf5f-b69e7554278b\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:42:26.581626 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.581602    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/595c6133-3f19-4cb0-bf5f-b69e7554278b-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg\" (UID: \"595c6133-3f19-4cb0-bf5f-b69e7554278b\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:42:26.611567 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.611240    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zb2p\" (UniqueName: \"kubernetes.io/projected/595c6133-3f19-4cb0-bf5f-b69e7554278b-kube-api-access-8zb2p\") pod \"payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg\" (UID: \"595c6133-3f19-4cb0-bf5f-b69e7554278b\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:42:26.772133 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.772046    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:42:26.845247 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.845217    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:26.943278 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:26.943237    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:27.043381 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.043297    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:27.067262 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.067235    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"]
Nov 04 05:42:27.068985 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:42:27.068955    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595c6133_3f19_4cb0_bf5f_b69e7554278b.slice/crio-13be4089c70e1105d409e738ed927a6651f9c6a929181c57a11e86185d4a6e40 WatchSource:0}: Error finding container 13be4089c70e1105d409e738ed927a6651f9c6a929181c57a11e86185d4a6e40: Status 404 returned error can't find the container with id 13be4089c70e1105d409e738ed927a6651f9c6a929181c57a11e86185d4a6e40
Nov 04 05:42:27.211173 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.211142    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:27.269457 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.269420    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"]
Nov 04 05:42:27.274304 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.274277    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:42:27.278611 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.278572    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-9a0c8b-dockercfg-42gk8\""
Nov 04 05:42:27.283000 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.282972    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"]
Nov 04 05:42:27.291889 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.291860    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2\" (UID: \"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:42:27.292042 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.291959    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f7ml\" (UniqueName: \"kubernetes.io/projected/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-kube-api-access-4f7ml\") pod \"payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2\" (UID: \"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:42:27.317193 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.317113    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:27.359093 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.359065    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-9a0c8b\""
Nov 04 05:42:27.392761 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.392725    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2\" (UID: \"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:42:27.392935 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.392790    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f7ml\" (UniqueName: \"kubernetes.io/projected/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-kube-api-access-4f7ml\") pod \"payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2\" (UID: \"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:42:27.393446 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.393426    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2\" (UID: \"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:42:27.401182 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.401153    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f7ml\" (UniqueName: \"kubernetes.io/projected/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-kube-api-access-4f7ml\") pod \"payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2\" (UID: \"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:42:27.527984 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.527943    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:27.581346 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.581254    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"]
Nov 04 05:42:27.586161 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.586138    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:42:27.592444 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.592410    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-27935d-dockercfg-vzw29\""
Nov 04 05:42:27.592629 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.592457    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-27935d\""
Nov 04 05:42:27.594288 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.594263    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"]
Nov 04 05:42:27.607100 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.607071    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:42:27.617834 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.617797    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:27.628857 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.628446    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg" event={"ID":"595c6133-3f19-4cb0-bf5f-b69e7554278b","Type":"ContainerStarted","Data":"be2221b9e48ba6a5ecfc577c61b979ff5d9c53f8fbbb7e2888962fd0b58317af"}
Nov 04 05:42:27.628857 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.628561    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg" event={"ID":"595c6133-3f19-4cb0-bf5f-b69e7554278b","Type":"ContainerStarted","Data":"13be4089c70e1105d409e738ed927a6651f9c6a929181c57a11e86185d4a6e40"}
Nov 04 05:42:27.628857 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.628738    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:42:27.648682 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.648603    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg" podStartSLOduration=1.648583045 podStartE2EDuration="1.648583045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:27.646074223 +0000 UTC m=+842.504062055" watchObservedRunningTime="2026-11-04 05:42:27.648583045 +0000 UTC m=+842.506570876"
Nov 04 05:42:27.817527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.816290    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h65nw\" (UniqueName: \"kubernetes.io/projected/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-kube-api-access-h65nw\") pod \"payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7\" (UID: \"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:42:27.817527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.816487    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7\" (UID: \"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:42:27.898436 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.898029    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"]
Nov 04 05:42:27.901244 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:42:27.901206    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8bfe7f3_0f4a_4aa3_8477_217cfe25c359.slice/crio-4b695010b5937c5993452a0795208e4b2c35fc167c21dd1dde56bf722425990e WatchSource:0}: Error finding container 4b695010b5937c5993452a0795208e4b2c35fc167c21dd1dde56bf722425990e: Status 404 returned error can't find the container with id 4b695010b5937c5993452a0795208e4b2c35fc167c21dd1dde56bf722425990e
Nov 04 05:42:27.917390 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.917352    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h65nw\" (UniqueName: \"kubernetes.io/projected/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-kube-api-access-h65nw\") pod \"payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7\" (UID: \"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:42:27.917541 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.917515    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7\" (UID: \"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:42:27.918148 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.918126    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7\" (UID: \"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:42:27.925720 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.925693    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h65nw\" (UniqueName: \"kubernetes.io/projected/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-kube-api-access-h65nw\") pod \"payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7\" (UID: \"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:42:27.961064 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:27.961028    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:28.101546 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.093061    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:28.145786 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.145748    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"]
Nov 04 05:42:28.150819 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.150747    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:42:28.158460 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.158236    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"]
Nov 04 05:42:28.161144 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.161117    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-9d808e-dockercfg-5w48w\""
Nov 04 05:42:28.180534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.180461    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:28.203912 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.203879    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:42:28.221086 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.221053    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr979\" (UniqueName: \"kubernetes.io/projected/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-kube-api-access-wr979\") pod \"payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t\" (UID: \"3f9ca4aa-f1a8-455a-98e2-11942289e9ec\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:42:28.221214 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.221167    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t\" (UID: \"3f9ca4aa-f1a8-455a-98e2-11942289e9ec\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:42:28.234253 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.234200    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-9d808e\""
Nov 04 05:42:28.336643 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.335394    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr979\" (UniqueName: \"kubernetes.io/projected/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-kube-api-access-wr979\") pod \"payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t\" (UID: \"3f9ca4aa-f1a8-455a-98e2-11942289e9ec\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:42:28.336643 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.335483    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t\" (UID: \"3f9ca4aa-f1a8-455a-98e2-11942289e9ec\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:42:28.336955 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.336862    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t\" (UID: \"3f9ca4aa-f1a8-455a-98e2-11942289e9ec\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:42:28.344428 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.344396    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr979\" (UniqueName: \"kubernetes.io/projected/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-kube-api-access-wr979\") pod \"payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t\" (UID: \"3f9ca4aa-f1a8-455a-98e2-11942289e9ec\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:42:28.475589 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.475546    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:42:28.543565 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.543529    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"]
Nov 04 05:42:28.640577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.640544    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2" event={"ID":"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359","Type":"ContainerStarted","Data":"50269708228a7ae6d3d5e6336b368edc1e36224ea33f42b9d6e013de9d858fdf"}
Nov 04 05:42:28.640763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.640599    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2" event={"ID":"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359","Type":"ContainerStarted","Data":"4b695010b5937c5993452a0795208e4b2c35fc167c21dd1dde56bf722425990e"}
Nov 04 05:42:28.640763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.640638    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:42:28.642467 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.642442    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7" event={"ID":"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60","Type":"ContainerStarted","Data":"3ca02b1197e6e4f7f1d509b7142a7307768e1f46af8dca79457a427d9fcd0f0e"}
Nov 04 05:42:28.659003 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.658943    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2" podStartSLOduration=1.658924511 podStartE2EDuration="1.658924511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:28.655941237 +0000 UTC m=+843.513929107" watchObservedRunningTime="2026-11-04 05:42:28.658924511 +0000 UTC m=+843.516912344"
Nov 04 05:42:28.767637 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.767609    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"]
Nov 04 05:42:28.794712 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.794685    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:28.887685 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.887651    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:28.987723 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:28.987682    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:29.211009 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.210974    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:29.316901 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.316873    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:29.651294 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.651183    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7" event={"ID":"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60","Type":"ContainerStarted","Data":"2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e"}
Nov 04 05:42:29.651294 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.651257    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:42:29.651294 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.651197    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:29.653575 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.653545    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t" event={"ID":"3f9ca4aa-f1a8-455a-98e2-11942289e9ec","Type":"ContainerStarted","Data":"f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f"}
Nov 04 05:42:29.653743 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.653600    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t" event={"ID":"3f9ca4aa-f1a8-455a-98e2-11942289e9ec","Type":"ContainerStarted","Data":"00e7827ea4d550c182c136d92d263b0baf98b5b1bbebb6f4cb9c06e39504f0a8"}
Nov 04 05:42:29.670273 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.670228    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7" podStartSLOduration=2.67021466 podStartE2EDuration="2.67021466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:29.667924738 +0000 UTC m=+844.525912567" watchObservedRunningTime="2026-11-04 05:42:29.67021466 +0000 UTC m=+844.528202490"
Nov 04 05:42:29.687853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.687802    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t" podStartSLOduration=1.687787113 podStartE2EDuration="1.687787113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:29.68681025 +0000 UTC m=+844.544798081" watchObservedRunningTime="2026-11-04 05:42:29.687787113 +0000 UTC m=+844.545774943"
Nov 04 05:42:29.755705 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.755666    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:29.852081 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.852042    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:29.889551 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.886216    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"]
Nov 04 05:42:29.891308 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.891278    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:42:29.904622 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.904542    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"]
Nov 04 05:42:29.964547 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.964484    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76febd74-70ad-4e31-8d12-dcdafa5a51c1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp\" (UID: \"76febd74-70ad-4e31-8d12-dcdafa5a51c1\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:42:29.964732 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.964593    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmfvp\" (UniqueName: \"kubernetes.io/projected/76febd74-70ad-4e31-8d12-dcdafa5a51c1-kube-api-access-pmfvp\") pod \"payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp\" (UID: \"76febd74-70ad-4e31-8d12-dcdafa5a51c1\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:42:29.974478 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.974427    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-ade2e8\""
Nov 04 05:42:29.974956 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:29.974928    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-ade2e8-dockercfg-zlkz5\""
Nov 04 05:42:30.066074 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.066038    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76febd74-70ad-4e31-8d12-dcdafa5a51c1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp\" (UID: \"76febd74-70ad-4e31-8d12-dcdafa5a51c1\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:42:30.066635 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.066129    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmfvp\" (UniqueName: \"kubernetes.io/projected/76febd74-70ad-4e31-8d12-dcdafa5a51c1-kube-api-access-pmfvp\") pod \"payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp\" (UID: \"76febd74-70ad-4e31-8d12-dcdafa5a51c1\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:42:30.066983 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.066955    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76febd74-70ad-4e31-8d12-dcdafa5a51c1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp\" (UID: \"76febd74-70ad-4e31-8d12-dcdafa5a51c1\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:42:30.068986 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.068961    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:42:30.076914 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.076881    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmfvp\" (UniqueName: \"kubernetes.io/projected/76febd74-70ad-4e31-8d12-dcdafa5a51c1-kube-api-access-pmfvp\") pod \"payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp\" (UID: \"76febd74-70ad-4e31-8d12-dcdafa5a51c1\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:42:30.220310 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.220279    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:42:30.454308 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.454271    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:30.515902 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.515858    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"]
Nov 04 05:42:30.516097 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:42:30.516072    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76febd74_70ad_4e31_8d12_dcdafa5a51c1.slice/crio-35b97a9c2b7a3fbe508093c895f832dceb5b34018627371c5ff723f8bb885c34 WatchSource:0}: Error finding container 35b97a9c2b7a3fbe508093c895f832dceb5b34018627371c5ff723f8bb885c34: Status 404 returned error can't find the container with id 35b97a9c2b7a3fbe508093c895f832dceb5b34018627371c5ff723f8bb885c34
Nov 04 05:42:30.603983 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.603708    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:30.661860 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.661827    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp" event={"ID":"76febd74-70ad-4e31-8d12-dcdafa5a51c1","Type":"ContainerStarted","Data":"35b97a9c2b7a3fbe508093c895f832dceb5b34018627371c5ff723f8bb885c34"}
Nov 04 05:42:30.662025 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.661974    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:42:30.687662 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:30.687627    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:31.352531 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:31.351209    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:31.445172 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:31.445118    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:31.545127 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:31.545093    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:31.669888 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:31.669781    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp" event={"ID":"76febd74-70ad-4e31-8d12-dcdafa5a51c1","Type":"ContainerStarted","Data":"f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456"}
Nov 04 05:42:31.669888 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:31.669876    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:42:31.687959 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:31.687909    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp" podStartSLOduration=2.687890424 podStartE2EDuration="2.687890424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:31.685466324 +0000 UTC m=+846.543454160" watchObservedRunningTime="2026-11-04 05:42:31.687890424 +0000 UTC m=+846.545878257"
Nov 04 05:42:31.952204 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:31.952160    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:32.617451 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.617389    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"]
Nov 04 05:42:32.621644 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.621620    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.632534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.632475    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"]
Nov 04 05:42:32.633055 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.632805    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 05:42:32.633408 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.633390    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-f9b4a9-serving-cert\""
Nov 04 05:42:32.633489 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.633476    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 04 05:42:32.633640 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.633623    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 05:42:32.633749 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.633733    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dcrf5\""
Nov 04 05:42:32.665578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.665543    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:32.713702 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.713664    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28lg2\" (UniqueName: \"kubernetes.io/projected/d2042576-eeb4-4205-a6f6-f643865bc74f-kube-api-access-28lg2\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.713887 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.713730    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2042576-eeb4-4205-a6f6-f643865bc74f-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.713887 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.713815    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-metrics-certs\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.713995 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.713904    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.765165 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.765126    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:32.815279 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.815238    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.815494 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.815347    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28lg2\" (UniqueName: \"kubernetes.io/projected/d2042576-eeb4-4205-a6f6-f643865bc74f-kube-api-access-28lg2\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.815494 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.815405    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2042576-eeb4-4205-a6f6-f643865bc74f-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.815494 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.815454    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-metrics-certs\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.816420 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.816373    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2042576-eeb4-4205-a6f6-f643865bc74f-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.818102 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.818067    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-maas-api-tls\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.818401 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.818378    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-metrics-certs\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.823630 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.823607    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28lg2\" (UniqueName: \"kubernetes.io/projected/d2042576-eeb4-4205-a6f6-f643865bc74f-kube-api-access-28lg2\") pod \"maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.962287 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.962234    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:32.972835 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:32.972679    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:33.251344 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:33.251305    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"]
Nov 04 05:42:33.252674 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:42:33.252647    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2042576_eeb4_4205_a6f6_f643865bc74f.slice/crio-d218f3eea0847ab61c148f58b49b6e7068b146983f413d7475cc9bf6afce6ffe WatchSource:0}: Error finding container d218f3eea0847ab61c148f58b49b6e7068b146983f413d7475cc9bf6afce6ffe: Status 404 returned error can't find the container with id d218f3eea0847ab61c148f58b49b6e7068b146983f413d7475cc9bf6afce6ffe
Nov 04 05:42:33.254200 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:33.254183    5079 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 05:42:33.464145 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:33.464105    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:33.564659 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:33.564530    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:33.681566 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:33.681485    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:33.684462 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:33.684431    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545" event={"ID":"d2042576-eeb4-4205-a6f6-f643865bc74f","Type":"ContainerStarted","Data":"d218f3eea0847ab61c148f58b49b6e7068b146983f413d7475cc9bf6afce6ffe"}
Nov 04 05:42:34.152163 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:34.152127    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:35.098232 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:35.098190    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:35.750171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:35.750108    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:36.366475 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:36.366385    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:37.074416 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:37.074381    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:37.658574 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:37.658535    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:37.768979 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:37.768944    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545" event={"ID":"d2042576-eeb4-4205-a6f6-f643865bc74f","Type":"ContainerStarted","Data":"4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd"}
Nov 04 05:42:37.769794 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:37.769732    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:38.524523 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:38.517178    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:38.646078 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:38.646047    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:42:38.697525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:38.696205    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545" podStartSLOduration=3.098737667 podStartE2EDuration="6.696184073s" totalImagesPullingTime="3.597446406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:37.818563949 +0000 UTC m=+852.676551780" watchObservedRunningTime="2026-11-04 05:42:38.696184073 +0000 UTC m=+853.554171904"
Nov 04 05:42:39.453693 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:39.453651    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:39.553409 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:39.553380    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:39.656664 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:39.656633    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:42:40.060372 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:40.060328    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:40.174472 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:40.174437    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:40.270743 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:40.270707    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:40.389368 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:40.389265    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:42:40.665639 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:40.665539    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:42:40.928879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:40.928842    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:41.632169 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:41.632137    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:41.849155 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:41.732701    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:42:42.652909 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:42.652873    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:42.706803 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:42.706768    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:42:43.348356 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:43.348322    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:43.451397 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:43.451320    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:44.310192 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:44.310103    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:44.630368 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:44.630262    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:44.743941 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:44.743851    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:44.849632 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:44.849596    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:42:45.037528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:45.037159    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:45.138607 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:45.138423    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:45.266160 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:45.266127    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:45.366132 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:45.366019    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:45.492527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:45.489868    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:45.659705 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:45.659384    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:45.849746 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:45.849710    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:46.007630 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:46.007582    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:46.544139 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:46.544063    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:46.709020 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:42:46.708260    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:42:47.342867 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:47.342818    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:48.051622 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:48.051538    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:48.661448 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:48.661338    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:48.883577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:48.882722    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:42:49.007316 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.007277    5079 generic.go:356] "Generic (PLEG): container finished" podID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerID="703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363" exitCode=0
Nov 04 05:42:49.007559 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.007392    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" event={"ID":"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6","Type":"ContainerDied","Data":"703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363"}
Nov 04 05:42:49.007889 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.007857    5079 scope.go:122] "RemoveContainer" containerID="703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363"
Nov 04 05:42:49.010041 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.009515    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:49.010041 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.009619    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:49.010041 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.009666    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:49.011170 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.011134    5079 generic.go:356] "Generic (PLEG): container finished" podID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerID="3d8bfb9ff13df6f1bdccfd228a4a58ae7a6a1c610b04b35d23432393aa0fbff6" exitCode=0
Nov 04 05:42:49.011326 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.011306    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" event={"ID":"870d4866-24fe-4fa0-89dc-63a5ed9b0e02","Type":"ContainerDied","Data":"3d8bfb9ff13df6f1bdccfd228a4a58ae7a6a1c610b04b35d23432393aa0fbff6"}
Nov 04 05:42:49.011776 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.011760    5079 scope.go:122] "RemoveContainer" containerID="3d8bfb9ff13df6f1bdccfd228a4a58ae7a6a1c610b04b35d23432393aa0fbff6"
Nov 04 05:42:49.018540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.013794    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:49.018540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.013879    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:49.018540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.013927    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:49.448584 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.448493    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:49.500207 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.500174    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"]
Nov 04 05:42:49.507410 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.506112    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.512045 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.512014    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-2b14d0\"/\"default-dockercfg-l9x7p\""
Nov 04 05:42:49.512202 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.512143    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-2b14d0\"/\"simulator-w6-2b14d0-kserve-self-signed-certs\""
Nov 04 05:42:49.512273 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.512228    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-2b14d0\"/\"openshift-service-ca.crt\""
Nov 04 05:42:49.547131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.545383    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"]
Nov 04 05:42:49.563543 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.563336    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:49.638765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.611428    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-2b14d0\"/\"kube-root-ca.crt\""
Nov 04 05:42:49.638765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.638212    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-model-cache\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.638765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.638266    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86fae14f-6a9a-4129-bb37-b412c2faa480-tls-certs\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.638765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.638298    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8l8k\" (UniqueName: \"kubernetes.io/projected/86fae14f-6a9a-4129-bb37-b412c2faa480-kube-api-access-s8l8k\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.638765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.638329    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-tmp-dir\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.638765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.638408    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-home\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.638765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.638554    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-dshm\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.741733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.739761    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-model-cache\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.741733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.739824    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86fae14f-6a9a-4129-bb37-b412c2faa480-tls-certs\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.741733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.739856    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8l8k\" (UniqueName: \"kubernetes.io/projected/86fae14f-6a9a-4129-bb37-b412c2faa480-kube-api-access-s8l8k\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.741733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.739885    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-tmp-dir\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.741733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.739969    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-home\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.741733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.740076    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-dshm\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.741733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.741304    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-model-cache\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.742865 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.742565    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-tmp-dir\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.742865 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.742803    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-home\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.798284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.798208    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8l8k\" (UniqueName: \"kubernetes.io/projected/86fae14f-6a9a-4129-bb37-b412c2faa480-kube-api-access-s8l8k\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.816964 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.816895    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-dshm\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.830333 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.830267    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86fae14f-6a9a-4129-bb37-b412c2faa480-tls-certs\") pod \"simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") " pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:49.848551 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:49.848200    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:50.044810 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:50.042206    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" event={"ID":"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6","Type":"ContainerStarted","Data":"f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7"}
Nov 04 05:42:50.045152 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:50.045125    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" event={"ID":"870d4866-24fe-4fa0-89dc-63a5ed9b0e02","Type":"ContainerStarted","Data":"f1042fe5c408cc319ddb3c086eebe36ab2895805fe93049aa60b28bd1e4b46c8"}
Nov 04 05:42:50.229643 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:50.218216    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:50.346669 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:50.308474    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:50.540957 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:50.540904    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"]
Nov 04 05:42:50.553367 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:42:50.553332    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86fae14f_6a9a_4129_bb37_b412c2faa480.slice/crio-1b8debc6cb0461510765ddb30bcdb494351117e0e8862a46b4a12f6137c2d55d WatchSource:0}: Error finding container 1b8debc6cb0461510765ddb30bcdb494351117e0e8862a46b4a12f6137c2d55d: Status 404 returned error can't find the container with id 1b8debc6cb0461510765ddb30bcdb494351117e0e8862a46b4a12f6137c2d55d
Nov 04 05:42:50.752924 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:50.752892    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:50.754564 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:50.754532    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 04 05:42:50.754705 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:50.754589    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 04 05:42:50.841209 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:50.841169    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:50.959092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:50.958973    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:51.018556 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.017985    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:51.018556 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.018141    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:42:51.018556 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.018189    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Nov 04 05:42:51.058452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.058412    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v" event={"ID":"86fae14f-6a9a-4129-bb37-b412c2faa480","Type":"ContainerStarted","Data":"312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1"}
Nov 04 05:42:51.058452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.058457    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v" event={"ID":"86fae14f-6a9a-4129-bb37-b412c2faa480","Type":"ContainerStarted","Data":"1b8debc6cb0461510765ddb30bcdb494351117e0e8862a46b4a12f6137c2d55d"}
Nov 04 05:42:51.060836 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.060799    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:51.102526 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.101675    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v" podStartSLOduration=2.101652624 podStartE2EDuration="2.101652624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:51.08231815 +0000 UTC m=+865.940305988" watchObservedRunningTime="2026-11-04 05:42:51.101652624 +0000 UTC m=+865.959640455"
Nov 04 05:42:51.166188 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.166090    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:51.752927 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.752887    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 04 05:42:51.753381 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.752955    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 04 05:42:51.849298 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.849244    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:51.863491 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:51.863452    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:52.017446 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:52.016933    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:42:52.017446 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:52.016998    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Nov 04 05:42:52.257663 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:52.257629    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:52.657489 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:52.657404    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:52.760391 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:52.759929    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 04 05:42:52.760391 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:52.759997    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 04 05:42:53.021390 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.020933    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:42:53.021390 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.021001    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Nov 04 05:42:53.345690 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.345606    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"]
Nov 04 05:42:53.357859 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.357821    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"]
Nov 04 05:42:53.358064 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.357956    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.364712 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.364542    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-27935d\"/\"kube-root-ca.crt\""
Nov 04 05:42:53.364712 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.364666    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-27935d\"/\"default-dockercfg-r78l2\""
Nov 04 05:42:53.364965 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.364779    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:53.367347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.366733    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-27935d\"/\"simulator-w0-27935d-kserve-self-signed-certs\""
Nov 04 05:42:53.462488 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.462437    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:53.464568 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.464545    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-27935d\"/\"openshift-service-ca.crt\""
Nov 04 05:42:53.469196 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.469163    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-home\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.469340 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.469312    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-model-cache\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.469483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.469431    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wwm6\" (UniqueName: \"kubernetes.io/projected/246d0446-d674-4eb4-b6a0-a30dc42f3154-kube-api-access-4wwm6\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.469483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.469475    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-dshm\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.469684 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.469656    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-tmp-dir\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.469796 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.469697    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246d0446-d674-4eb4-b6a0-a30dc42f3154-tls-certs\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.591524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.574092    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wwm6\" (UniqueName: \"kubernetes.io/projected/246d0446-d674-4eb4-b6a0-a30dc42f3154-kube-api-access-4wwm6\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.591524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.574154    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-dshm\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.591524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.574241    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-tmp-dir\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.591524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.574267    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246d0446-d674-4eb4-b6a0-a30dc42f3154-tls-certs\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.591524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.574310    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-home\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.591524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.574400    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-model-cache\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.591524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.574926    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-model-cache\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.591524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.579343    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-tmp-dir\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.591524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.579710    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-home\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.598099 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.594286    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:53.638944 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.638181    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246d0446-d674-4eb4-b6a0-a30dc42f3154-tls-certs\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.639435 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.639378    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-dshm\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.646321 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.646258    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wwm6\" (UniqueName: \"kubernetes.io/projected/246d0446-d674-4eb4-b6a0-a30dc42f3154-kube-api-access-4wwm6\") pod \"simulator-w0-27935d-kserve-b4d66ccbf-ffpws\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") " pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.752531 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.746639    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:53.753523 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.753018    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 04 05:42:53.753523 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:53.753078    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 04 05:42:54.059604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.059472    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:54.065323 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.064833    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:42:54.065323 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.064876    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Nov 04 05:42:54.411447 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.411333    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"]
Nov 04 05:42:54.440758 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:42:54.435970    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod246d0446_d674_4eb4_b6a0_a30dc42f3154.slice/crio-26c770af5f0fe64662727499d27b2a9ee203aab5c6f7231687301b9e60158546 WatchSource:0}: Error finding container 26c770af5f0fe64662727499d27b2a9ee203aab5c6f7231687301b9e60158546: Status 404 returned error can't find the container with id 26c770af5f0fe64662727499d27b2a9ee203aab5c6f7231687301b9e60158546
Nov 04 05:42:54.557137 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.557101    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:54.636527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.620647    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:54.641109 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.641062    5079 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:42:54.641331 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.641308    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:42:54.641710 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.641677    5079 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:42:54.641790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.641730    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:42:54.757369 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.757335    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:54.758223 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.758197    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 04 05:42:54.758453 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:54.758417    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 04 05:42:55.045983 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:55.043704    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Nov 04 05:42:55.045983 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:55.043782    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Nov 04 05:42:55.157318 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:55.157232    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws" event={"ID":"246d0446-d674-4eb4-b6a0-a30dc42f3154","Type":"ContainerStarted","Data":"7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553"}
Nov 04 05:42:55.157318 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:55.157278    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws" event={"ID":"246d0446-d674-4eb4-b6a0-a30dc42f3154","Type":"ContainerStarted","Data":"26c770af5f0fe64662727499d27b2a9ee203aab5c6f7231687301b9e60158546"}
Nov 04 05:42:55.183595 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:55.182661    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws" podStartSLOduration=2.182637947 podStartE2EDuration="2.182637947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:42:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:42:55.174083679 +0000 UTC m=+870.032071510" watchObservedRunningTime="2026-11-04 05:42:55.182637947 +0000 UTC m=+870.040625796"
Nov 04 05:42:55.367922 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:55.367770    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:55.748545 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:55.748046    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:42:55.942059 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:55.941959    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:55.943994 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:55.943960    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:42:56.056151 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.054830    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:56.057371 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.057347    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:42:56.165207 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.165179    5079 generic.go:356] "Generic (PLEG): container finished" podID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerID="58d50c4f1deaf0619d509e02eb5e6ff3c0fa85a2c8cbd152922941b6e20cd353" exitCode=0
Nov 04 05:42:56.165847 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.165248    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" event={"ID":"dad1f6bc-3194-46b3-bab1-6182c6534597","Type":"ContainerDied","Data":"58d50c4f1deaf0619d509e02eb5e6ff3c0fa85a2c8cbd152922941b6e20cd353"}
Nov 04 05:42:56.165847 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.165699    5079 scope.go:122] "RemoveContainer" containerID="58d50c4f1deaf0619d509e02eb5e6ff3c0fa85a2c8cbd152922941b6e20cd353"
Nov 04 05:42:56.167193 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.167148    5079 generic.go:356] "Generic (PLEG): container finished" podID="d4d61a7c-e515-4835-af73-9a4177e08880" containerID="a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768" exitCode=0
Nov 04 05:42:56.167329 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.167305    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" event={"ID":"d4d61a7c-e515-4835-af73-9a4177e08880","Type":"ContainerDied","Data":"a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768"}
Nov 04 05:42:56.167404 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.167364    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:56.167465 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.167446    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:56.167552 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.167493    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:56.167750 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.167732    5079 scope.go:122] "RemoveContainer" containerID="a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768"
Nov 04 05:42:56.169474 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.169438    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:56.169628 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.169564    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:56.169628 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.169612    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:42:56.269368 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.269306    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:56.935572 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:56.935528    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:57.214581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:57.213784    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" event={"ID":"dad1f6bc-3194-46b3-bab1-6182c6534597","Type":"ContainerStarted","Data":"285e696e0a8257d1255f090482f47f1cf5d26c6ac1b1a680b31b97c6aecc7a34"}
Nov 04 05:42:57.220522 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:57.218116    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" event={"ID":"d4d61a7c-e515-4835-af73-9a4177e08880","Type":"ContainerStarted","Data":"9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758"}
Nov 04 05:42:57.405383 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:57.404914    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:42:57.405383 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:57.405056    5079 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Nov 04 05:42:57.405383 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:57.405104    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Nov 04 05:42:57.565171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:57.565048    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:42:57.565374 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:57.565269    5079 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:42:57.565374 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:57.565315    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 05:42:57.644980 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:57.644926    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:58.266083 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:58.266053    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:58.404675 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:58.404639    5079 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Nov 04 05:42:58.404950 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:58.404921    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Nov 04 05:42:58.565117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:58.564699    5079 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:42:58.565117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:58.564755    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 05:42:58.852432 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:58.852341    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:59.403378 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:59.403343    5079 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Nov 04 05:42:59.404069 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:59.404023    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Nov 04 05:42:59.452527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:59.452472    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:42:59.565287 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:59.565253    5079 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:42:59.565475 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:59.565310    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 05:42:59.849609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:59.849574    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:42:59.863419 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:42:59.863387    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:43:00.046083 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.046037    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:00.257149 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.257106    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:43:00.410370 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.410317    5079 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Nov 04 05:43:00.411019 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.410988    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Nov 04 05:43:00.565278 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.565184    5079 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:43:00.565278 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.565252    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 05:43:00.741692 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.741660    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:00.944546 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.944312    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"]
Nov 04 05:43:00.949409 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.949369    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:00.953540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.952567    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"]
Nov 04 05:43:00.953540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.952674    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:00.956126 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.956103    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-f9b4a9\"/\"default-dockercfg-j7xb5\""
Nov 04 05:43:00.956276 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.956236    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-f9b4a9\"/\"kube-root-ca.crt\""
Nov 04 05:43:00.956345 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.956301    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-f9b4a9\"/\"openshift-service-ca.crt\""
Nov 04 05:43:00.956536 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:00.956106    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-f9b4a9\"/\"simulator-w1-f9b4a9-kserve-self-signed-certs\""
Nov 04 05:43:01.044256 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.044211    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-dshm\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.044256 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.044263    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17057c13-819c-492c-8bf1-453505ea131d-tls-certs\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.044534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.044287    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkdk6\" (UniqueName: \"kubernetes.io/projected/17057c13-819c-492c-8bf1-453505ea131d-kube-api-access-xkdk6\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.044534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.044443    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-home\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.044534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.044523    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-tmp-dir\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.044692 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.044614    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-model-cache\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.152061 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.152016    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-dshm\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.152272 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.152069    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17057c13-819c-492c-8bf1-453505ea131d-tls-certs\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.152272 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.152099    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkdk6\" (UniqueName: \"kubernetes.io/projected/17057c13-819c-492c-8bf1-453505ea131d-kube-api-access-xkdk6\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.152272 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.152142    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-home\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.152272 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.152187    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-tmp-dir\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.152272 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.152225    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-model-cache\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.152825 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.152802    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-model-cache\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.160644 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.156891    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-home\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.160644 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.157167    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-tmp-dir\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.161122 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.161097    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-dshm\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.163337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.163311    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17057c13-819c-492c-8bf1-453505ea131d-tls-certs\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.165194 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.165171    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkdk6\" (UniqueName: \"kubernetes.io/projected/17057c13-819c-492c-8bf1-453505ea131d-kube-api-access-xkdk6\") pod \"simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") " pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.268665 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.268578    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:01.406367 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.402890    5079 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Nov 04 05:43:01.406367 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.402956    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Nov 04 05:43:01.429529 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.416102    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:01.565530 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.565173    5079 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:43:01.565530 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.565236    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 05:43:01.662803 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:01.662757    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"]
Nov 04 05:43:01.667807 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:43:01.667778    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17057c13_819c_492c_8bf1_453505ea131d.slice/crio-518164096cee4e7b86d094bf17737f216083c19164c5bae36c15738ff54adb8d WatchSource:0}: Error finding container 518164096cee4e7b86d094bf17737f216083c19164c5bae36c15738ff54adb8d: Status 404 returned error can't find the container with id 518164096cee4e7b86d094bf17737f216083c19164c5bae36c15738ff54adb8d
Nov 04 05:43:02.068231 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:02.068146    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:02.269294 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:02.269259    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg" event={"ID":"17057c13-819c-492c-8bf1-453505ea131d","Type":"ContainerStarted","Data":"d29763f3953931084bc8fbac898dc4518b3f82add7874bd09350c3b92c1482c6"}
Nov 04 05:43:02.269294 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:02.269302    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg" event={"ID":"17057c13-819c-492c-8bf1-453505ea131d","Type":"ContainerStarted","Data":"518164096cee4e7b86d094bf17737f216083c19164c5bae36c15738ff54adb8d"}
Nov 04 05:43:02.325530 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:02.322752    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg" podStartSLOduration=2.322731578 podStartE2EDuration="2.322731578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:43:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:43:02.320045518 +0000 UTC m=+877.178033349" watchObservedRunningTime="2026-11-04 05:43:02.322731578 +0000 UTC m=+877.180719406"
Nov 04 05:43:02.403963 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:02.403925    5079 patch_prober.go:29] interesting pod/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Nov 04 05:43:02.404237 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:02.404209    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Nov 04 05:43:02.565133 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:02.565043    5079 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 05:43:02.565133 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:02.565107    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 05:43:03.269123 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:03.269089    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:03.328955 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:03.328919    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:03.426782 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:03.425887    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:43:03.426985 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:03.426892    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:43:03.429860 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:03.429833    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:43:03.525091 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:03.524904    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:03.568690 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:03.568658    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:43:03.569181 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:03.569136    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:43:03.571361 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:03.570240    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:43:03.747448 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:03.747411    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:43:03.761213 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:03.761189    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:43:04.160109 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:04.160070    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:04.187322 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:04.187285    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:43:04.302634 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:04.302594    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:43:04.996520 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:04.995836    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:05.759770 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:05.759735    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:06.476245 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:06.476206    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:07.253598 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:07.253562    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:07.823407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:07.823375    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:08.137559 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:08.137435    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:08.767683 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:08.767654    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:09.453860 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:09.453824    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:10.045416 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:10.045373    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:10.635605 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:10.635565    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:11.269327 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:11.269279    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:11.284904 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:11.284874    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:11.299546 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:11.299469    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:11.383017 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:11.382989    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:43:12.158353 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:12.158317    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:12.879081 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:12.879043    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:13.485425 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:13.485385    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:13.689171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:13.689138    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:14.164674 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:14.164639    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:14.768356 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:14.768315    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:15.466699 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:15.466661    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:15.575147 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:15.575115    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:16.069297 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:16.069237    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:16.659176 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:43:16.659136    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:43:16.782063 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:16.782028    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:17.111347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.111313    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"]
Nov 04 05:43:17.115720 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.115680    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.122962 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.121984    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-9d808e\"/\"kube-root-ca.crt\""
Nov 04 05:43:17.122962 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.122113    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-9d808e\"/\"openshift-service-ca.crt\""
Nov 04 05:43:17.122962 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.122171    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-9d808e\"/\"default-dockercfg-r9vd2\""
Nov 04 05:43:17.122962 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.122901    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-9d808e\"/\"premium-w5-9d808e-kserve-self-signed-certs\""
Nov 04 05:43:17.127006 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.126978    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"]
Nov 04 05:43:17.156466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.156431    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:17.198425 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.198385    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-home\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.198425 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.198420    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12343966-5a09-45e2-800a-b885d9417e6e-tls-certs\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.198733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.198455    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-model-cache\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.198733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.198617    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-dshm\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.198733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.198655    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkkph\" (UniqueName: \"kubernetes.io/projected/12343966-5a09-45e2-800a-b885d9417e6e-kube-api-access-nkkph\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.198733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.198708    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-tmp-dir\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.299579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.299546    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkkph\" (UniqueName: \"kubernetes.io/projected/12343966-5a09-45e2-800a-b885d9417e6e-kube-api-access-nkkph\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.299755 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.299597    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-tmp-dir\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.299798 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.299783    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-home\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.299838 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.299813    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12343966-5a09-45e2-800a-b885d9417e6e-tls-certs\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.299925 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.299899    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-model-cache\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.300002 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.299984    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-dshm\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.300146 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.300123    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-tmp-dir\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.300210 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.300160    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-home\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.300318 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.300298    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-model-cache\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.302300 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.302273    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-dshm\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.302622 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.302602    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12343966-5a09-45e2-800a-b885d9417e6e-tls-certs\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.310015 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.309982    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkkph\" (UniqueName: \"kubernetes.io/projected/12343966-5a09-45e2-800a-b885d9417e6e-kube-api-access-nkkph\") pod \"premium-w5-9d808e-kserve-6bccb94fd7-jw6sh\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") " pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.433485 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.433458    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:17.465472 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.465430    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:17.718207 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.718173    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"]
Nov 04 05:43:17.720196 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:43:17.720155    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12343966_5a09_45e2_800a_b885d9417e6e.slice/crio-1251c84f185a89dfc2d7c5b1d61f673f8d0530346b69c54aae71f24cf8b6f13b WatchSource:0}: Error finding container 1251c84f185a89dfc2d7c5b1d61f673f8d0530346b69c54aae71f24cf8b6f13b: Status 404 returned error can't find the container with id 1251c84f185a89dfc2d7c5b1d61f673f8d0530346b69c54aae71f24cf8b6f13b
Nov 04 05:43:17.932783 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:17.932744    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:43:18.161790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:18.161592    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:18.429004 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:18.428965    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh" event={"ID":"12343966-5a09-45e2-800a-b885d9417e6e","Type":"ContainerStarted","Data":"fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e"}
Nov 04 05:43:18.429220 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:18.429014    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh" event={"ID":"12343966-5a09-45e2-800a-b885d9417e6e","Type":"ContainerStarted","Data":"1251c84f185a89dfc2d7c5b1d61f673f8d0530346b69c54aae71f24cf8b6f13b"}
Nov 04 05:43:18.433672 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:18.433636    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:18.448158 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:18.448089    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh" podStartSLOduration=1.448066761 podStartE2EDuration="1.448066761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:43:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:43:18.444957491 +0000 UTC m=+893.302945320" watchObservedRunningTime="2026-11-04 05:43:18.448066761 +0000 UTC m=+893.306054597"
Nov 04 05:43:19.081313 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:19.081274    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:19.763655 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:19.763614    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:20.451329 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:20.451289    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:21.067048 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:21.067004    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:21.745037 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:21.744993    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:22.256640 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:22.256603    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:22.449517 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:22.449471    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:23.064329 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.064287    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:23.858675 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.858618    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:23.945441 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.945403    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"]
Nov 04 05:43:23.950494 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.950471    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:23.955836 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.955815    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-9a0c8b\"/\"premium-w4-9a0c8b-kserve-self-signed-certs\""
Nov 04 05:43:23.956243 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.956210    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-9a0c8b\"/\"default-dockercfg-mhxj5\""
Nov 04 05:43:23.959702 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.959677    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"]
Nov 04 05:43:23.988650 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.988620    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:23.991971 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.991937    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca79b24-1161-4cdd-b7fd-0301af6f7861-tls-certs\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:23.992092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.991988    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-home\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:23.992092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.992060    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-model-cache\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:23.992169 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.992120    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-tmp-dir\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:23.992270 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.992252    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9d5d\" (UniqueName: \"kubernetes.io/projected/eca79b24-1161-4cdd-b7fd-0301af6f7861-kube-api-access-p9d5d\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:23.992308 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:23.992282    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-dshm\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.029590 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.029562    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-9a0c8b\"/\"openshift-service-ca.crt\""
Nov 04 05:43:24.029733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.029637    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-9a0c8b\"/\"kube-root-ca.crt\""
Nov 04 05:43:24.093175 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.093139    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-home\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.093175 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.093174    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-model-cache\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.093423 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.093221    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-tmp-dir\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.093423 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.093309    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9d5d\" (UniqueName: \"kubernetes.io/projected/eca79b24-1161-4cdd-b7fd-0301af6f7861-kube-api-access-p9d5d\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.093423 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.093329    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-dshm\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.093423 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.093399    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca79b24-1161-4cdd-b7fd-0301af6f7861-tls-certs\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.093673 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.093646    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-home\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.093863 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.093840    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-tmp-dir\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.093982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.093878    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-model-cache\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.095842 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.095821    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-dshm\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.096135 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.096114    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca79b24-1161-4cdd-b7fd-0301af6f7861-tls-certs\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.101243 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.101213    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9d5d\" (UniqueName: \"kubernetes.io/projected/eca79b24-1161-4cdd-b7fd-0301af6f7861-kube-api-access-p9d5d\") pod \"premium-w4-9a0c8b-kserve-674968896f-m84pg\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") " pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.270113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.270083    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:24.560989 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.560937    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"]
Nov 04 05:43:24.562281 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:43:24.562255    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeca79b24_1161_4cdd_b7fd_0301af6f7861.slice/crio-3df3ed67b65234775a48564a68c67c471cb8ff32e02883d2a5bc376f213f3846 WatchSource:0}: Error finding container 3df3ed67b65234775a48564a68c67c471cb8ff32e02883d2a5bc376f213f3846: Status 404 returned error can't find the container with id 3df3ed67b65234775a48564a68c67c471cb8ff32e02883d2a5bc376f213f3846
Nov 04 05:43:24.678292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:24.678258    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:25.353131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:25.353093    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:25.398711 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:25.398681    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:43:25.400602 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:25.400578    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:43:25.409862 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:25.409837    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:43:25.418981 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:25.412249    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vk7hk_6deb7716-c3cc-4944-99bf-dd904746d24c/ovn-acl-logging/0.log"
Nov 04 05:43:25.474422 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:25.474385    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg" event={"ID":"eca79b24-1161-4cdd-b7fd-0301af6f7861","Type":"ContainerStarted","Data":"52431375ab0358ef03a3ca1a4705141323a8694ff8b0af14e780e0f676ef6b72"}
Nov 04 05:43:25.474617 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:25.474430    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg" event={"ID":"eca79b24-1161-4cdd-b7fd-0301af6f7861","Type":"ContainerStarted","Data":"3df3ed67b65234775a48564a68c67c471cb8ff32e02883d2a5bc376f213f3846"}
Nov 04 05:43:25.491311 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:25.491255    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg" podStartSLOduration=2.491241608 podStartE2EDuration="2.491241608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:43:25.488835546 +0000 UTC m=+900.346823377" watchObservedRunningTime="2026-11-04 05:43:25.491241608 +0000 UTC m=+900.349229438"
Nov 04 05:43:26.148177 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:26.148147    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:26.270686 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:26.270650    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:26.960076 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:26.960029    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:27.434386 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:27.434354    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:27.446686 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:27.446658    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:27.501312 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:27.501279    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:43:27.547259 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:27.547228    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:28.177244 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:28.177206    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:28.958011 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:28.957969    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:29.940614 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:29.940577    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:30.376572 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:30.376205    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:30.870029 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:30.869990    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:31.439585 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:31.439523    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:31.569683 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:31.569647    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:32.325076 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:32.322994    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:33.046174 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:33.046142    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:33.844953 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:33.844919    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:34.271028 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:34.270986    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:34.289744 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:34.289713    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:34.442142 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:34.442090    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:34.572413 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:34.572319    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:43:35.257398 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:35.257358    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:35.887826 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:35.887789    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:36.270017 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.269980    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"]
Nov 04 05:43:36.275198 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.275179    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.280924 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.280896    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-f910f5-openshift-default-dockercfg-ttdqw\""
Nov 04 05:43:36.285191 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.285002    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"]
Nov 04 05:43:36.340821 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.340789    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.340991 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.340840    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxkv6\" (UniqueName: \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-kube-api-access-xxkv6\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.340991 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.340981    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.341068 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.341009    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.341068 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.341064    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.341150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.341139    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.341185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.341176    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.341217 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.341192    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/623e0836-ea01-418c-95a0-5027a0e7be4d-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.341272 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.341259    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.442166 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442132    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.442166 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442175    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.442447 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442211    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkv6\" (UniqueName: \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-kube-api-access-xxkv6\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.442447 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442262    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.442447 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442287    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.442447 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442358    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.442447 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442416    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.442754 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442469    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.442754 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442492    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/623e0836-ea01-418c-95a0-5027a0e7be4d-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.442754 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442622    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.442754 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442678    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.443029 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442834    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.443029 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.442976    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.443150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.443129    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/623e0836-ea01-418c-95a0-5027a0e7be4d-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.444952 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.444929    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.445216 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.445198    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.450109 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.450080    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.450209 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.450160    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxkv6\" (UniqueName: \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-kube-api-access-xxkv6\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.561019 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.560928    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:36.593613 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.593580    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:36.901470 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.901435    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"]
Nov 04 05:43:36.902842 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:43:36.902809    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623e0836_ea01_418c_95a0_5027a0e7be4d.slice/crio-849fec0ded064676b40a4a63df6f19793f8a0d3d68f1943cb814d0b5a8a25f75 WatchSource:0}: Error finding container 849fec0ded064676b40a4a63df6f19793f8a0d3d68f1943cb814d0b5a8a25f75: Status 404 returned error can't find the container with id 849fec0ded064676b40a4a63df6f19793f8a0d3d68f1943cb814d0b5a8a25f75
Nov 04 05:43:36.905369 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.905333    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:43:36.905467 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.905412    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:43:36.905467 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:36.905455    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:43:37.195492 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:37.195453    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:37.581591 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:37.580973    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" event={"ID":"623e0836-ea01-418c-95a0-5027a0e7be4d","Type":"ContainerStarted","Data":"f390cb41f41af142b91eaf546ce30aefd30b8cf586aee2fd26ffdd9fc03b4330"}
Nov 04 05:43:37.581591 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:37.581049    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" event={"ID":"623e0836-ea01-418c-95a0-5027a0e7be4d","Type":"ContainerStarted","Data":"849fec0ded064676b40a4a63df6f19793f8a0d3d68f1943cb814d0b5a8a25f75"}
Nov 04 05:43:37.597947 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:37.597855    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:37.601944 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:37.601611    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 05:43:37.601944 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:37.601665    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 05:43:37.958388 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:37.958353    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:38.456030 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:38.455993    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:38.612773 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:38.612730    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 05:43:38.613032 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:38.613005    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 05:43:39.165419 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:39.165379    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:39.598872 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:39.598833    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 05:43:39.599178 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:39.599146    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 05:43:40.110514 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:40.110464    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:40.598633 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:40.598566    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 05:43:40.599147 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:40.598648    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 05:43:40.758733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:40.758688    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:41.287742 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:41.287677    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" podStartSLOduration=5.287653035 podStartE2EDuration="5.287653035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:43:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:43:37.608072894 +0000 UTC m=+912.466060726" watchObservedRunningTime="2026-11-04 05:43:41.287653035 +0000 UTC m=+916.145640867"
Nov 04 05:43:41.293524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:41.290174    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:43:41.486487 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:41.486448    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:41.595151 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:41.595051    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 05:43:41.595446 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:41.595394    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 05:43:42.392525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:42.386304    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:42.598321 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:42.598284    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 05:43:42.598665 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:42.598633    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 05:43:43.047146 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:43.047113    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:43.594769 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:43.594731    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 05:43:43.595245 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:43.594798    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 05:43:43.765635 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:43.765601    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:44.600178 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:44.600146    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:44.600726 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:44.600699    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:44.601525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:44.601483    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:43:44.656425 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:44.656365    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:45.555823 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:45.555784    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:46.163762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:46.163726    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:46.659670 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:43:46.659627    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:43:46.849898 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:46.849855    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:47.464655 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:47.464613    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:48.060980 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:48.060943    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:48.769473 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:48.769427    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:49.347615 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:49.347580    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:49.958892 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:49.958854    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:50.572891 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:50.572857    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:51.277687 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.277650    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:51.458041 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.457990    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"]
Nov 04 05:43:51.471337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.471302    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.471714 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.471685    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"]
Nov 04 05:43:51.476868 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.476841    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-2b14d0-openshift-default-dockercfg-ccjw4\""
Nov 04 05:43:51.572082 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.572004    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mdzg\" (UniqueName: \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-kube-api-access-5mdzg\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.572299 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.572092    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.572299 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.572163    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.572299 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.572241    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.572439 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.572338    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.572439 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.572402    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.572544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.572436    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.572595 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.572553    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.572595 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.572585    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ef99e53-7236-44f4-91df-8d774a75ce86-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.631551 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.631513    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"]
Nov 04 05:43:51.636573 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.636534    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.647104 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.647067    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"]
Nov 04 05:43:51.650630 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.650396    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-9a0c8b-openshift-default-dockercfg-zrhdn\""
Nov 04 05:43:51.676704 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.676656    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mdzg\" (UniqueName: \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-kube-api-access-5mdzg\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.676912 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.676768    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.676912 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.676852    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.676912 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.676884    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.677092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.676938    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.677092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.677010    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.677092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.677063    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.677238 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.677110    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.677238 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.677149    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ef99e53-7236-44f4-91df-8d774a75ce86-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.678100 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.677986    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.678219 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.678100    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ef99e53-7236-44f4-91df-8d774a75ce86-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.678396 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.678374    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.678693 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.678672    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.679257 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.679237    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.681777 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.681754    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.683178 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.683151    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.686468 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.686442    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mdzg\" (UniqueName: \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-kube-api-access-5mdzg\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.686736 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.686709    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.778088 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.778049    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-envoy\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.778088 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.778088    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-podinfo\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.778319 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.778106    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f07418fd-c953-42ed-a436-2e02cdfb7a05-istiod-ca-cert\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.778373 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.778298    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-certs\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.778373 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.778354    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-credential-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.778537 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.778477    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5pvx\" (UniqueName: \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-kube-api-access-j5pvx\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.778614 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.778536    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-data\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.778717 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.778702    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.778794 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.778776    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-token\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.793307 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.793265    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:51.795120 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.795094    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.894291    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-certs\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.894348    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-credential-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.894419    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5pvx\" (UniqueName: \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-kube-api-access-j5pvx\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.894452    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-data\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.894635    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.894740    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-token\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.894790    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-envoy\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.894815    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-podinfo\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.894844    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f07418fd-c953-42ed-a436-2e02cdfb7a05-istiod-ca-cert\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.895830    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f07418fd-c953-42ed-a436-2e02cdfb7a05-istiod-ca-cert\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.896136    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-certs\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.896396    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-credential-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.896976    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-data\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.903934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.897229    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-socket\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.949382 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.946927    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-podinfo\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.949382 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.949139    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-token\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.983449 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.958874    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-envoy\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:51.983449 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:51.983370    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5pvx\" (UniqueName: \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-kube-api-access-j5pvx\") pod \"e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") " pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:52.076690 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:52.074995    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:52.117369 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:52.116456    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"]
Nov 04 05:43:52.172088 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:52.172039    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:43:52.172243 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:52.172185    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:43:52.172243 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:52.172230    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:43:52.264023 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:52.263993    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:52.874691 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:52.874650    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"]
Nov 04 05:43:52.987776 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:52.973238    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:52.993588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:52.976359    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:43:52.993903 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:52.993868    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:43:52.994084 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:52.994062    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:43:53.009048 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:53.009020    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" event={"ID":"3ef99e53-7236-44f4-91df-8d774a75ce86","Type":"ContainerStarted","Data":"c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764"}
Nov 04 05:43:53.010236 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:53.010213    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" event={"ID":"3ef99e53-7236-44f4-91df-8d774a75ce86","Type":"ContainerStarted","Data":"f5e31b7e847724967844d7805195c0ac78bb3a738f48798c333b8871bbeaccc6"}
Nov 04 05:43:53.052525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:53.048828    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" podStartSLOduration=2.048807738 podStartE2EDuration="2.048807738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:43:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:43:53.044156488 +0000 UTC m=+927.902144319" watchObservedRunningTime="2026-11-04 05:43:53.048807738 +0000 UTC m=+927.906795570"
Nov 04 05:43:53.795910 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:53.795876    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:53.814242 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:53.814108    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 05:43:53.814242 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:53.814163    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" podUID="3ef99e53-7236-44f4-91df-8d774a75ce86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 05:43:53.815261 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:53.815237    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:54.042629 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:54.042602    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" event={"ID":"f07418fd-c953-42ed-a436-2e02cdfb7a05","Type":"ContainerStarted","Data":"ab60e625284833e10ada56437d6001a114ea0368947ea8f5828ad1ec96aa12d2"}
Nov 04 05:43:54.043085 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:54.043064    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" event={"ID":"f07418fd-c953-42ed-a436-2e02cdfb7a05","Type":"ContainerStarted","Data":"d8334952ac69e8e3c11a1c5744cc3832ce994c7af0edb877c2c8b8b327483d49"}
Nov 04 05:43:54.066150 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:54.066025    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" podStartSLOduration=3.066004968 podStartE2EDuration="3.066004968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:43:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:43:54.062341067 +0000 UTC m=+928.920328922" watchObservedRunningTime="2026-11-04 05:43:54.066004968 +0000 UTC m=+928.923992799"
Nov 04 05:43:54.265478 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:54.265453    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:43:54.266838 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:54.266812    5079 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 04 05:43:54.267037 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:54.267015    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" podUID="f07418fd-c953-42ed-a436-2e02cdfb7a05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 04 05:43:54.687525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:54.681385    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:54.804528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:54.803987    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 05:43:54.804528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:54.804051    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" podUID="3ef99e53-7236-44f4-91df-8d774a75ce86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 05:43:55.265947 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:55.265907    5079 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 04 05:43:55.266562 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:55.266525    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" podUID="f07418fd-c953-42ed-a436-2e02cdfb7a05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 04 05:43:55.801526 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:55.800923    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 05:43:55.801526 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:55.800990    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" podUID="3ef99e53-7236-44f4-91df-8d774a75ce86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 05:43:55.930527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:55.930457    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:56.266128 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:56.265651    5079 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 04 05:43:56.266128 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:56.265714    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" podUID="f07418fd-c953-42ed-a436-2e02cdfb7a05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 04 05:43:56.667389 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:56.667312    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:56.796527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:56.796476    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 05:43:56.796779 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:56.796752    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" podUID="3ef99e53-7236-44f4-91df-8d774a75ce86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 05:43:57.264933 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:57.264895    5079 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 04 05:43:57.265118 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:57.264961    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" podUID="f07418fd-c953-42ed-a436-2e02cdfb7a05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 04 05:43:57.585602 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:57.585437    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:57.799525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:57.799024    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 05:43:57.799525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:57.799106    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" podUID="3ef99e53-7236-44f4-91df-8d774a75ce86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 05:43:58.259904 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:58.258805    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:58.265829 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:58.265788    5079 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 04 05:43:58.265988 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:58.265874    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" podUID="f07418fd-c953-42ed-a436-2e02cdfb7a05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 04 05:43:58.795998 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:58.795954    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 05:43:58.796675 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:58.796638    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" podUID="3ef99e53-7236-44f4-91df-8d774a75ce86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 05:43:58.861360 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:58.861281    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:59.265881 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:59.265838    5079 patch_prober.go:29] interesting pod/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Nov 04 05:43:59.266074 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:59.265921    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" podUID="f07418fd-c953-42ed-a436-2e02cdfb7a05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Nov 04 05:43:59.575385 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:59.574485    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:43:59.954294 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:59.954263    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:59.955718 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:59.955694    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:43:59.957191 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:43:59.957168    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:44:00.237323 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:00.237232    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:00.478618 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:00.478585    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:44:00.479062 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:00.479002    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:44:00.483142 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:00.483119    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:44:00.854659 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:00.854591    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:01.452599 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:01.452569    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:02.046303 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:02.046267    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:02.661100 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:02.661066    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:03.344798 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:03.344756    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:04.043331 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:04.043300    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:04.645088 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:04.645051    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:05.272342 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:05.272258    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:06.019185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:06.019152    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:06.750205 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:06.750163    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:07.357096 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:07.357065    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:07.958190 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:07.958149    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:08.591594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:08.591556    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:44:08.654269 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:08.654237    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:09.363899 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:09.363862    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:09.961327 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:09.961292    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:10.538244 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:10.538154    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:11.167140 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:11.167106    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:11.778865 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:11.778824    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:12.448409 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:12.448379    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:13.162719 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:13.162687    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:13.628900 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:13.628869    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:13.779612 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:13.779581    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:14.361656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:14.361621    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:14.967440 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:14.967407    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:15.567031 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:15.566995    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:15.663282 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:15.663250    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:16.438495 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:16.438459    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:16.666993 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:16.666957    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:16.668137 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:44:16.668106    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:44:17.236186 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:17.236156    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:17.848844 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:17.848812    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:18.456316 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:18.456282    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:19.245231 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:19.245000    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:20.142570 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:20.142529    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:20.847908 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:20.847873    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:21.675320 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:21.675287    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:22.354787 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:22.354748    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:23.057079 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:23.057040    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:23.372872 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:23.372799    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:44:23.760156 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:23.760121    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:24.710066 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:24.710029    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:24.894155 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:24.894081    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:24.988364 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:24.988260    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:25.475480 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:25.475440    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:25.575733 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:25.575693    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:26.160288 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.160196    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:26.352630 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.352596    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:26.461138 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.460992    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:26.720817 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.720734    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"]
Nov 04 05:44:26.726469 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.726449    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:26.731837 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.731741    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"]
Nov 04 05:44:26.732222 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.731972    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 05:44:26.732983 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.732959    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nsl8n\""
Nov 04 05:44:26.766033 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.765989    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3dff2ea7-c6xcz\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:26.766220 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.766074    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3dff2ea7-c6xcz\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:26.766303 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.766277    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh7cg\" (UniqueName: \"kubernetes.io/projected/f995d94d-abb9-46ae-9398-7f2507a2dc3b-kube-api-access-mh7cg\") pod \"maas-api-revoke-sub-3dff2ea7-c6xcz\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:26.868079 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.868040    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3dff2ea7-c6xcz\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:26.868263 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.868103    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3dff2ea7-c6xcz\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:26.868263 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.868223    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh7cg\" (UniqueName: \"kubernetes.io/projected/f995d94d-abb9-46ae-9398-7f2507a2dc3b-kube-api-access-mh7cg\") pod \"maas-api-revoke-sub-3dff2ea7-c6xcz\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:26.868969 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.868942    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3dff2ea7-c6xcz\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:26.870728 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.870700    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3dff2ea7-c6xcz\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:26.880910 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:26.880878    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh7cg\" (UniqueName: \"kubernetes.io/projected/f995d94d-abb9-46ae-9398-7f2507a2dc3b-kube-api-access-mh7cg\") pod \"maas-api-revoke-sub-3dff2ea7-c6xcz\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:27.046534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:27.046433    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:27.065362 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:27.065330    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:27.338130 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:27.338096    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"]
Nov 04 05:44:27.339846 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:44:27.339815    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf995d94d_abb9_46ae_9398_7f2507a2dc3b.slice/crio-ec97c6e79a4af038051f56cf2599f78c4e905e57b4983ac499c35910f4c7829a WatchSource:0}: Error finding container ec97c6e79a4af038051f56cf2599f78c4e905e57b4983ac499c35910f4c7829a: Status 404 returned error can't find the container with id ec97c6e79a4af038051f56cf2599f78c4e905e57b4983ac499c35910f4c7829a
Nov 04 05:44:27.397902 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:27.397860    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz" event={"ID":"f995d94d-abb9-46ae-9398-7f2507a2dc3b","Type":"ContainerStarted","Data":"ec97c6e79a4af038051f56cf2599f78c4e905e57b4983ac499c35910f4c7829a"}
Nov 04 05:44:27.767952 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:27.767918    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:28.360666 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:28.360631    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:28.959649 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:28.959553    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:29.428272 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.428223    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"]
Nov 04 05:44:29.438010 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.436853    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.443251 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.443222    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"]
Nov 04 05:44:29.444041 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.444009    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-f910f5\"/\"openshift-service-ca.crt\""
Nov 04 05:44:29.445267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.445241    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-f910f5\"/\"kube-root-ca.crt\""
Nov 04 05:44:29.445620 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.445389    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-f910f5\"/\"distinct-w3-f910f5-kserve-self-signed-certs\""
Nov 04 05:44:29.445620 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.445518    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-f910f5\"/\"default-dockercfg-nm5gm\""
Nov 04 05:44:29.464770 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.464740    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:29.502809 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.502773    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-tmp-dir\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.502993 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.502903    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsjdl\" (UniqueName: \"kubernetes.io/projected/524718b3-0092-4e88-a213-0e4d2263e6b6-kube-api-access-jsjdl\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.502993 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.502965    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-dshm\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.503127 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.503110    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/524718b3-0092-4e88-a213-0e4d2263e6b6-tls-certs\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.503172 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.503148    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-model-cache\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.503226 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.503180    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-home\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.604394 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.604358    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsjdl\" (UniqueName: \"kubernetes.io/projected/524718b3-0092-4e88-a213-0e4d2263e6b6-kube-api-access-jsjdl\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.604609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.604422    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-dshm\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.604609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.604552    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/524718b3-0092-4e88-a213-0e4d2263e6b6-tls-certs\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.604609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.604582    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-model-cache\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.606110 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.605918    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-model-cache\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.606692 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.606638    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-home\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.610095 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.609971    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-dshm\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.612836 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.604608    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-home\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.613243 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.613219    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-tmp-dir\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.613677 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.613656    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-tmp-dir\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.614122 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.614102    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/524718b3-0092-4e88-a213-0e4d2263e6b6-tls-certs\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.617004 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.616977    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsjdl\" (UniqueName: \"kubernetes.io/projected/524718b3-0092-4e88-a213-0e4d2263e6b6-kube-api-access-jsjdl\") pod \"distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:29.742374 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.742271    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:29.760859 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:29.760819    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:30.076181 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:44:30.076139    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod524718b3_0092_4e88_a213_0e4d2263e6b6.slice/crio-f9e7c08336d12cc5adb1888ac5f0d1d2573f6899ad6afdc3c357dd4188c15155 WatchSource:0}: Error finding container f9e7c08336d12cc5adb1888ac5f0d1d2573f6899ad6afdc3c357dd4188c15155: Status 404 returned error can't find the container with id f9e7c08336d12cc5adb1888ac5f0d1d2573f6899ad6afdc3c357dd4188c15155
Nov 04 05:44:30.076432 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:30.076405    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"]
Nov 04 05:44:30.442782 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:30.442746    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk" event={"ID":"524718b3-0092-4e88-a213-0e4d2263e6b6","Type":"ContainerStarted","Data":"4b4456f04fbaf57946bc17582d982dc516e2b56c1ac7ff15dfc45ad9012974ee"}
Nov 04 05:44:30.443184 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:30.442796    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk" event={"ID":"524718b3-0092-4e88-a213-0e4d2263e6b6","Type":"ContainerStarted","Data":"f9e7c08336d12cc5adb1888ac5f0d1d2573f6899ad6afdc3c357dd4188c15155"}
Nov 04 05:44:30.463197 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:30.463135    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk" podStartSLOduration=1.463121006 podStartE2EDuration="1.463121006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:44:30.46173394 +0000 UTC m=+965.319721780" watchObservedRunningTime="2026-11-04 05:44:30.463121006 +0000 UTC m=+965.321108835"
Nov 04 05:44:30.464132 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:30.464102    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:30.761353 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:30.761320    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:31.297159 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.297123    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:31.398318 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.398281    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:31.460951 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.460915    5079 generic.go:356] "Generic (PLEG): container finished" podID="f995d94d-abb9-46ae-9398-7f2507a2dc3b" containerID="98fb20dbf602a717ecceb9cbe9ed02a7e601b4d17a96e8bd61b0ff22f7a53668" exitCode=0
Nov 04 05:44:31.461472 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.461001    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz" event={"ID":"f995d94d-abb9-46ae-9398-7f2507a2dc3b","Type":"ContainerDied","Data":"98fb20dbf602a717ecceb9cbe9ed02a7e601b4d17a96e8bd61b0ff22f7a53668"}
Nov 04 05:44:31.659991 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.659906    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"]
Nov 04 05:44:31.669726 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.669684    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.673396 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.673365    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"]
Nov 04 05:44:31.685019 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.684990    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-9d808e\"/\"distinct-w5-9d808e-kserve-self-signed-certs\""
Nov 04 05:44:31.709152 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.709019    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:31.754086 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.754048    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8pgv\" (UniqueName: \"kubernetes.io/projected/de75450b-a274-47d0-ba6a-94b47d9f5f01-kube-api-access-n8pgv\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.754270 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.754100    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de75450b-a274-47d0-ba6a-94b47d9f5f01-tls-certs\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.754270 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.754248    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-tmp-dir\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.754385 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.754316    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-model-cache\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.754467 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.754445    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-home\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.754561 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.754485    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-dshm\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.798540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.797608    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:31.855711 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.855673    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8pgv\" (UniqueName: \"kubernetes.io/projected/de75450b-a274-47d0-ba6a-94b47d9f5f01-kube-api-access-n8pgv\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.855931 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.855722    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de75450b-a274-47d0-ba6a-94b47d9f5f01-tls-certs\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.855931 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.855797    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-tmp-dir\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.855931 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.855863    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-model-cache\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.855931 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.855930    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-home\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.856158 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.855956    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-dshm\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.856413 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.856384    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-model-cache\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.856606 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.856576    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-tmp-dir\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.856861 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.856841    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-home\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.859181 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.859159    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-dshm\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.860306 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.860282    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de75450b-a274-47d0-ba6a-94b47d9f5f01-tls-certs\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.864030 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.864012    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8pgv\" (UniqueName: \"kubernetes.io/projected/de75450b-a274-47d0-ba6a-94b47d9f5f01-kube-api-access-n8pgv\") pod \"distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") " pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:31.896489 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.896452    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:31.998348 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:31.998307    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:32.061655 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.061480    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:32.279207 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.279176    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"]
Nov 04 05:44:32.280726 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:44:32.280694    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde75450b_a274_47d0_ba6a_94b47d9f5f01.slice/crio-7cf847141221a49d13c91c23bbcc13727b1f900a00c525bdd613ea1e953543be WatchSource:0}: Error finding container 7cf847141221a49d13c91c23bbcc13727b1f900a00c525bdd613ea1e953543be: Status 404 returned error can't find the container with id 7cf847141221a49d13c91c23bbcc13727b1f900a00c525bdd613ea1e953543be
Nov 04 05:44:32.411396 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.411364    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:32.469589 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.469550    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7" event={"ID":"de75450b-a274-47d0-ba6a-94b47d9f5f01","Type":"ContainerStarted","Data":"79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0"}
Nov 04 05:44:32.470047 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.469597    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7" event={"ID":"de75450b-a274-47d0-ba6a-94b47d9f5f01","Type":"ContainerStarted","Data":"7cf847141221a49d13c91c23bbcc13727b1f900a00c525bdd613ea1e953543be"}
Nov 04 05:44:32.488611 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.488550    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7" podStartSLOduration=1.488535411 podStartE2EDuration="1.488535411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:44:32.485068442 +0000 UTC m=+967.343056400" watchObservedRunningTime="2026-11-04 05:44:32.488535411 +0000 UTC m=+967.346523241"
Nov 04 05:44:32.627295 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.627269    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:32.666965 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.666932    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-xks-ca\") pod \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") "
Nov 04 05:44:32.667171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.667023    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f995d94d-abb9-46ae-9398-7f2507a2dc3b-kube-api-access-mh7cg\" (UniqueName: \"kubernetes.io/projected/f995d94d-abb9-46ae-9398-7f2507a2dc3b-kube-api-access-mh7cg\") pod \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") "
Nov 04 05:44:32.667171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.667064    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-openshift-ca\") pod \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\" (UID: \"f995d94d-abb9-46ae-9398-7f2507a2dc3b\") "
Nov 04 05:44:32.667873 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.667844    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-openshift-ca" pod "f995d94d-abb9-46ae-9398-7f2507a2dc3b" (UID: "f995d94d-abb9-46ae-9398-7f2507a2dc3b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:44:32.670646 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.670617    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-xks-ca" pod "f995d94d-abb9-46ae-9398-7f2507a2dc3b" (UID: "f995d94d-abb9-46ae-9398-7f2507a2dc3b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:44:32.670743 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.670651    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f995d94d-abb9-46ae-9398-7f2507a2dc3b-kube-api-access-mh7cg" pod "f995d94d-abb9-46ae-9398-7f2507a2dc3b" (UID: "f995d94d-abb9-46ae-9398-7f2507a2dc3b"). InnerVolumeSpecName "kube-api-access-mh7cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:32.755726 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.755680    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:32.769205 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.769173    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-xks-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:32.769205 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.769205    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh7cg\" (UniqueName: \"kubernetes.io/projected/f995d94d-abb9-46ae-9398-7f2507a2dc3b-kube-api-access-mh7cg\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:32.769403 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.769220    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f995d94d-abb9-46ae-9398-7f2507a2dc3b-maas-api-openshift-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:32.827319 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.827217    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"]
Nov 04 05:44:32.828195 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.828172    5079 cpu_manager.go:414] "containerMap: removing container" podUID="f995d94d-abb9-46ae-9398-7f2507a2dc3b" containerName="revoke-keys"
Nov 04 05:44:32.828279 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.828199    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f995d94d-abb9-46ae-9398-7f2507a2dc3b" containerName="revoke-keys"
Nov 04 05:44:32.828381 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.828369    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="f995d94d-abb9-46ae-9398-7f2507a2dc3b" containerName="revoke-keys"
Nov 04 05:44:32.832939 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.832912    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:32.837691 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.837659    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"]
Nov 04 05:44:32.870924 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.870889    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e3392fc5-6r58z\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:32.871837 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.871015    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs9xl\" (UniqueName: \"kubernetes.io/projected/344436f0-10e1-4ec1-a5e2-944e957ca7ad-kube-api-access-qs9xl\") pod \"maas-api-revoke-sub-e3392fc5-6r58z\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:32.871837 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.871067    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e3392fc5-6r58z\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:32.972209 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.972172    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e3392fc5-6r58z\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:32.972406 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.972356    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e3392fc5-6r58z\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:32.972477 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.972461    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs9xl\" (UniqueName: \"kubernetes.io/projected/344436f0-10e1-4ec1-a5e2-944e957ca7ad-kube-api-access-qs9xl\") pod \"maas-api-revoke-sub-e3392fc5-6r58z\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:32.973016 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.972997    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e3392fc5-6r58z\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:32.974933 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.974906    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e3392fc5-6r58z\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:32.980102 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.980075    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs9xl\" (UniqueName: \"kubernetes.io/projected/344436f0-10e1-4ec1-a5e2-944e957ca7ad-kube-api-access-qs9xl\") pod \"maas-api-revoke-sub-e3392fc5-6r58z\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:32.998654 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:32.998627    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:33.154660 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:33.154564    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:33.437073 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:33.437048    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"]
Nov 04 05:44:33.467964 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:33.467912    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:33.478483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:33.478461    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz"
Nov 04 05:44:33.478834 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:33.478534    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3dff2ea7-c6xcz" event={"ID":"f995d94d-abb9-46ae-9398-7f2507a2dc3b","Type":"ContainerDied","Data":"ec97c6e79a4af038051f56cf2599f78c4e905e57b4983ac499c35910f4c7829a"}
Nov 04 05:44:33.478834 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:33.478618    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec97c6e79a4af038051f56cf2599f78c4e905e57b4983ac499c35910f4c7829a"
Nov 04 05:44:33.480267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:33.480238    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z" event={"ID":"344436f0-10e1-4ec1-a5e2-944e957ca7ad","Type":"ContainerStarted","Data":"fb032c0c4dc9f880d5e56b4f9409aade883acfb4cbdc50a381aca0604afff84b"}
Nov 04 05:44:34.120222 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:34.120136    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:34.490044 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:34.489986    5079 generic.go:356] "Generic (PLEG): container finished" podID="344436f0-10e1-4ec1-a5e2-944e957ca7ad" containerID="5531921c3d509f067dfce0f8447ecea5f198b3f4a906d05b3bf13b7e832c1a13" exitCode=0
Nov 04 05:44:34.490482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:34.490061    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z" event={"ID":"344436f0-10e1-4ec1-a5e2-944e957ca7ad","Type":"ContainerDied","Data":"5531921c3d509f067dfce0f8447ecea5f198b3f4a906d05b3bf13b7e832c1a13"}
Nov 04 05:44:34.743288 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:34.743236    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:35.408982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.408945    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:35.512480 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.512452    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:35.665765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.665653    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:35.709879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.709826    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/344436f0-10e1-4ec1-a5e2-944e957ca7ad-kube-api-access-qs9xl\" (UniqueName: \"kubernetes.io/projected/344436f0-10e1-4ec1-a5e2-944e957ca7ad-kube-api-access-qs9xl\") pod \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") "
Nov 04 05:44:35.710089 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.709915    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-xks-ca\") pod \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") "
Nov 04 05:44:35.710207 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.710187    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-openshift-ca\") pod \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\" (UID: \"344436f0-10e1-4ec1-a5e2-944e957ca7ad\") "
Nov 04 05:44:35.710739 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.710712    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-openshift-ca" pod "344436f0-10e1-4ec1-a5e2-944e957ca7ad" (UID: "344436f0-10e1-4ec1-a5e2-944e957ca7ad"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:44:35.717677 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.717638    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-xks-ca" pod "344436f0-10e1-4ec1-a5e2-944e957ca7ad" (UID: "344436f0-10e1-4ec1-a5e2-944e957ca7ad"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:44:35.717677 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.717662    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/344436f0-10e1-4ec1-a5e2-944e957ca7ad-kube-api-access-qs9xl" pod "344436f0-10e1-4ec1-a5e2-944e957ca7ad" (UID: "344436f0-10e1-4ec1-a5e2-944e957ca7ad"). InnerVolumeSpecName "kube-api-access-qs9xl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:35.812431 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.812151    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs9xl\" (UniqueName: \"kubernetes.io/projected/344436f0-10e1-4ec1-a5e2-944e957ca7ad-kube-api-access-qs9xl\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:35.812431 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.812189    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-xks-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:35.812431 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.812206    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/344436f0-10e1-4ec1-a5e2-944e957ca7ad-maas-api-openshift-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:35.813033 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.813006    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"]
Nov 04 05:44:35.813720 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.813698    5079 cpu_manager.go:414] "containerMap: removing container" podUID="344436f0-10e1-4ec1-a5e2-944e957ca7ad" containerName="revoke-keys"
Nov 04 05:44:35.813720 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.813715    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="344436f0-10e1-4ec1-a5e2-944e957ca7ad" containerName="revoke-keys"
Nov 04 05:44:35.813915 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.813818    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="344436f0-10e1-4ec1-a5e2-944e957ca7ad" containerName="revoke-keys"
Nov 04 05:44:35.817534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.817477    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:35.825256 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.825230    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"]
Nov 04 05:44:35.913130 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.913094    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bltm\" (UniqueName: \"kubernetes.io/projected/70eab7c8-032d-4542-a906-ad1bcdd9dc17-kube-api-access-2bltm\") pod \"maas-api-revoke-sub-71199809-hjkw7\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:35.913343 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.913165    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-xks-ca\") pod \"maas-api-revoke-sub-71199809-hjkw7\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:35.913343 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:35.913229    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-71199809-hjkw7\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:36.015018 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.014985    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-xks-ca\") pod \"maas-api-revoke-sub-71199809-hjkw7\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:36.015018 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.015026    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-71199809-hjkw7\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:36.015336 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.015173    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bltm\" (UniqueName: \"kubernetes.io/projected/70eab7c8-032d-4542-a906-ad1bcdd9dc17-kube-api-access-2bltm\") pod \"maas-api-revoke-sub-71199809-hjkw7\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:36.016004 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.015976    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-71199809-hjkw7\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:36.017577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.017554    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-xks-ca\") pod \"maas-api-revoke-sub-71199809-hjkw7\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:36.022820 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.022800    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bltm\" (UniqueName: \"kubernetes.io/projected/70eab7c8-032d-4542-a906-ad1bcdd9dc17-kube-api-access-2bltm\") pod \"maas-api-revoke-sub-71199809-hjkw7\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:36.063561 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.063492    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:36.134532 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.134491    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:36.420805 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.420771    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"]
Nov 04 05:44:36.422205 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:44:36.422178    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70eab7c8_032d_4542_a906_ad1bcdd9dc17.slice/crio-9650a06cf832f88678f1382b8548a707756c1e0cd863643e0d45cc2b8ac9b023 WatchSource:0}: Error finding container 9650a06cf832f88678f1382b8548a707756c1e0cd863643e0d45cc2b8ac9b023: Status 404 returned error can't find the container with id 9650a06cf832f88678f1382b8548a707756c1e0cd863643e0d45cc2b8ac9b023
Nov 04 05:44:36.508743 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.508713    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z"
Nov 04 05:44:36.508939 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.508716    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e3392fc5-6r58z" event={"ID":"344436f0-10e1-4ec1-a5e2-944e957ca7ad","Type":"ContainerDied","Data":"fb032c0c4dc9f880d5e56b4f9409aade883acfb4cbdc50a381aca0604afff84b"}
Nov 04 05:44:36.508939 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.508865    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb032c0c4dc9f880d5e56b4f9409aade883acfb4cbdc50a381aca0604afff84b"
Nov 04 05:44:36.510394 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.510371    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7" event={"ID":"70eab7c8-032d-4542-a906-ad1bcdd9dc17","Type":"ContainerStarted","Data":"9650a06cf832f88678f1382b8548a707756c1e0cd863643e0d45cc2b8ac9b023"}
Nov 04 05:44:36.667978 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.667948    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:36.954822 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:36.954733    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:37.387348 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:37.387307    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"]
Nov 04 05:44:37.478473 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:37.478244    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:37.524925 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:37.524813    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7" event={"ID":"70eab7c8-032d-4542-a906-ad1bcdd9dc17","Type":"ContainerDied","Data":"1a662d85e2604fefa07f458ae57871188bea13287ae43722321bda43fdfca525"}
Nov 04 05:44:37.525152 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:37.524666    5079 generic.go:356] "Generic (PLEG): container finished" podID="70eab7c8-032d-4542-a906-ad1bcdd9dc17" containerID="1a662d85e2604fefa07f458ae57871188bea13287ae43722321bda43fdfca525" exitCode=0
Nov 04 05:44:37.550712 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:37.550680    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:38.250483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.250450    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:38.701947 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.701912    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:38.852075 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.851987    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-xks-ca\") pod \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") "
Nov 04 05:44:38.852075 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.852039    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70eab7c8-032d-4542-a906-ad1bcdd9dc17-kube-api-access-2bltm\" (UniqueName: \"kubernetes.io/projected/70eab7c8-032d-4542-a906-ad1bcdd9dc17-kube-api-access-2bltm\") pod \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") "
Nov 04 05:44:38.852075 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.852072    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-openshift-ca\") pod \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\" (UID: \"70eab7c8-032d-4542-a906-ad1bcdd9dc17\") "
Nov 04 05:44:38.852697 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.852662    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-openshift-ca" pod "70eab7c8-032d-4542-a906-ad1bcdd9dc17" (UID: "70eab7c8-032d-4542-a906-ad1bcdd9dc17"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:44:38.854359 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.854332    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-xks-ca" pod "70eab7c8-032d-4542-a906-ad1bcdd9dc17" (UID: "70eab7c8-032d-4542-a906-ad1bcdd9dc17"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:44:38.854359 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.854335    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70eab7c8-032d-4542-a906-ad1bcdd9dc17-kube-api-access-2bltm" pod "70eab7c8-032d-4542-a906-ad1bcdd9dc17" (UID: "70eab7c8-032d-4542-a906-ad1bcdd9dc17"). InnerVolumeSpecName "kube-api-access-2bltm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:38.954311 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.954257    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-xks-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:38.954466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.954315    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bltm\" (UniqueName: \"kubernetes.io/projected/70eab7c8-032d-4542-a906-ad1bcdd9dc17-kube-api-access-2bltm\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:38.954466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.954337    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/70eab7c8-032d-4542-a906-ad1bcdd9dc17-maas-api-openshift-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:38.964451 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:38.964406    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:39.541016 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:39.540988    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7"
Nov 04 05:44:39.541016 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:39.541003    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-71199809-hjkw7" event={"ID":"70eab7c8-032d-4542-a906-ad1bcdd9dc17","Type":"ContainerDied","Data":"9650a06cf832f88678f1382b8548a707756c1e0cd863643e0d45cc2b8ac9b023"}
Nov 04 05:44:39.541633 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:39.541046    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9650a06cf832f88678f1382b8548a707756c1e0cd863643e0d45cc2b8ac9b023"
Nov 04 05:44:39.765220 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:39.763839    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:39.771547 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:39.766783    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:39.783651 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:39.781974    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:40.394528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:40.393990    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"]
Nov 04 05:44:40.463268 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:40.463222    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:40.556713 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:40.555081    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:40.765935 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:40.765717    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:44:41.069332 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:41.069234    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:41.521130 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:41.521100    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:41.845147 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:41.845047    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:41.998732 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:41.998694    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:42.013348 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.013313    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:42.035224 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.035190    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"]
Nov 04 05:44:42.035887 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.035864    5079 cpu_manager.go:414] "containerMap: removing container" podUID="70eab7c8-032d-4542-a906-ad1bcdd9dc17" containerName="revoke-keys"
Nov 04 05:44:42.035887 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.035885    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="70eab7c8-032d-4542-a906-ad1bcdd9dc17" containerName="revoke-keys"
Nov 04 05:44:42.036018 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.035976    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="70eab7c8-032d-4542-a906-ad1bcdd9dc17" containerName="revoke-keys"
Nov 04 05:44:42.039353 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.039338    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:42.042763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.042737    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nsl8n\""
Nov 04 05:44:42.042890 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.042818    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 05:44:42.045389 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.045365    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"]
Nov 04 05:44:42.146397 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.146306    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6xvj\" (UniqueName: \"kubernetes.io/projected/22713897-972b-44f4-bc1f-5d0786f45dae-kube-api-access-m6xvj\") pod \"maas-api-revoke-sub-94658290-8vppk\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:42.146603 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.146580    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-xks-ca\") pod \"maas-api-revoke-sub-94658290-8vppk\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:42.146665 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.146633    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-94658290-8vppk\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:42.248284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.248247    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-xks-ca\") pod \"maas-api-revoke-sub-94658290-8vppk\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:42.248472 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.248314    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-94658290-8vppk\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:42.248472 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.248391    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xvj\" (UniqueName: \"kubernetes.io/projected/22713897-972b-44f4-bc1f-5d0786f45dae-kube-api-access-m6xvj\") pod \"maas-api-revoke-sub-94658290-8vppk\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:42.249038 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.249014    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-94658290-8vppk\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:42.250853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.250832    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-xks-ca\") pod \"maas-api-revoke-sub-94658290-8vppk\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:42.257689 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.257662    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xvj\" (UniqueName: \"kubernetes.io/projected/22713897-972b-44f4-bc1f-5d0786f45dae-kube-api-access-m6xvj\") pod \"maas-api-revoke-sub-94658290-8vppk\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:42.357098 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.357053    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:42.631708 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.631646    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:42.635821 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.632971    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:44:42.673736 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:42.671617    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"]
Nov 04 05:44:43.054972 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:43.054936    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:43.289179 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:43.288812    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"]
Nov 04 05:44:43.294577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:43.294521    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:43.394767 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:43.394728    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:43.562661 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:43.562543    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:43.632264 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:43.632065    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk" event={"ID":"22713897-972b-44f4-bc1f-5d0786f45dae","Type":"ContainerStarted","Data":"a628c5cc6ffe3364be1e50bcdfa01891882e2250b939390ddcad7a681465de57"}
Nov 04 05:44:43.632264 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:43.632127    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk" event={"ID":"22713897-972b-44f4-bc1f-5d0786f45dae","Type":"ContainerStarted","Data":"240d8520af51ba0c15d22c1c2f68ba8fbb287cf97c17f8828b4b37910fbab88a"}
Nov 04 05:44:43.649047 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:43.648961    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk" podStartSLOduration=1.6489467690000001 podStartE2EDuration="1.648946769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:44:43.647767878 +0000 UTC m=+978.505755709" watchObservedRunningTime="2026-11-04 05:44:43.648946769 +0000 UTC m=+978.506934603"
Nov 04 05:44:44.038387 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:44.038347    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:44.197772 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:44.197736    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:44.639185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:44.639150    5079 generic.go:356] "Generic (PLEG): container finished" podID="22713897-972b-44f4-bc1f-5d0786f45dae" containerID="a628c5cc6ffe3364be1e50bcdfa01891882e2250b939390ddcad7a681465de57" exitCode=0
Nov 04 05:44:44.639361 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:44.639235    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk" event={"ID":"22713897-972b-44f4-bc1f-5d0786f45dae","Type":"ContainerDied","Data":"a628c5cc6ffe3364be1e50bcdfa01891882e2250b939390ddcad7a681465de57"}
Nov 04 05:44:44.769104 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:44.769073    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:45.639020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:45.638866    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:45.833620 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:45.833593    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:45.901764 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:45.901678    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-xks-ca\") pod \"22713897-972b-44f4-bc1f-5d0786f45dae\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") "
Nov 04 05:44:45.901926 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:45.901790    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22713897-972b-44f4-bc1f-5d0786f45dae-kube-api-access-m6xvj\" (UniqueName: \"kubernetes.io/projected/22713897-972b-44f4-bc1f-5d0786f45dae-kube-api-access-m6xvj\") pod \"22713897-972b-44f4-bc1f-5d0786f45dae\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") "
Nov 04 05:44:45.901998 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:45.901967    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-openshift-ca\") pod \"22713897-972b-44f4-bc1f-5d0786f45dae\" (UID: \"22713897-972b-44f4-bc1f-5d0786f45dae\") "
Nov 04 05:44:45.902292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:45.902267    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-openshift-ca" pod "22713897-972b-44f4-bc1f-5d0786f45dae" (UID: "22713897-972b-44f4-bc1f-5d0786f45dae"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:44:45.902429 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:45.902414    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-openshift-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:45.904018 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:45.903989    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22713897-972b-44f4-bc1f-5d0786f45dae-kube-api-access-m6xvj" pod "22713897-972b-44f4-bc1f-5d0786f45dae" (UID: "22713897-972b-44f4-bc1f-5d0786f45dae"). InnerVolumeSpecName "kube-api-access-m6xvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:45.904117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:45.904034    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-xks-ca" pod "22713897-972b-44f4-bc1f-5d0786f45dae" (UID: "22713897-972b-44f4-bc1f-5d0786f45dae"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:44:46.003569 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:46.003496    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/22713897-972b-44f4-bc1f-5d0786f45dae-maas-api-xks-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:46.003569 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:46.003564    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6xvj\" (UniqueName: \"kubernetes.io/projected/22713897-972b-44f4-bc1f-5d0786f45dae-kube-api-access-m6xvj\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:46.358399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:46.358357    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:46.662194 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:46.662028    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk"
Nov 04 05:44:46.662687 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:46.662101    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-94658290-8vppk" event={"ID":"22713897-972b-44f4-bc1f-5d0786f45dae","Type":"ContainerDied","Data":"240d8520af51ba0c15d22c1c2f68ba8fbb287cf97c17f8828b4b37910fbab88a"}
Nov 04 05:44:46.662687 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:46.662425    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="240d8520af51ba0c15d22c1c2f68ba8fbb287cf97c17f8828b4b37910fbab88a"
Nov 04 05:44:46.679839 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:44:46.679796    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:44:47.076598 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:47.076550    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:47.206979 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:47.206947    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:47.776734 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:47.776690    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:48.098398 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.098309    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:48.198967 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.198927    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:48.300518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.294543    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp" podUID="76febd74-70ad-4e31-8d12-dcdafa5a51c1" containerName="payload-processing" containerID="cri-o://f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456" gracePeriod=25
Nov 04 05:44:48.517934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.517903    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"]
Nov 04 05:44:48.518795 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.518772    5079 cpu_manager.go:414] "containerMap: removing container" podUID="22713897-972b-44f4-bc1f-5d0786f45dae" containerName="revoke-keys"
Nov 04 05:44:48.518874 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.518797    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22713897-972b-44f4-bc1f-5d0786f45dae" containerName="revoke-keys"
Nov 04 05:44:48.518968 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.518955    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="22713897-972b-44f4-bc1f-5d0786f45dae" containerName="revoke-keys"
Nov 04 05:44:48.526904 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.523221    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:48.530936 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.530432    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nsl8n\""
Nov 04 05:44:48.530936 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.530479    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 05:44:48.530936 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.530818    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"]
Nov 04 05:44:48.614851 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.614783    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:44:48.649105 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.649061    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a24ab2f5-l6mwl\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:48.649296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.649181    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjcs7\" (UniqueName: \"kubernetes.io/projected/b3a881d7-3de2-416c-a6a2-2a9503249471-kube-api-access-xjcs7\") pod \"maas-api-revoke-sub-a24ab2f5-l6mwl\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:48.649397 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.649379    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a24ab2f5-l6mwl\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:48.681959 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.681928    5079 generic.go:356] "Generic (PLEG): container finished" podID="76febd74-70ad-4e31-8d12-dcdafa5a51c1" containerID="f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456" exitCode=0
Nov 04 05:44:48.682174 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.682006    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp" event={"ID":"76febd74-70ad-4e31-8d12-dcdafa5a51c1","Type":"ContainerDied","Data":"f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456"}
Nov 04 05:44:48.682174 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.682049    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp" event={"ID":"76febd74-70ad-4e31-8d12-dcdafa5a51c1","Type":"ContainerDied","Data":"35b97a9c2b7a3fbe508093c895f832dceb5b34018627371c5ff723f8bb885c34"}
Nov 04 05:44:48.682174 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.682071    5079 scope.go:122] "RemoveContainer" containerID="f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456"
Nov 04 05:44:48.682340 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.682198    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"
Nov 04 05:44:48.696418 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.696347    5079 scope.go:122] "RemoveContainer" containerID="f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456"
Nov 04 05:44:48.698779 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:44:48.698704    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456\": container with ID starting with f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456 not found: ID does not exist" containerID="f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456"
Nov 04 05:44:48.698779 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.698745    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456"} err="failed to get container status \"f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456\": rpc error: code = NotFound desc = could not find container \"f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456\": container with ID starting with f9866cd03fc4568096d4d9def83d45c3ee78485afdc3d86fe5cdb6c1bb01a456 not found: ID does not exist"
Nov 04 05:44:48.750571 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.750534    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76febd74-70ad-4e31-8d12-dcdafa5a51c1-kube-api-access-pmfvp\" (UniqueName: \"kubernetes.io/projected/76febd74-70ad-4e31-8d12-dcdafa5a51c1-kube-api-access-pmfvp\") pod \"76febd74-70ad-4e31-8d12-dcdafa5a51c1\" (UID: \"76febd74-70ad-4e31-8d12-dcdafa5a51c1\") "
Nov 04 05:44:48.750760 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.750696    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/76febd74-70ad-4e31-8d12-dcdafa5a51c1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76febd74-70ad-4e31-8d12-dcdafa5a51c1-plugins-config-volume\") pod \"76febd74-70ad-4e31-8d12-dcdafa5a51c1\" (UID: \"76febd74-70ad-4e31-8d12-dcdafa5a51c1\") "
Nov 04 05:44:48.750913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.750890    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjcs7\" (UniqueName: \"kubernetes.io/projected/b3a881d7-3de2-416c-a6a2-2a9503249471-kube-api-access-xjcs7\") pod \"maas-api-revoke-sub-a24ab2f5-l6mwl\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:48.751078 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.751062    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a24ab2f5-l6mwl\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:48.751078 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.751063    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76febd74-70ad-4e31-8d12-dcdafa5a51c1-plugins-config-volume" pod "76febd74-70ad-4e31-8d12-dcdafa5a51c1" (UID: "76febd74-70ad-4e31-8d12-dcdafa5a51c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:44:48.751202 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.751175    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a24ab2f5-l6mwl\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:48.751288 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.751252    5079 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76febd74-70ad-4e31-8d12-dcdafa5a51c1-plugins-config-volume\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:48.751756 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.751734    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a24ab2f5-l6mwl\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:48.753568 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.753538    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a24ab2f5-l6mwl\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:48.753685 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.753583    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76febd74-70ad-4e31-8d12-dcdafa5a51c1-kube-api-access-pmfvp" pod "76febd74-70ad-4e31-8d12-dcdafa5a51c1" (UID: "76febd74-70ad-4e31-8d12-dcdafa5a51c1"). InnerVolumeSpecName "kube-api-access-pmfvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:48.759027 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.759004    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjcs7\" (UniqueName: \"kubernetes.io/projected/b3a881d7-3de2-416c-a6a2-2a9503249471-kube-api-access-xjcs7\") pod \"maas-api-revoke-sub-a24ab2f5-l6mwl\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:48.826171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.826141    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:48.846991 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.846959    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:48.852872 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:48.852852    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmfvp\" (UniqueName: \"kubernetes.io/projected/76febd74-70ad-4e31-8d12-dcdafa5a51c1-kube-api-access-pmfvp\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:49.011986 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:49.011915    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"]
Nov 04 05:44:49.015588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:49.015556    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-ade2e8-6b5ddccf76-m5htp"]
Nov 04 05:44:49.133570 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:49.133539    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"]
Nov 04 05:44:49.134785 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:44:49.134761    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a881d7_3de2_416c_a6a2_2a9503249471.slice/crio-3e681af44e6dd2774dac07103c4017f07e7c9c60b2b8b9327880cdae52c0f7d1 WatchSource:0}: Error finding container 3e681af44e6dd2774dac07103c4017f07e7c9c60b2b8b9327880cdae52c0f7d1: Status 404 returned error can't find the container with id 3e681af44e6dd2774dac07103c4017f07e7c9c60b2b8b9327880cdae52c0f7d1
Nov 04 05:44:49.298167 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:49.298132    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76febd74-70ad-4e31-8d12-dcdafa5a51c1" path="/var/lib/kubelet/pods/76febd74-70ad-4e31-8d12-dcdafa5a51c1/volumes"
Nov 04 05:44:49.634016 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:49.633971    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:49.716551 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:49.716471    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl" event={"ID":"b3a881d7-3de2-416c-a6a2-2a9503249471","Type":"ContainerStarted","Data":"4b8023edeb20b3bf850a5f8c90ccd491e4d61f0ee013766ddc2a0ce94a09e2e3"}
Nov 04 05:44:49.716775 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:49.716627    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl" event={"ID":"b3a881d7-3de2-416c-a6a2-2a9503249471","Type":"ContainerStarted","Data":"3e681af44e6dd2774dac07103c4017f07e7c9c60b2b8b9327880cdae52c0f7d1"}
Nov 04 05:44:49.735634 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:49.735525    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl" podStartSLOduration=1.735510792 podStartE2EDuration="1.735510792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:44:49.732161172 +0000 UTC m=+984.590149001" watchObservedRunningTime="2026-11-04 05:44:49.735510792 +0000 UTC m=+984.593498613"
Nov 04 05:44:50.305540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:50.304246    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:50.405578 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:50.405540    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:50.506320 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:50.506284    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:50.566250 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:50.566211    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"]
Nov 04 05:44:50.630762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:50.630724    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:50.707495 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:50.707460    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:50.724907 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:50.724872    5079 generic.go:356] "Generic (PLEG): container finished" podID="b3a881d7-3de2-416c-a6a2-2a9503249471" containerID="4b8023edeb20b3bf850a5f8c90ccd491e4d61f0ee013766ddc2a0ce94a09e2e3" exitCode=0
Nov 04 05:44:50.725064 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:50.724954    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl" event={"ID":"b3a881d7-3de2-416c-a6a2-2a9503249471","Type":"ContainerDied","Data":"4b8023edeb20b3bf850a5f8c90ccd491e4d61f0ee013766ddc2a0ce94a09e2e3"}
Nov 04 05:44:51.252341 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:51.252308    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:51.918375 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:51.918348    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:51.925470 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:51.925437    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:52.020479 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.010899    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-xks-ca\") pod \"b3a881d7-3de2-416c-a6a2-2a9503249471\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") "
Nov 04 05:44:52.020479 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.010953    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3a881d7-3de2-416c-a6a2-2a9503249471-kube-api-access-xjcs7\" (UniqueName: \"kubernetes.io/projected/b3a881d7-3de2-416c-a6a2-2a9503249471-kube-api-access-xjcs7\") pod \"b3a881d7-3de2-416c-a6a2-2a9503249471\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") "
Nov 04 05:44:52.020479 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.011088    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-openshift-ca\") pod \"b3a881d7-3de2-416c-a6a2-2a9503249471\" (UID: \"b3a881d7-3de2-416c-a6a2-2a9503249471\") "
Nov 04 05:44:52.020479 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.018776    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-openshift-ca" pod "b3a881d7-3de2-416c-a6a2-2a9503249471" (UID: "b3a881d7-3de2-416c-a6a2-2a9503249471"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:44:52.027522 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.022132    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-xks-ca" pod "b3a881d7-3de2-416c-a6a2-2a9503249471" (UID: "b3a881d7-3de2-416c-a6a2-2a9503249471"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:44:52.027522 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.022277    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a881d7-3de2-416c-a6a2-2a9503249471-kube-api-access-xjcs7" pod "b3a881d7-3de2-416c-a6a2-2a9503249471" (UID: "b3a881d7-3de2-416c-a6a2-2a9503249471"). InnerVolumeSpecName "kube-api-access-xjcs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:52.113295 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.113247    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-openshift-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:52.113295 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.113285    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b3a881d7-3de2-416c-a6a2-2a9503249471-maas-api-xks-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:52.113295 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.113300    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjcs7\" (UniqueName: \"kubernetes.io/projected/b3a881d7-3de2-416c-a6a2-2a9503249471-kube-api-access-xjcs7\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:52.552670 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.552628    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg" podUID="17057c13-819c-492c-8bf1-453505ea131d" containerName="main" containerID="cri-o://d29763f3953931084bc8fbac898dc4518b3f82add7874bd09350c3b92c1482c6" gracePeriod=45
Nov 04 05:44:52.643649 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.643606    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:52.746864 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.746828    5079 generic.go:356] "Generic (PLEG): container finished" podID="17057c13-819c-492c-8bf1-453505ea131d" containerID="d29763f3953931084bc8fbac898dc4518b3f82add7874bd09350c3b92c1482c6" exitCode=0
Nov 04 05:44:52.747070 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.746894    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg" event={"ID":"17057c13-819c-492c-8bf1-453505ea131d","Type":"ContainerDied","Data":"d29763f3953931084bc8fbac898dc4518b3f82add7874bd09350c3b92c1482c6"}
Nov 04 05:44:52.748738 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.748715    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl" event={"ID":"b3a881d7-3de2-416c-a6a2-2a9503249471","Type":"ContainerDied","Data":"3e681af44e6dd2774dac07103c4017f07e7c9c60b2b8b9327880cdae52c0f7d1"}
Nov 04 05:44:52.748804 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.748756    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24ab2f5-l6mwl"
Nov 04 05:44:52.748804 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.748767    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e681af44e6dd2774dac07103c4017f07e7c9c60b2b8b9327880cdae52c0f7d1"
Nov 04 05:44:52.850965 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:52.850938    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:44:53.016879 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.016845    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"]
Nov 04 05:44:53.017470 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.017453    5079 cpu_manager.go:414] "containerMap: removing container" podUID="76febd74-70ad-4e31-8d12-dcdafa5a51c1" containerName="payload-processing"
Nov 04 05:44:53.017594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.017472    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76febd74-70ad-4e31-8d12-dcdafa5a51c1" containerName="payload-processing"
Nov 04 05:44:53.017594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.017482    5079 cpu_manager.go:414] "containerMap: removing container" podUID="b3a881d7-3de2-416c-a6a2-2a9503249471" containerName="revoke-keys"
Nov 04 05:44:53.017594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.017487    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3a881d7-3de2-416c-a6a2-2a9503249471" containerName="revoke-keys"
Nov 04 05:44:53.017594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.017526    5079 cpu_manager.go:414] "containerMap: removing container" podUID="17057c13-819c-492c-8bf1-453505ea131d" containerName="main"
Nov 04 05:44:53.017594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.017535    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17057c13-819c-492c-8bf1-453505ea131d" containerName="main"
Nov 04 05:44:53.017840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.017657    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="17057c13-819c-492c-8bf1-453505ea131d" containerName="main"
Nov 04 05:44:53.017840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.017668    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="76febd74-70ad-4e31-8d12-dcdafa5a51c1" containerName="payload-processing"
Nov 04 05:44:53.017840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.017674    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3a881d7-3de2-416c-a6a2-2a9503249471" containerName="revoke-keys"
Nov 04 05:44:53.024639 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.024596    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.032850 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.032816    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"]
Nov 04 05:44:53.034516 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.034465    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-tmp-dir\") pod \"17057c13-819c-492c-8bf1-453505ea131d\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") "
Nov 04 05:44:53.034654 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.034570    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-home\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-home\") pod \"17057c13-819c-492c-8bf1-453505ea131d\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") "
Nov 04 05:44:53.034654 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.034603    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-model-cache\") pod \"17057c13-819c-492c-8bf1-453505ea131d\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") "
Nov 04 05:44:53.034790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.034751    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-dshm\") pod \"17057c13-819c-492c-8bf1-453505ea131d\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") "
Nov 04 05:44:53.034845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.034796    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17057c13-819c-492c-8bf1-453505ea131d-kube-api-access-xkdk6\" (UniqueName: \"kubernetes.io/projected/17057c13-819c-492c-8bf1-453505ea131d-kube-api-access-xkdk6\") pod \"17057c13-819c-492c-8bf1-453505ea131d\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") "
Nov 04 05:44:53.034907 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.034893    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/17057c13-819c-492c-8bf1-453505ea131d-tls-certs\" (UniqueName: \"kubernetes.io/secret/17057c13-819c-492c-8bf1-453505ea131d-tls-certs\") pod \"17057c13-819c-492c-8bf1-453505ea131d\" (UID: \"17057c13-819c-492c-8bf1-453505ea131d\") "
Nov 04 05:44:53.037901 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.037809    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-home" pod "17057c13-819c-492c-8bf1-453505ea131d" (UID: "17057c13-819c-492c-8bf1-453505ea131d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:53.038183 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.038159    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-tmp-dir" pod "17057c13-819c-492c-8bf1-453505ea131d" (UID: "17057c13-819c-492c-8bf1-453505ea131d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:53.038357 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.038327    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-model-cache" pod "17057c13-819c-492c-8bf1-453505ea131d" (UID: "17057c13-819c-492c-8bf1-453505ea131d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:53.040931 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.040898    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-dshm" pod "17057c13-819c-492c-8bf1-453505ea131d" (UID: "17057c13-819c-492c-8bf1-453505ea131d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:53.041041 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.040930    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17057c13-819c-492c-8bf1-453505ea131d-kube-api-access-xkdk6" pod "17057c13-819c-492c-8bf1-453505ea131d" (UID: "17057c13-819c-492c-8bf1-453505ea131d"). InnerVolumeSpecName "kube-api-access-xkdk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:53.041185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.041093    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17057c13-819c-492c-8bf1-453505ea131d-tls-certs" pod "17057c13-819c-492c-8bf1-453505ea131d" (UID: "17057c13-819c-492c-8bf1-453505ea131d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:44:53.041185 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.041178    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-f910f5\"/\"distinct-2-w3-f910f5-kserve-self-signed-certs\""
Nov 04 05:44:53.056074 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.056046    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136179    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fd94\" (UniqueName: \"kubernetes.io/projected/5b48ad58-03f8-4046-b0bf-c4bd18508b93-kube-api-access-9fd94\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136266    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tmp-dir\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136379    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-home\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136486    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-dshm\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136558    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-model-cache\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136583    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tls-certs\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136647    5079 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-home\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136660    5079 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-model-cache\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136674    5079 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-dshm\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136687    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkdk6\" (UniqueName: \"kubernetes.io/projected/17057c13-819c-492c-8bf1-453505ea131d-kube-api-access-xkdk6\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136701    5079 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17057c13-819c-492c-8bf1-453505ea131d-tls-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:53.137945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.136714    5079 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17057c13-819c-492c-8bf1-453505ea131d-tmp-dir\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:53.237531 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.237483    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tmp-dir\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.237725 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.237628    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-home\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.237725 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.237700    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-dshm\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.237848 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.237737    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-model-cache\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.237848 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.237757    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tls-certs\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.237848 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.237810    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fd94\" (UniqueName: \"kubernetes.io/projected/5b48ad58-03f8-4046-b0bf-c4bd18508b93-kube-api-access-9fd94\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.238016 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.237915    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tmp-dir\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.238122 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.238104    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-home\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.238122 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.238114    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-model-cache\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.240127 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.240105    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-dshm\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.240438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.240416    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tls-certs\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.245993 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.245969    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fd94\" (UniqueName: \"kubernetes.io/projected/5b48ad58-03f8-4046-b0bf-c4bd18508b93-kube-api-access-9fd94\") pod \"distinct-2-w3-f910f5-kserve-78957ff584-stkkr\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") " pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.377396 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.377358    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:53.505157 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.505114    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:53.668022 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.667996    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"]
Nov 04 05:44:53.669038 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:44:53.669008    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b48ad58_03f8_4046_b0bf_c4bd18508b93.slice/crio-d1548b44a341d516ea505eac968bf29e4e528ff41d30772bf046a44511dfe7d9 WatchSource:0}: Error finding container d1548b44a341d516ea505eac968bf29e4e528ff41d30772bf046a44511dfe7d9: Status 404 returned error can't find the container with id d1548b44a341d516ea505eac968bf29e4e528ff41d30772bf046a44511dfe7d9
Nov 04 05:44:53.758601 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.758040    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg" event={"ID":"17057c13-819c-492c-8bf1-453505ea131d","Type":"ContainerDied","Data":"518164096cee4e7b86d094bf17737f216083c19164c5bae36c15738ff54adb8d"}
Nov 04 05:44:53.758601 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.758074    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"
Nov 04 05:44:53.758601 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.758096    5079 scope.go:122] "RemoveContainer" containerID="d29763f3953931084bc8fbac898dc4518b3f82add7874bd09350c3b92c1482c6"
Nov 04 05:44:53.762895 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.762854    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr" event={"ID":"5b48ad58-03f8-4046-b0bf-c4bd18508b93","Type":"ContainerStarted","Data":"1fcdae0eaa2da2688e1d40f01c9509f48aa2c376a916f76e0c54125978e26c83"}
Nov 04 05:44:53.763018 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.762914    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr" event={"ID":"5b48ad58-03f8-4046-b0bf-c4bd18508b93","Type":"ContainerStarted","Data":"d1548b44a341d516ea505eac968bf29e4e528ff41d30772bf046a44511dfe7d9"}
Nov 04 05:44:53.776564 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.776532    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"]
Nov 04 05:44:53.782299 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.782269    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-f9b4a9/simulator-w1-f9b4a9-kserve-576b767fb7-ccmrg"]
Nov 04 05:44:53.797848 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:53.797789    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr" podStartSLOduration=1.7977673809999999 podStartE2EDuration="1.797767381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:44:53.793953308 +0000 UTC m=+988.651941119" watchObservedRunningTime="2026-11-04 05:44:53.797767381 +0000 UTC m=+988.655755213"
Nov 04 05:44:54.378592 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:54.378548    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:44:54.419752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:54.419721    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:55.191277 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.191243    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:55.301330 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.301290    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17057c13-819c-492c-8bf1-453505ea131d" path="/var/lib/kubelet/pods/17057c13-819c-492c-8bf1-453505ea131d/volumes"
Nov 04 05:44:55.478727 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.478631    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg" podUID="eca79b24-1161-4cdd-b7fd-0301af6f7861" containerName="main" containerID="cri-o://52431375ab0358ef03a3ca1a4705141323a8694ff8b0af14e780e0f676ef6b72" gracePeriod=45
Nov 04 05:44:55.556421 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.556380    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg" podUID="eca79b24-1161-4cdd-b7fd-0301af6f7861" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": dial tcp 10.132.0.73:8000: connect: connection refused"
Nov 04 05:44:55.567151 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.567113    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2" podUID="d8bfe7f3-0f4a-4aa3-8477-217cfe25c359" containerName="payload-pre-processing" containerID="cri-o://50269708228a7ae6d3d5e6336b368edc1e36224ea33f42b9d6e013de9d858fdf" gracePeriod=25
Nov 04 05:44:55.786404 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.786369    5079 generic.go:356] "Generic (PLEG): container finished" podID="eca79b24-1161-4cdd-b7fd-0301af6f7861" containerID="52431375ab0358ef03a3ca1a4705141323a8694ff8b0af14e780e0f676ef6b72" exitCode=0
Nov 04 05:44:55.786590 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.786440    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg" event={"ID":"eca79b24-1161-4cdd-b7fd-0301af6f7861","Type":"ContainerDied","Data":"52431375ab0358ef03a3ca1a4705141323a8694ff8b0af14e780e0f676ef6b72"}
Nov 04 05:44:55.789390 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.789358    5079 generic.go:356] "Generic (PLEG): container finished" podID="d8bfe7f3-0f4a-4aa3-8477-217cfe25c359" containerID="50269708228a7ae6d3d5e6336b368edc1e36224ea33f42b9d6e013de9d858fdf" exitCode=0
Nov 04 05:44:55.789738 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.789715    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2" event={"ID":"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359","Type":"ContainerDied","Data":"50269708228a7ae6d3d5e6336b368edc1e36224ea33f42b9d6e013de9d858fdf"}
Nov 04 05:44:55.913523 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.913144    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:44:55.917352 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.917329    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:44:55.977466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.977432    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-dshm\") pod \"eca79b24-1161-4cdd-b7fd-0301af6f7861\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") "
Nov 04 05:44:55.977713 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.977588    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-plugins-config-volume\") pod \"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359\" (UID: \"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359\") "
Nov 04 05:44:55.977713 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.977622    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-model-cache\") pod \"eca79b24-1161-4cdd-b7fd-0301af6f7861\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") "
Nov 04 05:44:55.977713 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.977680    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-home\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-home\") pod \"eca79b24-1161-4cdd-b7fd-0301af6f7861\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") "
Nov 04 05:44:55.977876 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.977767    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eca79b24-1161-4cdd-b7fd-0301af6f7861-tls-certs\" (UniqueName: \"kubernetes.io/secret/eca79b24-1161-4cdd-b7fd-0301af6f7861-tls-certs\") pod \"eca79b24-1161-4cdd-b7fd-0301af6f7861\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") "
Nov 04 05:44:55.977876 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.977845    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eca79b24-1161-4cdd-b7fd-0301af6f7861-kube-api-access-p9d5d\" (UniqueName: \"kubernetes.io/projected/eca79b24-1161-4cdd-b7fd-0301af6f7861-kube-api-access-p9d5d\") pod \"eca79b24-1161-4cdd-b7fd-0301af6f7861\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") "
Nov 04 05:44:55.977982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.977946    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-kube-api-access-4f7ml\" (UniqueName: \"kubernetes.io/projected/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-kube-api-access-4f7ml\") pod \"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359\" (UID: \"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359\") "
Nov 04 05:44:55.978049 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.977991    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-tmp-dir\") pod \"eca79b24-1161-4cdd-b7fd-0301af6f7861\" (UID: \"eca79b24-1161-4cdd-b7fd-0301af6f7861\") "
Nov 04 05:44:55.979402 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.979355    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-model-cache" pod "eca79b24-1161-4cdd-b7fd-0301af6f7861" (UID: "eca79b24-1161-4cdd-b7fd-0301af6f7861"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:55.980577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.980556    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-tmp-dir" pod "eca79b24-1161-4cdd-b7fd-0301af6f7861" (UID: "eca79b24-1161-4cdd-b7fd-0301af6f7861"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:55.980866 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.980731    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-home" pod "eca79b24-1161-4cdd-b7fd-0301af6f7861" (UID: "eca79b24-1161-4cdd-b7fd-0301af6f7861"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:55.981064 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.981032    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-plugins-config-volume" pod "d8bfe7f3-0f4a-4aa3-8477-217cfe25c359" (UID: "d8bfe7f3-0f4a-4aa3-8477-217cfe25c359"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:44:55.987802 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.987754    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca79b24-1161-4cdd-b7fd-0301af6f7861-kube-api-access-p9d5d" pod "eca79b24-1161-4cdd-b7fd-0301af6f7861" (UID: "eca79b24-1161-4cdd-b7fd-0301af6f7861"). InnerVolumeSpecName "kube-api-access-p9d5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:55.989719 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.989670    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-kube-api-access-4f7ml" pod "d8bfe7f3-0f4a-4aa3-8477-217cfe25c359" (UID: "d8bfe7f3-0f4a-4aa3-8477-217cfe25c359"). InnerVolumeSpecName "kube-api-access-4f7ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:44:55.989846 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.989781    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-dshm" pod "eca79b24-1161-4cdd-b7fd-0301af6f7861" (UID: "eca79b24-1161-4cdd-b7fd-0301af6f7861"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:44:55.990553 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:55.990514    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eca79b24-1161-4cdd-b7fd-0301af6f7861-tls-certs" pod "eca79b24-1161-4cdd-b7fd-0301af6f7861" (UID: "eca79b24-1161-4cdd-b7fd-0301af6f7861"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:44:56.049754 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.049667    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:56.079829 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.079790    5079 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eca79b24-1161-4cdd-b7fd-0301af6f7861-tls-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.079829 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.079829    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9d5d\" (UniqueName: \"kubernetes.io/projected/eca79b24-1161-4cdd-b7fd-0301af6f7861-kube-api-access-p9d5d\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.079829 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.079844    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f7ml\" (UniqueName: \"kubernetes.io/projected/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-kube-api-access-4f7ml\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.080166 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.079856    5079 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-tmp-dir\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.080166 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.079869    5079 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-dshm\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.080166 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.079880    5079 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359-plugins-config-volume\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.080166 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.079893    5079 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-model-cache\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.080166 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.079907    5079 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eca79b24-1161-4cdd-b7fd-0301af6f7861-home\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:44:56.777408 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.777312    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:44:56.800133 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.800100    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg" event={"ID":"eca79b24-1161-4cdd-b7fd-0301af6f7861","Type":"ContainerDied","Data":"3df3ed67b65234775a48564a68c67c471cb8ff32e02883d2a5bc376f213f3846"}
Nov 04 05:44:56.800133 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.800119    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"
Nov 04 05:44:56.800383 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.800156    5079 scope.go:122] "RemoveContainer" containerID="52431375ab0358ef03a3ca1a4705141323a8694ff8b0af14e780e0f676ef6b72"
Nov 04 05:44:56.807569 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.801927    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2" event={"ID":"d8bfe7f3-0f4a-4aa3-8477-217cfe25c359","Type":"ContainerDied","Data":"4b695010b5937c5993452a0795208e4b2c35fc167c21dd1dde56bf722425990e"}
Nov 04 05:44:56.807569 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.801954    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"
Nov 04 05:44:56.822742 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.822714    5079 scope.go:122] "RemoveContainer" containerID="50269708228a7ae6d3d5e6336b368edc1e36224ea33f42b9d6e013de9d858fdf"
Nov 04 05:44:56.837802 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.835693    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"]
Nov 04 05:44:56.840763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.840732    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:56.842780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.842753    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-9a0c8b/premium-w4-9a0c8b-kserve-674968896f-m84pg"]
Nov 04 05:44:56.851602 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.851571    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"]
Nov 04 05:44:56.853769 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:56.853741    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9a0c8b-8fcfb9967-55cp2"]
Nov 04 05:44:57.089400 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:57.089321    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:57.302788 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:57.302750    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d8bfe7f3-0f4a-4aa3-8477-217cfe25c359" path="/var/lib/kubelet/pods/d8bfe7f3-0f4a-4aa3-8477-217cfe25c359/volumes"
Nov 04 05:44:57.303437 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:57.303408    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eca79b24-1161-4cdd-b7fd-0301af6f7861" path="/var/lib/kubelet/pods/eca79b24-1161-4cdd-b7fd-0301af6f7861/volumes"
Nov 04 05:44:57.369001 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:57.368922    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:57.466807 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:57.466674    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:58.335523 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:58.334881    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:44:59.265177 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:44:59.262525    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:00.056962 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.056929    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:00.429798 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.429764    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"]
Nov 04 05:45:00.447603 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.439945    5079 cpu_manager.go:414] "containerMap: removing container" podUID="eca79b24-1161-4cdd-b7fd-0301af6f7861" containerName="main"
Nov 04 05:45:00.454927 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.454856    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eca79b24-1161-4cdd-b7fd-0301af6f7861" containerName="main"
Nov 04 05:45:00.483427 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.483397    5079 cpu_manager.go:414] "containerMap: removing container" podUID="d8bfe7f3-0f4a-4aa3-8477-217cfe25c359" containerName="payload-pre-processing"
Nov 04 05:45:00.483670 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.483650    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8bfe7f3-0f4a-4aa3-8477-217cfe25c359" containerName="payload-pre-processing"
Nov 04 05:45:00.491538 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.484022    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="eca79b24-1161-4cdd-b7fd-0301af6f7861" containerName="main"
Nov 04 05:45:00.513195 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.513165    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8bfe7f3-0f4a-4aa3-8477-217cfe25c359" containerName="payload-pre-processing"
Nov 04 05:45:00.531494 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.528874    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"]
Nov 04 05:45:00.531494 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.529617    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"
Nov 04 05:45:00.535493 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.534483    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"]
Nov 04 05:45:00.535822 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.535801    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"
Nov 04 05:45:00.537063 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.537037    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nsl8n\""
Nov 04 05:45:00.551050 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.551016    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"
Nov 04 05:45:00.551203 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.551073    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"]
Nov 04 05:45:00.551203 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.551140    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"]
Nov 04 05:45:00.551203 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.551169    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"]
Nov 04 05:45:00.551342 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.551200    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"]
Nov 04 05:45:00.557188 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.556770    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"]
Nov 04 05:45:00.557188 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.556883    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"
Nov 04 05:45:00.594737 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.594700    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45aed7bc-ac05-49d4-bce4-fa11e92f873b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd\" (UID: \"45aed7bc-ac05-49d4-bce4-fa11e92f873b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"
Nov 04 05:45:00.594899 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.594747    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af3acf0e-f4e6-4006-900e-ac71780a2902-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl\" (UID: \"af3acf0e-f4e6-4006-900e-ac71780a2902\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"
Nov 04 05:45:00.594899 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.594788    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q\" (UID: \"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"
Nov 04 05:45:00.594899 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.594865    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqlbr\" (UniqueName: \"kubernetes.io/projected/45aed7bc-ac05-49d4-bce4-fa11e92f873b-kube-api-access-tqlbr\") pod \"maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd\" (UID: \"45aed7bc-ac05-49d4-bce4-fa11e92f873b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"
Nov 04 05:45:00.595019 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.594921    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq\" (UID: \"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"
Nov 04 05:45:00.595019 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.594947    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c4bv\" (UniqueName: \"kubernetes.io/projected/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-kube-api-access-5c4bv\") pod \"maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q\" (UID: \"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"
Nov 04 05:45:00.595091 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.595036    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrv58\" (UniqueName: \"kubernetes.io/projected/af3acf0e-f4e6-4006-900e-ac71780a2902-kube-api-access-qrv58\") pod \"maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl\" (UID: \"af3acf0e-f4e6-4006-900e-ac71780a2902\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"
Nov 04 05:45:00.595133 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.595100    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jxjn\" (UniqueName: \"kubernetes.io/projected/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-kube-api-access-7jxjn\") pod \"maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq\" (UID: \"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"
Nov 04 05:45:00.666625 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.662846    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"]
Nov 04 05:45:00.666625 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.663097    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545" podUID="d2042576-eeb4-4205-a6f6-f643865bc74f" containerName="maas-api" containerID="cri-o://4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd" gracePeriod=30
Nov 04 05:45:00.696703 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.696609    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrv58\" (UniqueName: \"kubernetes.io/projected/af3acf0e-f4e6-4006-900e-ac71780a2902-kube-api-access-qrv58\") pod \"maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl\" (UID: \"af3acf0e-f4e6-4006-900e-ac71780a2902\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"
Nov 04 05:45:00.696996 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.696973    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jxjn\" (UniqueName: \"kubernetes.io/projected/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-kube-api-access-7jxjn\") pod \"maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq\" (UID: \"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"
Nov 04 05:45:00.697189 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.697173    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45aed7bc-ac05-49d4-bce4-fa11e92f873b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd\" (UID: \"45aed7bc-ac05-49d4-bce4-fa11e92f873b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"
Nov 04 05:45:00.697297 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.697282    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af3acf0e-f4e6-4006-900e-ac71780a2902-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl\" (UID: \"af3acf0e-f4e6-4006-900e-ac71780a2902\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"
Nov 04 05:45:00.697409 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.697395    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q\" (UID: \"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"
Nov 04 05:45:00.697598 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.697576    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqlbr\" (UniqueName: \"kubernetes.io/projected/45aed7bc-ac05-49d4-bce4-fa11e92f873b-kube-api-access-tqlbr\") pod \"maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd\" (UID: \"45aed7bc-ac05-49d4-bce4-fa11e92f873b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"
Nov 04 05:45:00.697793 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.697777    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq\" (UID: \"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"
Nov 04 05:45:00.697889 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.697876    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c4bv\" (UniqueName: \"kubernetes.io/projected/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-kube-api-access-5c4bv\") pod \"maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q\" (UID: \"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"
Nov 04 05:45:00.699146 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.699121    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45aed7bc-ac05-49d4-bce4-fa11e92f873b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd\" (UID: \"45aed7bc-ac05-49d4-bce4-fa11e92f873b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"
Nov 04 05:45:00.699304 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.699179    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af3acf0e-f4e6-4006-900e-ac71780a2902-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl\" (UID: \"af3acf0e-f4e6-4006-900e-ac71780a2902\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"
Nov 04 05:45:00.699920 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.699897    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q\" (UID: \"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"
Nov 04 05:45:00.701018 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.700838    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq\" (UID: \"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"
Nov 04 05:45:00.717447 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.715610    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqlbr\" (UniqueName: \"kubernetes.io/projected/45aed7bc-ac05-49d4-bce4-fa11e92f873b-kube-api-access-tqlbr\") pod \"maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd\" (UID: \"45aed7bc-ac05-49d4-bce4-fa11e92f873b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"
Nov 04 05:45:00.718405 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.718177    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:00.720342 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.720167    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jxjn\" (UniqueName: \"kubernetes.io/projected/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-kube-api-access-7jxjn\") pod \"maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq\" (UID: \"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"
Nov 04 05:45:00.725628 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.725578    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c4bv\" (UniqueName: \"kubernetes.io/projected/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-kube-api-access-5c4bv\") pod \"maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q\" (UID: \"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"
Nov 04 05:45:00.728922 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.728235    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrv58\" (UniqueName: \"kubernetes.io/projected/af3acf0e-f4e6-4006-900e-ac71780a2902-kube-api-access-qrv58\") pod \"maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl\" (UID: \"af3acf0e-f4e6-4006-900e-ac71780a2902\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"
Nov 04 05:45:00.747053 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.747018    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"]
Nov 04 05:45:00.747403 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.747382    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"
Nov 04 05:45:00.832094 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.831331    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:00.845338 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.845302    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"]
Nov 04 05:45:00.845810 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.845788    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"
Nov 04 05:45:00.867859 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.867612    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"
Nov 04 05:45:00.916534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:00.916464    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"
Nov 04 05:45:01.127320 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.127284    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"]
Nov 04 05:45:01.149282 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.149239    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:01.452295 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.452265    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:45:01.467206 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.467174    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"]
Nov 04 05:45:01.468370 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:45:01.468342    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9cc36a9_c2cf_4734_97f9_fd1f955e2a6d.slice/crio-6d050c8469dd89be1cbf1dc93b4597ecbced44d58a86f37e880c7594d6fb1fb6 WatchSource:0}: Error finding container 6d050c8469dd89be1cbf1dc93b4597ecbced44d58a86f37e880c7594d6fb1fb6: Status 404 returned error can't find the container with id 6d050c8469dd89be1cbf1dc93b4597ecbced44d58a86f37e880c7594d6fb1fb6
Nov 04 05:45:01.472314 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.472291    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"]
Nov 04 05:45:01.481975 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:45:01.481933    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d35ca3b_adcc_4c9a_bc02_ad6a17ec9390.slice/crio-4caaec119c1c7d92bdfb1442db46a448a3d908a41ff9a005fd2ea288e84d703f WatchSource:0}: Error finding container 4caaec119c1c7d92bdfb1442db46a448a3d908a41ff9a005fd2ea288e84d703f: Status 404 returned error can't find the container with id 4caaec119c1c7d92bdfb1442db46a448a3d908a41ff9a005fd2ea288e84d703f
Nov 04 05:45:01.550544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.549743    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-maas-api-tls\") pod \"d2042576-eeb4-4205-a6f6-f643865bc74f\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") "
Nov 04 05:45:01.550544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.549839    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2042576-eeb4-4205-a6f6-f643865bc74f-kube-api-access-28lg2\" (UniqueName: \"kubernetes.io/projected/d2042576-eeb4-4205-a6f6-f643865bc74f-kube-api-access-28lg2\") pod \"d2042576-eeb4-4205-a6f6-f643865bc74f\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") "
Nov 04 05:45:01.550544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.549925    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-metrics-certs\") pod \"d2042576-eeb4-4205-a6f6-f643865bc74f\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") "
Nov 04 05:45:01.550544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.549957    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2042576-eeb4-4205-a6f6-f643865bc74f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2042576-eeb4-4205-a6f6-f643865bc74f-openshift-service-ca\") pod \"d2042576-eeb4-4205-a6f6-f643865bc74f\" (UID: \"d2042576-eeb4-4205-a6f6-f643865bc74f\") "
Nov 04 05:45:01.551280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.551232    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2042576-eeb4-4205-a6f6-f643865bc74f-openshift-service-ca" pod "d2042576-eeb4-4205-a6f6-f643865bc74f" (UID: "d2042576-eeb4-4205-a6f6-f643865bc74f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:01.553430 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.553397    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-metrics-certs" pod "d2042576-eeb4-4205-a6f6-f643865bc74f" (UID: "d2042576-eeb4-4205-a6f6-f643865bc74f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:01.553582 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.553446    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2042576-eeb4-4205-a6f6-f643865bc74f-kube-api-access-28lg2" pod "d2042576-eeb4-4205-a6f6-f643865bc74f" (UID: "d2042576-eeb4-4205-a6f6-f643865bc74f"). InnerVolumeSpecName "kube-api-access-28lg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:01.553744 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.553722    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-maas-api-tls" pod "d2042576-eeb4-4205-a6f6-f643865bc74f" (UID: "d2042576-eeb4-4205-a6f6-f643865bc74f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:01.567256 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.567230    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"]
Nov 04 05:45:01.581027 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:45:01.569568    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45aed7bc_ac05_49d4_bce4_fa11e92f873b.slice/crio-fcdc39eda216c3a08aed18f8a89dbc1134a934f420ae5abbf0d68d929aa8ea25 WatchSource:0}: Error finding container fcdc39eda216c3a08aed18f8a89dbc1134a934f420ae5abbf0d68d929aa8ea25: Status 404 returned error can't find the container with id fcdc39eda216c3a08aed18f8a89dbc1134a934f420ae5abbf0d68d929aa8ea25
Nov 04 05:45:01.652113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.652083    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-maas-api-tls\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:01.652113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.652113    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28lg2\" (UniqueName: \"kubernetes.io/projected/d2042576-eeb4-4205-a6f6-f643865bc74f-kube-api-access-28lg2\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:01.652326 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.652130    5079 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2042576-eeb4-4205-a6f6-f643865bc74f-metrics-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:01.652326 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.652139    5079 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2042576-eeb4-4205-a6f6-f643865bc74f-openshift-service-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:01.754451 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.754408    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:01.893281 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:01.893245    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:02.144635 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.144530    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd" event={"ID":"45aed7bc-ac05-49d4-bce4-fa11e92f873b","Type":"ContainerStarted","Data":"fcdc39eda216c3a08aed18f8a89dbc1134a934f420ae5abbf0d68d929aa8ea25"}
Nov 04 05:45:02.147083 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.147040    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq" event={"ID":"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d","Type":"ContainerStarted","Data":"a0df7b2c3e27507fa58a3716e94f3512f48d4815290bc7633227f333b0d0ef30"}
Nov 04 05:45:02.147300 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.147279    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq" event={"ID":"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d","Type":"ContainerStarted","Data":"6d050c8469dd89be1cbf1dc93b4597ecbced44d58a86f37e880c7594d6fb1fb6"}
Nov 04 05:45:02.149995 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.149956    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl" event={"ID":"af3acf0e-f4e6-4006-900e-ac71780a2902","Type":"ContainerStarted","Data":"b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d"}
Nov 04 05:45:02.150154 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.150010    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl" podUID="af3acf0e-f4e6-4006-900e-ac71780a2902" containerName="cleanup" containerID="cri-o://b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d" gracePeriod=30
Nov 04 05:45:02.150154 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.150026    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl" event={"ID":"af3acf0e-f4e6-4006-900e-ac71780a2902","Type":"ContainerStarted","Data":"971f298ad7a3219c8e91104b472d2705d68c6015097ebfed7192774df923c36c"}
Nov 04 05:45:02.153322 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.153289    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q" event={"ID":"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390","Type":"ContainerStarted","Data":"d6f5a8d086067b9e22687b3690e93c372adf1d68e3af524006bc372669597ba4"}
Nov 04 05:45:02.153539 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.153361    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q" event={"ID":"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390","Type":"ContainerStarted","Data":"4caaec119c1c7d92bdfb1442db46a448a3d908a41ff9a005fd2ea288e84d703f"}
Nov 04 05:45:02.155025 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.155000    5079 generic.go:356] "Generic (PLEG): container finished" podID="d2042576-eeb4-4205-a6f6-f643865bc74f" containerID="4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd" exitCode=0
Nov 04 05:45:02.155120 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.155048    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"
Nov 04 05:45:02.155120 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.155082    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545" event={"ID":"d2042576-eeb4-4205-a6f6-f643865bc74f","Type":"ContainerDied","Data":"4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd"}
Nov 04 05:45:02.155202 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.155136    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545" event={"ID":"d2042576-eeb4-4205-a6f6-f643865bc74f","Type":"ContainerDied","Data":"d218f3eea0847ab61c148f58b49b6e7068b146983f413d7475cc9bf6afce6ffe"}
Nov 04 05:45:02.155202 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.155167    5079 scope.go:122] "RemoveContainer" containerID="4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd"
Nov 04 05:45:02.156474 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.156437    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"]
Nov 04 05:45:02.157249 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.157225    5079 cpu_manager.go:414] "containerMap: removing container" podUID="d2042576-eeb4-4205-a6f6-f643865bc74f" containerName="maas-api"
Nov 04 05:45:02.157249 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.157246    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2042576-eeb4-4205-a6f6-f643865bc74f" containerName="maas-api"
Nov 04 05:45:02.157425 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.157381    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2042576-eeb4-4205-a6f6-f643865bc74f" containerName="maas-api"
Nov 04 05:45:02.161228 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.161207    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:02.164984 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.164942    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq" podStartSLOduration=2.164930003 podStartE2EDuration="2.164930003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:02.163878947 +0000 UTC m=+997.021866778" watchObservedRunningTime="2026-11-04 05:45:02.164930003 +0000 UTC m=+997.022917830"
Nov 04 05:45:02.167409 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.167363    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 05:45:02.168292 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.168255    5079 scope.go:122] "RemoveContainer" containerID="4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd"
Nov 04 05:45:02.174776 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:02.168863    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd\": container with ID starting with 4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd not found: ID does not exist" containerID="4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd"
Nov 04 05:45:02.174776 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.168902    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd"} err="failed to get container status \"4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd\": rpc error: code = NotFound desc = could not find container \"4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd\": container with ID starting with 4c423b3eeea431c8b3b5361c101b21301ab3705b18302d2f0a2db84b53a9d1dd not found: ID does not exist"
Nov 04 05:45:02.175550 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.175484    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"]
Nov 04 05:45:02.184480 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.184111    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl" podStartSLOduration=2.184094275 podStartE2EDuration="2.184094275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:02.181635958 +0000 UTC m=+997.039623789" watchObservedRunningTime="2026-11-04 05:45:02.184094275 +0000 UTC m=+997.042082105"
Nov 04 05:45:02.241584 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.241462    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q" podStartSLOduration=2.24144245 podStartE2EDuration="2.24144245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:02.239109179 +0000 UTC m=+997.097097013" watchObservedRunningTime="2026-11-04 05:45:02.24144245 +0000 UTC m=+997.099430280"
Nov 04 05:45:02.255291 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.255238    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"]
Nov 04 05:45:02.260958 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.260926    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-f9b4a9-97bfbf58c-rf545"]
Nov 04 05:45:02.261475 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.261447    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cb56d506-fl25h\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:02.261623 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.261574    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cb56d506-fl25h\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:02.261906 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.261883    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzznh\" (UniqueName: \"kubernetes.io/projected/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-kube-api-access-bzznh\") pod \"maas-api-revoke-sub-cb56d506-fl25h\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:02.363315 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.363279    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzznh\" (UniqueName: \"kubernetes.io/projected/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-kube-api-access-bzznh\") pod \"maas-api-revoke-sub-cb56d506-fl25h\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:02.363482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.363444    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cb56d506-fl25h\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:02.363482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.363469    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cb56d506-fl25h\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:02.364346 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.364319    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cb56d506-fl25h\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:02.366565 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.366545    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cb56d506-fl25h\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:02.376377 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.376344    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzznh\" (UniqueName: \"kubernetes.io/projected/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-kube-api-access-bzznh\") pod \"maas-api-revoke-sub-cb56d506-fl25h\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:02.477955 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.477918    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"
Nov 04 05:45:02.480945 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.480909    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:02.513670 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.513412    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:02.566935 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.566899    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af3acf0e-f4e6-4006-900e-ac71780a2902-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af3acf0e-f4e6-4006-900e-ac71780a2902-maas-api-service-ca\") pod \"af3acf0e-f4e6-4006-900e-ac71780a2902\" (UID: \"af3acf0e-f4e6-4006-900e-ac71780a2902\") "
Nov 04 05:45:02.566935 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.567080    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af3acf0e-f4e6-4006-900e-ac71780a2902-kube-api-access-qrv58\" (UniqueName: \"kubernetes.io/projected/af3acf0e-f4e6-4006-900e-ac71780a2902-kube-api-access-qrv58\") pod \"af3acf0e-f4e6-4006-900e-ac71780a2902\" (UID: \"af3acf0e-f4e6-4006-900e-ac71780a2902\") "
Nov 04 05:45:02.566935 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.568334    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af3acf0e-f4e6-4006-900e-ac71780a2902-maas-api-service-ca" pod "af3acf0e-f4e6-4006-900e-ac71780a2902" (UID: "af3acf0e-f4e6-4006-900e-ac71780a2902"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:02.574572 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.571052    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af3acf0e-f4e6-4006-900e-ac71780a2902-kube-api-access-qrv58" pod "af3acf0e-f4e6-4006-900e-ac71780a2902" (UID: "af3acf0e-f4e6-4006-900e-ac71780a2902"). InnerVolumeSpecName "kube-api-access-qrv58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:02.704865 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.688005    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrv58\" (UniqueName: \"kubernetes.io/projected/af3acf0e-f4e6-4006-900e-ac71780a2902-kube-api-access-qrv58\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:02.704865 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.688040    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af3acf0e-f4e6-4006-900e-ac71780a2902-maas-api-service-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:02.834627 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.833832    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"]
Nov 04 05:45:02.835327 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:45:02.835297    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a4ca71_22c5_4bc3_9bc3_4dcda28c2472.slice/crio-7701cf4b848d2615a0535bd1e31328b35be234a1607b22f2a0ca71c46a0adc9f WatchSource:0}: Error finding container 7701cf4b848d2615a0535bd1e31328b35be234a1607b22f2a0ca71c46a0adc9f: Status 404 returned error can't find the container with id 7701cf4b848d2615a0535bd1e31328b35be234a1607b22f2a0ca71c46a0adc9f
Nov 04 05:45:02.851925 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:02.851889    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:03.163693 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.163662    5079 generic.go:356] "Generic (PLEG): container finished" podID="af3acf0e-f4e6-4006-900e-ac71780a2902" containerID="b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d" exitCode=6
Nov 04 05:45:03.164168 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.163707    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"
Nov 04 05:45:03.164168 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.163741    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl" event={"ID":"af3acf0e-f4e6-4006-900e-ac71780a2902","Type":"ContainerDied","Data":"b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d"}
Nov 04 05:45:03.164168 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.163799    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl" event={"ID":"af3acf0e-f4e6-4006-900e-ac71780a2902","Type":"ContainerDied","Data":"971f298ad7a3219c8e91104b472d2705d68c6015097ebfed7192774df923c36c"}
Nov 04 05:45:03.164168 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.163828    5079 scope.go:122] "RemoveContainer" containerID="b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d"
Nov 04 05:45:03.166577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.166547    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h" event={"ID":"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472","Type":"ContainerStarted","Data":"7701cf4b848d2615a0535bd1e31328b35be234a1607b22f2a0ca71c46a0adc9f"}
Nov 04 05:45:03.168570 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.168542    5079 generic.go:356] "Generic (PLEG): container finished" podID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerID="d6f5a8d086067b9e22687b3690e93c372adf1d68e3af524006bc372669597ba4" exitCode=60
Nov 04 05:45:03.168713 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.168628    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q" event={"ID":"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390","Type":"ContainerDied","Data":"d6f5a8d086067b9e22687b3690e93c372adf1d68e3af524006bc372669597ba4"}
Nov 04 05:45:03.168985 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.168966    5079 scope.go:122] "RemoveContainer" containerID="d6f5a8d086067b9e22687b3690e93c372adf1d68e3af524006bc372669597ba4"
Nov 04 05:45:03.174446 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.174420    5079 generic.go:356] "Generic (PLEG): container finished" podID="45aed7bc-ac05-49d4-bce4-fa11e92f873b" containerID="a3d35769947be096de3ad7f1ac34aeeb93a7c19e254089638d48bcb573a5594a" exitCode=6
Nov 04 05:45:03.174627 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.174607    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd" event={"ID":"45aed7bc-ac05-49d4-bce4-fa11e92f873b","Type":"ContainerDied","Data":"a3d35769947be096de3ad7f1ac34aeeb93a7c19e254089638d48bcb573a5594a"}
Nov 04 05:45:03.177071 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.177051    5079 generic.go:356] "Generic (PLEG): container finished" podID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerID="a0df7b2c3e27507fa58a3716e94f3512f48d4815290bc7633227f333b0d0ef30" exitCode=60
Nov 04 05:45:03.177183 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.177088    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq" event={"ID":"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d","Type":"ContainerDied","Data":"a0df7b2c3e27507fa58a3716e94f3512f48d4815290bc7633227f333b0d0ef30"}
Nov 04 05:45:03.177423 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.177409    5079 scope.go:122] "RemoveContainer" containerID="a0df7b2c3e27507fa58a3716e94f3512f48d4815290bc7633227f333b0d0ef30"
Nov 04 05:45:03.179320 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.179303    5079 scope.go:122] "RemoveContainer" containerID="b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d"
Nov 04 05:45:03.179598 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:03.179574    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d\": container with ID starting with b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d not found: ID does not exist" containerID="b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d"
Nov 04 05:45:03.179724 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.179701    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d"} err="failed to get container status \"b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d\": rpc error: code = NotFound desc = could not find container \"b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d\": container with ID starting with b12298404aea07a0b11b78c5f45cf0a4f58777d709ca4f07ccada5087bd8ea1d not found: ID does not exist"
Nov 04 05:45:03.203398 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.203362    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"]
Nov 04 05:45:03.208338 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.208311    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-f9b4a9-29896185-lggdl"]
Nov 04 05:45:03.302570 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.302536    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af3acf0e-f4e6-4006-900e-ac71780a2902" path="/var/lib/kubelet/pods/af3acf0e-f4e6-4006-900e-ac71780a2902/volumes"
Nov 04 05:45:03.303126 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.303103    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2042576-eeb4-4205-a6f6-f643865bc74f" path="/var/lib/kubelet/pods/d2042576-eeb4-4205-a6f6-f643865bc74f/volumes"
Nov 04 05:45:03.380607 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.380000    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:45:03.402131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.401836    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:45:03.417711 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.417661    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:03.515158 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.507699    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"
Nov 04 05:45:03.520560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.519642    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:03.613654 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.612756    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45aed7bc-ac05-49d4-bce4-fa11e92f873b-kube-api-access-tqlbr\" (UniqueName: \"kubernetes.io/projected/45aed7bc-ac05-49d4-bce4-fa11e92f873b-kube-api-access-tqlbr\") pod \"45aed7bc-ac05-49d4-bce4-fa11e92f873b\" (UID: \"45aed7bc-ac05-49d4-bce4-fa11e92f873b\") "
Nov 04 05:45:03.613654 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.612975    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/45aed7bc-ac05-49d4-bce4-fa11e92f873b-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45aed7bc-ac05-49d4-bce4-fa11e92f873b-maas-api-service-ca\") pod \"45aed7bc-ac05-49d4-bce4-fa11e92f873b\" (UID: \"45aed7bc-ac05-49d4-bce4-fa11e92f873b\") "
Nov 04 05:45:03.615912 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.615865    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45aed7bc-ac05-49d4-bce4-fa11e92f873b-maas-api-service-ca" pod "45aed7bc-ac05-49d4-bce4-fa11e92f873b" (UID: "45aed7bc-ac05-49d4-bce4-fa11e92f873b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:03.630275 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.630199    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45aed7bc-ac05-49d4-bce4-fa11e92f873b-kube-api-access-tqlbr" pod "45aed7bc-ac05-49d4-bce4-fa11e92f873b" (UID: "45aed7bc-ac05-49d4-bce4-fa11e92f873b"). InnerVolumeSpecName "kube-api-access-tqlbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:03.632077 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.632037    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:03.714451 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.714410    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/45aed7bc-ac05-49d4-bce4-fa11e92f873b-maas-api-service-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:03.714451 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:03.714450    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqlbr\" (UniqueName: \"kubernetes.io/projected/45aed7bc-ac05-49d4-bce4-fa11e92f873b-kube-api-access-tqlbr\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:04.143633 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.143530    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:04.190075 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.190027    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q" event={"ID":"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390","Type":"ContainerStarted","Data":"8232932cea51c3eac8f36c894543bf7413a1579d834e1d9bedff1d6dd743cf6c"}
Nov 04 05:45:04.192092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.192061    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"
Nov 04 05:45:04.192241 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.192097    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd" event={"ID":"45aed7bc-ac05-49d4-bce4-fa11e92f873b","Type":"ContainerDied","Data":"fcdc39eda216c3a08aed18f8a89dbc1134a934f420ae5abbf0d68d929aa8ea25"}
Nov 04 05:45:04.192241 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.192163    5079 scope.go:122] "RemoveContainer" containerID="a3d35769947be096de3ad7f1ac34aeeb93a7c19e254089638d48bcb573a5594a"
Nov 04 05:45:04.195709 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.195677    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq" event={"ID":"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d","Type":"ContainerStarted","Data":"2acf2d3bd0b4c15c38917eeb37c0b0a0183a8786d14e172da073fce59c7e8669"}
Nov 04 05:45:04.231425 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.227125    5079 generic.go:356] "Generic (PLEG): container finished" podID="04a4ca71-22c5-4bc3-9bc3-4dcda28c2472" containerID="d350cb8a71be7969799909d58185e729917d0c8a1700ab1387874ba2bbd8810f" exitCode=0
Nov 04 05:45:04.231425 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.228452    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h" event={"ID":"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472","Type":"ContainerDied","Data":"d350cb8a71be7969799909d58185e729917d0c8a1700ab1387874ba2bbd8810f"}
Nov 04 05:45:04.246783 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.246749    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"]
Nov 04 05:45:04.248393 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.248368    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:45:04.253761 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.253732    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ade2e8-29896185-b7pmd"]
Nov 04 05:45:04.258889 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.258858    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:04.442929 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.442888    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:04.894359 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.894264    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:04.990607 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:04.990571    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:05.243263 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.243228    5079 generic.go:356] "Generic (PLEG): container finished" podID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerID="2acf2d3bd0b4c15c38917eeb37c0b0a0183a8786d14e172da073fce59c7e8669" exitCode=60
Nov 04 05:45:05.243744 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.243309    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq" event={"ID":"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d","Type":"ContainerDied","Data":"2acf2d3bd0b4c15c38917eeb37c0b0a0183a8786d14e172da073fce59c7e8669"}
Nov 04 05:45:05.243744 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.243369    5079 scope.go:122] "RemoveContainer" containerID="a0df7b2c3e27507fa58a3716e94f3512f48d4815290bc7633227f333b0d0ef30"
Nov 04 05:45:05.243744 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.243635    5079 scope.go:122] "RemoveContainer" containerID="2acf2d3bd0b4c15c38917eeb37c0b0a0183a8786d14e172da073fce59c7e8669"
Nov 04 05:45:05.243995 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:05.243963    5079 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq_odh-ai-gateway-infra(e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d"
Nov 04 05:45:05.245587 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.245561    5079 generic.go:356] "Generic (PLEG): container finished" podID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerID="8232932cea51c3eac8f36c894543bf7413a1579d834e1d9bedff1d6dd743cf6c" exitCode=60
Nov 04 05:45:05.245701 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.245644    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q" event={"ID":"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390","Type":"ContainerDied","Data":"8232932cea51c3eac8f36c894543bf7413a1579d834e1d9bedff1d6dd743cf6c"}
Nov 04 05:45:05.245975 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.245955    5079 scope.go:122] "RemoveContainer" containerID="8232932cea51c3eac8f36c894543bf7413a1579d834e1d9bedff1d6dd743cf6c"
Nov 04 05:45:05.246310 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:05.246288    5079 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q_odh-ai-gateway-infra(9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390"
Nov 04 05:45:05.259947 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.259919    5079 scope.go:122] "RemoveContainer" containerID="d6f5a8d086067b9e22687b3690e93c372adf1d68e3af524006bc372669597ba4"
Nov 04 05:45:05.308981 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.308938    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45aed7bc-ac05-49d4-bce4-fa11e92f873b" path="/var/lib/kubelet/pods/45aed7bc-ac05-49d4-bce4-fa11e92f873b/volumes"
Nov 04 05:45:05.441356 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.441329    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:05.548806 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.548715    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-xks-ca\") pod \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") "
Nov 04 05:45:05.548806 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.548798    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-kube-api-access-bzznh\" (UniqueName: \"kubernetes.io/projected/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-kube-api-access-bzznh\") pod \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") "
Nov 04 05:45:05.549021 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.548912    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-openshift-ca\") pod \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\" (UID: \"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472\") "
Nov 04 05:45:05.549325 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.549300    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-openshift-ca" pod "04a4ca71-22c5-4bc3-9bc3-4dcda28c2472" (UID: "04a4ca71-22c5-4bc3-9bc3-4dcda28c2472"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:05.549706 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.549687    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-openshift-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:05.550965 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.550935    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-xks-ca" pod "04a4ca71-22c5-4bc3-9bc3-4dcda28c2472" (UID: "04a4ca71-22c5-4bc3-9bc3-4dcda28c2472"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:05.551071 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.551047    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-kube-api-access-bzznh" pod "04a4ca71-22c5-4bc3-9bc3-4dcda28c2472" (UID: "04a4ca71-22c5-4bc3-9bc3-4dcda28c2472"). InnerVolumeSpecName "kube-api-access-bzznh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:05.590692 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.590653    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:05.651127 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.651083    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-maas-api-xks-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:05.651127 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:05.651131    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzznh\" (UniqueName: \"kubernetes.io/projected/04a4ca71-22c5-4bc3-9bc3-4dcda28c2472-kube-api-access-bzznh\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:06.223268 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.223233    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:06.254842 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.254809    5079 scope.go:122] "RemoveContainer" containerID="2acf2d3bd0b4c15c38917eeb37c0b0a0183a8786d14e172da073fce59c7e8669"
Nov 04 05:45:06.255297 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:06.255141    5079 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq_odh-ai-gateway-infra(e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d"
Nov 04 05:45:06.255806 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.255785    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h"
Nov 04 05:45:06.255934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.255820    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cb56d506-fl25h" event={"ID":"04a4ca71-22c5-4bc3-9bc3-4dcda28c2472","Type":"ContainerDied","Data":"7701cf4b848d2615a0535bd1e31328b35be234a1607b22f2a0ca71c46a0adc9f"}
Nov 04 05:45:06.255934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.255870    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7701cf4b848d2615a0535bd1e31328b35be234a1607b22f2a0ca71c46a0adc9f"
Nov 04 05:45:06.259242 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.259220    5079 scope.go:122] "RemoveContainer" containerID="8232932cea51c3eac8f36c894543bf7413a1579d834e1d9bedff1d6dd743cf6c"
Nov 04 05:45:06.259417 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:06.259400    5079 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q_odh-ai-gateway-infra(9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390"
Nov 04 05:45:06.372621 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.372582    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"]
Nov 04 05:45:06.373455 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.373421    5079 cpu_manager.go:414] "containerMap: removing container" podUID="45aed7bc-ac05-49d4-bce4-fa11e92f873b" containerName="cleanup"
Nov 04 05:45:06.373455 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.373446    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45aed7bc-ac05-49d4-bce4-fa11e92f873b" containerName="cleanup"
Nov 04 05:45:06.373697 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.373479    5079 cpu_manager.go:414] "containerMap: removing container" podUID="04a4ca71-22c5-4bc3-9bc3-4dcda28c2472" containerName="revoke-keys"
Nov 04 05:45:06.373697 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.373488    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04a4ca71-22c5-4bc3-9bc3-4dcda28c2472" containerName="revoke-keys"
Nov 04 05:45:06.373697 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.373537    5079 cpu_manager.go:414] "containerMap: removing container" podUID="af3acf0e-f4e6-4006-900e-ac71780a2902" containerName="cleanup"
Nov 04 05:45:06.373697 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.373546    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af3acf0e-f4e6-4006-900e-ac71780a2902" containerName="cleanup"
Nov 04 05:45:06.373897 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.373698    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="04a4ca71-22c5-4bc3-9bc3-4dcda28c2472" containerName="revoke-keys"
Nov 04 05:45:06.373897 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.373715    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="af3acf0e-f4e6-4006-900e-ac71780a2902" containerName="cleanup"
Nov 04 05:45:06.373897 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.373733    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="45aed7bc-ac05-49d4-bce4-fa11e92f873b" containerName="cleanup"
Nov 04 05:45:06.377849 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.377824    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.389669 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.389642    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"]
Nov 04 05:45:06.461519 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.461469    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.461709 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.461567    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.461767 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.461740    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.461814 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.461798    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.461890 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.461867    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdhv6\" (UniqueName: \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-kube-api-access-rdhv6\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.461988 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.461915    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.461988 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.461945    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.462102 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.462079    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.462136 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.462115    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.563232 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.563148    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.563232 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.563201    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.563466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.563282    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.563466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.563349    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.563466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.563432    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.563657 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.563496    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.563657 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.563544    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdhv6\" (UniqueName: \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-kube-api-access-rdhv6\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.563657 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.563577    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.563657 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.563606    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.564124 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.564081    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-certs\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.564124 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.564115    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.564271 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.564167    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-data\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.564271 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.564254    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-credential-socket\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.564827 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.564807    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istiod-ca-cert\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.566039 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.566005    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-envoy\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.566338 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.566319    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-podinfo\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.572972 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.572950    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-token\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.573705 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.573680    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdhv6\" (UniqueName: \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-kube-api-access-rdhv6\") pod \"e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") " pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.630215 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.630178    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"]
Nov 04 05:45:06.636163 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.636137    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.650021 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.646943    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"]
Nov 04 05:45:06.708204 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.708171    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:06.755551 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.755489    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"]
Nov 04 05:45:06.766224 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.766193    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.766350 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.766247    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.766350 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.766268    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.766350 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.766304    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.766700 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.766352    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.766700 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.766407    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.766700 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.766439    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.766700 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.766458    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7lfv\" (UniqueName: \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-kube-api-access-r7lfv\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.766700 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.766484    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.823641 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.823533    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:06.867149 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.867115    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.867326 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.867181    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.867326 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.867214    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.867326 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.867231    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7lfv\" (UniqueName: \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-kube-api-access-r7lfv\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.867326 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.867288    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.867475 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.867384    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.867475 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.867455    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.867619 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.867474    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.867619 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.867592    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.867815 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.867785    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.867991 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.867946    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.868122 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.868102    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.868248 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.868228    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.868359 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.868338    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.870151 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.870057    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.870261 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.870165    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.875148 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.875127    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.875473 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.875446    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7lfv\" (UniqueName: \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-kube-api-access-r7lfv\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.957577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.957543    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:06.994684 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:06.994646    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"]
Nov 04 05:45:07.002591 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:45:07.002548    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ce8b9d_5f15_4752_9bd7_d7dcc61b3340.slice/crio-5faece7e54f05bd6ab39c37dbb973828400bb54574d336f65a59f74271c6c529 WatchSource:0}: Error finding container 5faece7e54f05bd6ab39c37dbb973828400bb54574d336f65a59f74271c6c529: Status 404 returned error can't find the container with id 5faece7e54f05bd6ab39c37dbb973828400bb54574d336f65a59f74271c6c529
Nov 04 05:45:07.006047 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.005995    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:07.006186 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.006099    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:07.006186 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.006140    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:07.050353 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.050310    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:07.253480 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.253450    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"]
Nov 04 05:45:07.255213 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:45:07.255186    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44fe3523_7b6a_4fe9_b56c_35106a80a83e.slice/crio-241b7dc84020a07f43572f15d79569453b1c45aeecc3b6fca5587c7a58be76ea WatchSource:0}: Error finding container 241b7dc84020a07f43572f15d79569453b1c45aeecc3b6fca5587c7a58be76ea: Status 404 returned error can't find the container with id 241b7dc84020a07f43572f15d79569453b1c45aeecc3b6fca5587c7a58be76ea
Nov 04 05:45:07.259221 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.259183    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:07.259312 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.259281    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:07.259384 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.259325    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:07.268865 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.268839    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" event={"ID":"44fe3523-7b6a-4fe9-b56c-35106a80a83e","Type":"ContainerStarted","Data":"241b7dc84020a07f43572f15d79569453b1c45aeecc3b6fca5587c7a58be76ea"}
Nov 04 05:45:07.270973 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.270941    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" event={"ID":"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340","Type":"ContainerStarted","Data":"900a79525ef91f12f7d9a77de4ac4bf0af9889aae1961a2fd1fad3ab4245362f"}
Nov 04 05:45:07.271106 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.271000    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" event={"ID":"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340","Type":"ContainerStarted","Data":"5faece7e54f05bd6ab39c37dbb973828400bb54574d336f65a59f74271c6c529"}
Nov 04 05:45:07.293162 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.292927    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" podStartSLOduration=1.292905963 podStartE2EDuration="1.292905963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:07.289093822 +0000 UTC m=+1002.147081653" watchObservedRunningTime="2026-11-04 05:45:07.292905963 +0000 UTC m=+1002.150893833"
Nov 04 05:45:07.532368 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.532290    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:07.708728 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.708651    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:07.861828 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:07.861741    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:08.335325 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:08.334167    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" event={"ID":"44fe3523-7b6a-4fe9-b56c-35106a80a83e","Type":"ContainerStarted","Data":"2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24"}
Nov 04 05:45:08.375621 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:08.369046    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" podStartSLOduration=2.369023433 podStartE2EDuration="2.369023433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:08.362214859 +0000 UTC m=+1003.220202690" watchObservedRunningTime="2026-11-04 05:45:08.369023433 +0000 UTC m=+1003.227011264"
Nov 04 05:45:08.435119 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:08.434983    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:08.561031 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:08.560994    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:08.742846 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:08.742805    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 04 05:45:08.743116 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:08.743086    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 04 05:45:08.958517 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:08.958473    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:08.960386 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:08.960358    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 04 05:45:08.960567 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:08.960413    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 04 05:45:08.966019 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:08.965986    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:09.382526 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:09.380366    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:09.715522 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:09.714929    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 04 05:45:09.715522 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:09.714997    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 04 05:45:09.958247 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:09.958210    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 04 05:45:09.958453 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:09.958264    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 04 05:45:10.014580 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.013142    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:10.237391 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.237359    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:10.409644 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.409441    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:10.534689 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.534653    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:10.660574 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.657609    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"]
Nov 04 05:45:10.739525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.721108    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 04 05:45:10.747465 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.747425    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 04 05:45:10.748959 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.746389    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:10.749250 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.746277    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"]
Nov 04 05:45:10.754749 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.754725    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 05:45:10.846726 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.846693    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ab03cae5-6dmpb\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:10.847029 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.847010    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ab03cae5-6dmpb\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:10.847208 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.847195    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f25t7\" (UniqueName: \"kubernetes.io/projected/61ffb3be-0163-44ae-a52d-3c14379a6f5b-kube-api-access-f25t7\") pod \"maas-api-revoke-sub-ab03cae5-6dmpb\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:10.918029 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.917923    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:10.943604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.943573    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"]
Nov 04 05:45:10.948585 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.948549    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ab03cae5-6dmpb\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:10.948857 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.948839    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f25t7\" (UniqueName: \"kubernetes.io/projected/61ffb3be-0163-44ae-a52d-3c14379a6f5b-kube-api-access-f25t7\") pod \"maas-api-revoke-sub-ab03cae5-6dmpb\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:10.949132 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.949115    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ab03cae5-6dmpb\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:10.950455 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.950428    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ab03cae5-6dmpb\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:10.951020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.951002    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"]
Nov 04 05:45:10.951126 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.951087    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:10.953459 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.953164    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"]
Nov 04 05:45:10.953459 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.953388    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy" containerID="cri-o://9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758" gracePeriod=30
Nov 04 05:45:10.953459 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.953413    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ab03cae5-6dmpb\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:10.957954 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.957932    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 04 05:45:10.958110 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.958087    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 04 05:45:10.959197 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:10.959182    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f25t7\" (UniqueName: \"kubernetes.io/projected/61ffb3be-0163-44ae-a52d-3c14379a6f5b-kube-api-access-f25t7\") pod \"maas-api-revoke-sub-ab03cae5-6dmpb\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:11.168197 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.168100    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:11.168777 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.168748    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hwrh\" (UniqueName: \"kubernetes.io/projected/f1a5fcbf-d991-4394-a8b8-738e05834b0b-kube-api-access-6hwrh\") pod \"maas-api-revoke-sub-25dd93bf-8zbsp\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:11.169118 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.169095    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-25dd93bf-8zbsp\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:11.169306 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.169290    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-25dd93bf-8zbsp\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:11.244672 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.244159    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:11.339019 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.338983    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hwrh\" (UniqueName: \"kubernetes.io/projected/f1a5fcbf-d991-4394-a8b8-738e05834b0b-kube-api-access-6hwrh\") pod \"maas-api-revoke-sub-25dd93bf-8zbsp\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:11.349417 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.343419    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-25dd93bf-8zbsp\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:11.349417 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.343492    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-25dd93bf-8zbsp\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:11.349417 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.344545    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-25dd93bf-8zbsp\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:11.349417 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.348766    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:11.361524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.358018    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hwrh\" (UniqueName: \"kubernetes.io/projected/f1a5fcbf-d991-4394-a8b8-738e05834b0b-kube-api-access-6hwrh\") pod \"maas-api-revoke-sub-25dd93bf-8zbsp\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:11.413527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.405666    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-25dd93bf-8zbsp\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:11.566057 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.566016    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:11.738693 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.738652    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 04 05:45:11.738829 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.738720    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 04 05:45:11.748822 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.747887    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"]
Nov 04 05:45:11.841737 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.841647    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:11.958588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.958555    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 04 05:45:11.958731 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:11.958612    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 04 05:45:12.018435 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:12.018390    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"]
Nov 04 05:45:12.338765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:12.333940    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:12.523801 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:12.507055    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb" event={"ID":"61ffb3be-0163-44ae-a52d-3c14379a6f5b","Type":"ContainerStarted","Data":"ec48e9314641dba3f5fdedae0c7442e0187b3ad106529433d32c2a6813836dfb"}
Nov 04 05:45:12.523801 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:12.507121    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb" event={"ID":"61ffb3be-0163-44ae-a52d-3c14379a6f5b","Type":"ContainerStarted","Data":"0ea9893a3549b4ba9840266ecd6fa16aabdecbbe2bc3e9728af92ac0848fc99d"}
Nov 04 05:45:12.529490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:12.529350    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp" event={"ID":"f1a5fcbf-d991-4394-a8b8-738e05834b0b","Type":"ContainerStarted","Data":"5b1d36ce780ceed53eae33a4ef92a9ad24add0eb6cfd9c1e0254416eb489a0df"}
Nov 04 05:45:12.712534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:12.712340    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 04 05:45:12.712534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:12.712414    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 04 05:45:12.958104 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:12.958067    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 04 05:45:12.958291 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:12.958123    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 04 05:45:13.277750 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:13.277518    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:13.544467 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:13.544377    5079 generic.go:356] "Generic (PLEG): container finished" podID="f1a5fcbf-d991-4394-a8b8-738e05834b0b" containerID="707503193a1f131a459fd56621d1082b15f5e2abb3d1a0d07286bf4caa796499" exitCode=0
Nov 04 05:45:13.545618 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:13.545014    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp" event={"ID":"f1a5fcbf-d991-4394-a8b8-738e05834b0b","Type":"ContainerDied","Data":"707503193a1f131a459fd56621d1082b15f5e2abb3d1a0d07286bf4caa796499"}
Nov 04 05:45:13.548345 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:13.548320    5079 generic.go:356] "Generic (PLEG): container finished" podID="61ffb3be-0163-44ae-a52d-3c14379a6f5b" containerID="ec48e9314641dba3f5fdedae0c7442e0187b3ad106529433d32c2a6813836dfb" exitCode=0
Nov 04 05:45:13.548539 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:13.548456    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb" event={"ID":"61ffb3be-0163-44ae-a52d-3c14379a6f5b","Type":"ContainerDied","Data":"ec48e9314641dba3f5fdedae0c7442e0187b3ad106529433d32c2a6813836dfb"}
Nov 04 05:45:13.566652 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:13.566592    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb" podStartSLOduration=3.566578437 podStartE2EDuration="3.566578437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:12.538784974 +0000 UTC m=+1007.396772809" watchObservedRunningTime="2026-11-04 05:45:13.566578437 +0000 UTC m=+1008.424566266"
Nov 04 05:45:13.709300 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:13.709260    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Nov 04 05:45:13.709484 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:13.709334    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Nov 04 05:45:13.958046 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:13.957997    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Nov 04 05:45:13.958221 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:13.958080    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Nov 04 05:45:14.142180 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.142135    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:14.368626 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.368536    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"]
Nov 04 05:45:14.464390 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.464143    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:14.566474 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.566435    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:14.683586 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.680576    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"]
Nov 04 05:45:14.766604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.763425    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:14.785818 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.785777    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"]
Nov 04 05:45:14.786025 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.785920    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:14.798604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.795660    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:14.798604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.797218    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:14.798604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.798419    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:45:14.993124 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.993080    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/20482451-096b-4110-b818-baa7fd3a4042-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d8b0bd4-r84p7\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:14.993325 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.993227    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/20482451-096b-4110-b818-baa7fd3a4042-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d8b0bd4-r84p7\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:14.993325 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:14.993299    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdlxq\" (UniqueName: \"kubernetes.io/projected/20482451-096b-4110-b818-baa7fd3a4042-kube-api-access-xdlxq\") pod \"maas-api-revoke-sub-3d8b0bd4-r84p7\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:15.025517 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.025193    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:15.056081 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.054834    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:15.056081 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.056060    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:15.060119 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.058691    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:45:15.072540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.072003    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:15.094949 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.094906    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/20482451-096b-4110-b818-baa7fd3a4042-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d8b0bd4-r84p7\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:15.095126 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.094991    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdlxq\" (UniqueName: \"kubernetes.io/projected/20482451-096b-4110-b818-baa7fd3a4042-kube-api-access-xdlxq\") pod \"maas-api-revoke-sub-3d8b0bd4-r84p7\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:15.095221 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.095203    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/20482451-096b-4110-b818-baa7fd3a4042-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d8b0bd4-r84p7\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:15.096203 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.096100    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/20482451-096b-4110-b818-baa7fd3a4042-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d8b0bd4-r84p7\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:15.099095 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.099063    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/20482451-096b-4110-b818-baa7fd3a4042-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d8b0bd4-r84p7\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:15.112716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.112623    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:15.125545 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.122609    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdlxq\" (UniqueName: \"kubernetes.io/projected/20482451-096b-4110-b818-baa7fd3a4042-kube-api-access-xdlxq\") pod \"maas-api-revoke-sub-3d8b0bd4-r84p7\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:15.125545 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.124163    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:15.200763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.196611    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-xks-ca\") pod \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") "
Nov 04 05:45:15.200763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.196701    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61ffb3be-0163-44ae-a52d-3c14379a6f5b-kube-api-access-f25t7\" (UniqueName: \"kubernetes.io/projected/61ffb3be-0163-44ae-a52d-3c14379a6f5b-kube-api-access-f25t7\") pod \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") "
Nov 04 05:45:15.200763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.196723    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-openshift-ca\") pod \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") "
Nov 04 05:45:15.200763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.196741    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-openshift-ca\") pod \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") "
Nov 04 05:45:15.200763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.196806    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f1a5fcbf-d991-4394-a8b8-738e05834b0b-kube-api-access-6hwrh\" (UniqueName: \"kubernetes.io/projected/f1a5fcbf-d991-4394-a8b8-738e05834b0b-kube-api-access-6hwrh\") pod \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\" (UID: \"f1a5fcbf-d991-4394-a8b8-738e05834b0b\") "
Nov 04 05:45:15.200763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.198301    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-openshift-ca" pod "f1a5fcbf-d991-4394-a8b8-738e05834b0b" (UID: "f1a5fcbf-d991-4394-a8b8-738e05834b0b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:15.200763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.198353    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-openshift-ca" pod "61ffb3be-0163-44ae-a52d-3c14379a6f5b" (UID: "61ffb3be-0163-44ae-a52d-3c14379a6f5b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:15.200763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.198593    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-xks-ca\") pod \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\" (UID: \"61ffb3be-0163-44ae-a52d-3c14379a6f5b\") "
Nov 04 05:45:15.200763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.199538    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-openshift-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:15.200763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.199565    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-openshift-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:15.201750 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.201720    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-xks-ca" pod "f1a5fcbf-d991-4394-a8b8-738e05834b0b" (UID: "f1a5fcbf-d991-4394-a8b8-738e05834b0b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:15.210193 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.210149    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:15.210314 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.210294    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61ffb3be-0163-44ae-a52d-3c14379a6f5b-kube-api-access-f25t7" pod "61ffb3be-0163-44ae-a52d-3c14379a6f5b" (UID: "61ffb3be-0163-44ae-a52d-3c14379a6f5b"). InnerVolumeSpecName "kube-api-access-f25t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:15.210466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.210438    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1a5fcbf-d991-4394-a8b8-738e05834b0b-kube-api-access-6hwrh" pod "f1a5fcbf-d991-4394-a8b8-738e05834b0b" (UID: "f1a5fcbf-d991-4394-a8b8-738e05834b0b"). InnerVolumeSpecName "kube-api-access-6hwrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:15.212365 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.212334    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-xks-ca" pod "61ffb3be-0163-44ae-a52d-3c14379a6f5b" (UID: "61ffb3be-0163-44ae-a52d-3c14379a6f5b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:15.238594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.238493    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"]
Nov 04 05:45:15.298546 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.295426    5079 scope.go:122] "RemoveContainer" containerID="2acf2d3bd0b4c15c38917eeb37c0b0a0183a8786d14e172da073fce59c7e8669"
Nov 04 05:45:15.304811 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.303967    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hwrh\" (UniqueName: \"kubernetes.io/projected/f1a5fcbf-d991-4394-a8b8-738e05834b0b-kube-api-access-6hwrh\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:15.304811 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.303995    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/61ffb3be-0163-44ae-a52d-3c14379a6f5b-maas-api-xks-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:15.304811 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.304012    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f1a5fcbf-d991-4394-a8b8-738e05834b0b-maas-api-xks-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:15.304811 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.304027    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f25t7\" (UniqueName: \"kubernetes.io/projected/61ffb3be-0163-44ae-a52d-3c14379a6f5b-kube-api-access-f25t7\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:15.307952 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.307913    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:15.438524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.437669    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"]
Nov 04 05:45:15.454525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.447249    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"]
Nov 04 05:45:15.477912 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.477885    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:15.496722 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.496558    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"]
Nov 04 05:45:15.549650 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.549615    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:15.567033 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.567008    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb"
Nov 04 05:45:15.567466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.567005    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ab03cae5-6dmpb" event={"ID":"61ffb3be-0163-44ae-a52d-3c14379a6f5b","Type":"ContainerDied","Data":"0ea9893a3549b4ba9840266ecd6fa16aabdecbbe2bc3e9728af92ac0848fc99d"}
Nov 04 05:45:15.567466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.567151    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ea9893a3549b4ba9840266ecd6fa16aabdecbbe2bc3e9728af92ac0848fc99d"
Nov 04 05:45:15.568639 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.568618    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp"
Nov 04 05:45:15.568782 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.568656    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25dd93bf-8zbsp" event={"ID":"f1a5fcbf-d991-4394-a8b8-738e05834b0b","Type":"ContainerDied","Data":"5b1d36ce780ceed53eae33a4ef92a9ad24add0eb6cfd9c1e0254416eb489a0df"}
Nov 04 05:45:15.568782 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.568700    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b1d36ce780ceed53eae33a4ef92a9ad24add0eb6cfd9c1e0254416eb489a0df"
Nov 04 05:45:15.690465 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.690427    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:15.995645 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:15.995611    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:16.261342 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.261305    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:45:16.271257 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.271201    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:16.291796 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.289009    5079 scope.go:122] "RemoveContainer" containerID="8232932cea51c3eac8f36c894543bf7413a1579d834e1d9bedff1d6dd743cf6c"
Nov 04 05:45:16.422656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.422618    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-credential-socket\") pod \"d4d61a7c-e515-4835-af73-9a4177e08880\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") "
Nov 04 05:45:16.422845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.422766    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-istio-token\" (UniqueName: \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-istio-token\") pod \"d4d61a7c-e515-4835-af73-9a4177e08880\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") "
Nov 04 05:45:16.422845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.422801    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-envoy\") pod \"d4d61a7c-e515-4835-af73-9a4177e08880\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") "
Nov 04 05:45:16.422990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.422843    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-certs\") pod \"d4d61a7c-e515-4835-af73-9a4177e08880\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") "
Nov 04 05:45:16.422990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.422923    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-credential-socket" pod "d4d61a7c-e515-4835-af73-9a4177e08880" (UID: "d4d61a7c-e515-4835-af73-9a4177e08880"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:16.423121 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.423101    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-certs" pod "d4d61a7c-e515-4835-af73-9a4177e08880" (UID: "d4d61a7c-e515-4835-af73-9a4177e08880"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:16.423177 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.423116    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-kube-api-access-4b6bv\" (UniqueName: \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-kube-api-access-4b6bv\") pod \"d4d61a7c-e515-4835-af73-9a4177e08880\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") "
Nov 04 05:45:16.423236 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.423197    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-data\") pod \"d4d61a7c-e515-4835-af73-9a4177e08880\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") "
Nov 04 05:45:16.423357 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.423322    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d4d61a7c-e515-4835-af73-9a4177e08880-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d61a7c-e515-4835-af73-9a4177e08880-istiod-ca-cert\") pod \"d4d61a7c-e515-4835-af73-9a4177e08880\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") "
Nov 04 05:45:16.423436 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.423384    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d4d61a7c-e515-4835-af73-9a4177e08880-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d61a7c-e515-4835-af73-9a4177e08880-istio-podinfo\") pod \"d4d61a7c-e515-4835-af73-9a4177e08880\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") "
Nov 04 05:45:16.423495 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.423469    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-socket\") pod \"d4d61a7c-e515-4835-af73-9a4177e08880\" (UID: \"d4d61a7c-e515-4835-af73-9a4177e08880\") "
Nov 04 05:45:16.424278 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.423541    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-data" pod "d4d61a7c-e515-4835-af73-9a4177e08880" (UID: "d4d61a7c-e515-4835-af73-9a4177e08880"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:16.424278 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.423728    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4d61a7c-e515-4835-af73-9a4177e08880-istiod-ca-cert" pod "d4d61a7c-e515-4835-af73-9a4177e08880" (UID: "d4d61a7c-e515-4835-af73-9a4177e08880"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:16.424278 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.423843    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-socket" pod "d4d61a7c-e515-4835-af73-9a4177e08880" (UID: "d4d61a7c-e515-4835-af73-9a4177e08880"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:16.424440 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.424315    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.424440 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.424335    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.424440 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.424366    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d61a7c-e515-4835-af73-9a4177e08880-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.424440 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.424380    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.424440 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.424395    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.425566 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.425542    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-kube-api-access-4b6bv" pod "d4d61a7c-e515-4835-af73-9a4177e08880" (UID: "d4d61a7c-e515-4835-af73-9a4177e08880"). InnerVolumeSpecName "kube-api-access-4b6bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:16.425650 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.425608    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-istio-token" pod "d4d61a7c-e515-4835-af73-9a4177e08880" (UID: "d4d61a7c-e515-4835-af73-9a4177e08880"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:16.425859 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.425837    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-envoy" pod "d4d61a7c-e515-4835-af73-9a4177e08880" (UID: "d4d61a7c-e515-4835-af73-9a4177e08880"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:16.426691 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.426672    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4d61a7c-e515-4835-af73-9a4177e08880-istio-podinfo" pod "d4d61a7c-e515-4835-af73-9a4177e08880" (UID: "d4d61a7c-e515-4835-af73-9a4177e08880"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:45:16.525284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.525247    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d61a7c-e515-4835-af73-9a4177e08880-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.525284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.525277    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.525284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.525286    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d61a7c-e515-4835-af73-9a4177e08880-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.525284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.525295    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b6bv\" (UniqueName: \"kubernetes.io/projected/d4d61a7c-e515-4835-af73-9a4177e08880-kube-api-access-4b6bv\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:16.581668 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.581639    5079 generic.go:356] "Generic (PLEG): container finished" podID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerID="6b186353f7e4aa8827534bdc1b69b9d501f21824e4c5a474aa86cd9940cc7d67" exitCode=60
Nov 04 05:45:16.582166 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.581711    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq" event={"ID":"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d","Type":"ContainerDied","Data":"6b186353f7e4aa8827534bdc1b69b9d501f21824e4c5a474aa86cd9940cc7d67"}
Nov 04 05:45:16.582166 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.581868    5079 scope.go:122] "RemoveContainer" containerID="2acf2d3bd0b4c15c38917eeb37c0b0a0183a8786d14e172da073fce59c7e8669"
Nov 04 05:45:16.582284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.582249    5079 scope.go:122] "RemoveContainer" containerID="6b186353f7e4aa8827534bdc1b69b9d501f21824e4c5a474aa86cd9940cc7d67"
Nov 04 05:45:16.582699 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:16.582671    5079 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq_odh-ai-gateway-infra(e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d"
Nov 04 05:45:16.584252 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.584224    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7" event={"ID":"20482451-096b-4110-b818-baa7fd3a4042","Type":"ContainerStarted","Data":"8866d39b8b961afd41d6438bc1d38fa3a515acf03ff0eec9eeeab0972195b67d"}
Nov 04 05:45:16.584347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.584277    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7" event={"ID":"20482451-096b-4110-b818-baa7fd3a4042","Type":"ContainerStarted","Data":"2c55480cf5bc0e3dd672cf819c7f8a23cda1cb5129ab53e1f63d2eac99de23e9"}
Nov 04 05:45:16.586387 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.586361    5079 generic.go:356] "Generic (PLEG): container finished" podID="d4d61a7c-e515-4835-af73-9a4177e08880" containerID="9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758" exitCode=0
Nov 04 05:45:16.586491 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.586422    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"
Nov 04 05:45:16.586491 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.586477    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" event={"ID":"d4d61a7c-e515-4835-af73-9a4177e08880","Type":"ContainerDied","Data":"9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758"}
Nov 04 05:45:16.586645 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.586556    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v" event={"ID":"d4d61a7c-e515-4835-af73-9a4177e08880","Type":"ContainerDied","Data":"32c86c43fa447c0a8b3ceff3f8a90ffbcc9e9f8b965a2e84bce1ad4710c5bd68"}
Nov 04 05:45:16.606571 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.606389    5079 scope.go:122] "RemoveContainer" containerID="9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758"
Nov 04 05:45:16.626560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.626455    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7" podStartSLOduration=2.626437091 podStartE2EDuration="2.626437091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:16.620898003 +0000 UTC m=+1011.478885834" watchObservedRunningTime="2026-11-04 05:45:16.626437091 +0000 UTC m=+1011.484424923"
Nov 04 05:45:16.628052 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.628025    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:16.646294 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.646271    5079 scope.go:122] "RemoveContainer" containerID="a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768"
Nov 04 05:45:16.657601 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.657565    5079 scope.go:122] "RemoveContainer" containerID="9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758"
Nov 04 05:45:16.658066 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:16.658033    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758\": container with ID starting with 9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758 not found: ID does not exist" containerID="9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758"
Nov 04 05:45:16.658190 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.658077    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758"} err="failed to get container status \"9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758\": rpc error: code = NotFound desc = could not find container \"9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758\": container with ID starting with 9da98833728bb0764cc48cdce537eee912f6c222f9546abd73b4a4e5ec23e758 not found: ID does not exist"
Nov 04 05:45:16.658190 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.658103    5079 scope.go:122] "RemoveContainer" containerID="a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768"
Nov 04 05:45:16.658409 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:16.658387    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768\": container with ID starting with a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768 not found: ID does not exist" containerID="a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768"
Nov 04 05:45:16.658484 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.658415    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768"} err="failed to get container status \"a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768\": rpc error: code = NotFound desc = could not find container \"a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768\": container with ID starting with a5c2138b8ee12bac131c1c71db3e13e6aeb0c1363908cf1119498514a2885768 not found: ID does not exist"
Nov 04 05:45:16.661751 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.661725    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"]
Nov 04 05:45:16.664157 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:16.664128    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:45:16.667305 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.667282    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-ade2e8-openshift-default-5975d78855-xj99v"]
Nov 04 05:45:16.724179 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.724074    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:16.824051 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.824012    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:16.835889 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.835848    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"]
Nov 04 05:45:16.843468 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.843439    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"]
Nov 04 05:45:16.924922 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:16.924884    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:17.024123 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.024094    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:17.311714 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.311615    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" path="/var/lib/kubelet/pods/d4d61a7c-e515-4835-af73-9a4177e08880/volumes"
Nov 04 05:45:17.598825 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.598724    5079 generic.go:356] "Generic (PLEG): container finished" podID="20482451-096b-4110-b818-baa7fd3a4042" containerID="8866d39b8b961afd41d6438bc1d38fa3a515acf03ff0eec9eeeab0972195b67d" exitCode=0
Nov 04 05:45:17.598825 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.598778    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7" event={"ID":"20482451-096b-4110-b818-baa7fd3a4042","Type":"ContainerDied","Data":"8866d39b8b961afd41d6438bc1d38fa3a515acf03ff0eec9eeeab0972195b67d"}
Nov 04 05:45:17.603857 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.603815    5079 generic.go:356] "Generic (PLEG): container finished" podID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerID="02f35d0447aaeb6042af58a114c48f61a290d44a3112b0b8219a0b4c840c74f2" exitCode=60
Nov 04 05:45:17.604009 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.603861    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q" event={"ID":"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390","Type":"ContainerDied","Data":"02f35d0447aaeb6042af58a114c48f61a290d44a3112b0b8219a0b4c840c74f2"}
Nov 04 05:45:17.604009 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.603945    5079 scope.go:122] "RemoveContainer" containerID="8232932cea51c3eac8f36c894543bf7413a1579d834e1d9bedff1d6dd743cf6c"
Nov 04 05:45:17.604375 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.604357    5079 scope.go:122] "RemoveContainer" containerID="02f35d0447aaeb6042af58a114c48f61a290d44a3112b0b8219a0b4c840c74f2"
Nov 04 05:45:17.604769 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:17.604743    5079 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q_odh-ai-gateway-infra(9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390"
Nov 04 05:45:17.613095 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.613070    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"]
Nov 04 05:45:17.801471 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.801444    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"
Nov 04 05:45:17.843543 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.843469    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-kube-api-access-7jxjn\" (UniqueName: \"kubernetes.io/projected/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-kube-api-access-7jxjn\") pod \"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d\" (UID: \"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d\") "
Nov 04 05:45:17.843739 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.843717    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-maas-api-service-ca\") pod \"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d\" (UID: \"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d\") "
Nov 04 05:45:17.844184 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.844152    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-maas-api-service-ca" pod "e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" (UID: "e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:17.844323 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.844305    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-maas-api-service-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:17.845959 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.845930    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-kube-api-access-7jxjn" pod "e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" (UID: "e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d"). InnerVolumeSpecName "kube-api-access-7jxjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:17.922192 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.922151    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:17.945632 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:17.945597    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jxjn\" (UniqueName: \"kubernetes.io/projected/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d-kube-api-access-7jxjn\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:18.023532 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.021086    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:18.319125 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.319086    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"]
Nov 04 05:45:18.319625 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.319589    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy" containerID="cri-o://285e696e0a8257d1255f090482f47f1cf5d26c6ac1b1a680b31b97c6aecc7a34" gracePeriod=30
Nov 04 05:45:18.346020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.345982    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:18.572452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.572359    5079 patch_prober.go:29] interesting pod/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:45:18.572452 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.572432    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:45:18.614520 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.613540    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"
Nov 04 05:45:18.614520 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.613570    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq" event={"ID":"e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d","Type":"ContainerDied","Data":"6d050c8469dd89be1cbf1dc93b4597ecbced44d58a86f37e880c7594d6fb1fb6"}
Nov 04 05:45:18.614520 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.613620    5079 scope.go:122] "RemoveContainer" containerID="6b186353f7e4aa8827534bdc1b69b9d501f21824e4c5a474aa86cd9940cc7d67"
Nov 04 05:45:18.641250 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.641220    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"]
Nov 04 05:45:18.648527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.648468    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-2b14d0-29896185-whwdq"]
Nov 04 05:45:18.673130 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.673099    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"]
Nov 04 05:45:18.831238 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.831163    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:18.844106 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.844058    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:18.863762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.863730    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/20482451-096b-4110-b818-baa7fd3a4042-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/20482451-096b-4110-b818-baa7fd3a4042-maas-api-xks-ca\") pod \"20482451-096b-4110-b818-baa7fd3a4042\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") "
Nov 04 05:45:18.863927 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.863837    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/20482451-096b-4110-b818-baa7fd3a4042-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/20482451-096b-4110-b818-baa7fd3a4042-maas-api-openshift-ca\") pod \"20482451-096b-4110-b818-baa7fd3a4042\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") "
Nov 04 05:45:18.863990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.863933    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20482451-096b-4110-b818-baa7fd3a4042-kube-api-access-xdlxq\" (UniqueName: \"kubernetes.io/projected/20482451-096b-4110-b818-baa7fd3a4042-kube-api-access-xdlxq\") pod \"20482451-096b-4110-b818-baa7fd3a4042\" (UID: \"20482451-096b-4110-b818-baa7fd3a4042\") "
Nov 04 05:45:18.864302 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.864272    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20482451-096b-4110-b818-baa7fd3a4042-maas-api-openshift-ca" pod "20482451-096b-4110-b818-baa7fd3a4042" (UID: "20482451-096b-4110-b818-baa7fd3a4042"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:18.866947 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.866915    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20482451-096b-4110-b818-baa7fd3a4042-maas-api-xks-ca" pod "20482451-096b-4110-b818-baa7fd3a4042" (UID: "20482451-096b-4110-b818-baa7fd3a4042"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:18.868663 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.868630    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20482451-096b-4110-b818-baa7fd3a4042-kube-api-access-xdlxq" pod "20482451-096b-4110-b818-baa7fd3a4042" (UID: "20482451-096b-4110-b818-baa7fd3a4042"). InnerVolumeSpecName "kube-api-access-xdlxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:18.975667 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.972552    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/20482451-096b-4110-b818-baa7fd3a4042-maas-api-xks-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:18.975667 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.972589    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/20482451-096b-4110-b818-baa7fd3a4042-maas-api-openshift-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:18.975667 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.972606    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdlxq\" (UniqueName: \"kubernetes.io/projected/20482451-096b-4110-b818-baa7fd3a4042-kube-api-access-xdlxq\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:18.977528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:18.976942    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"
Nov 04 05:45:19.073081 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.073043    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-maas-api-service-ca\") pod \"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390\" (UID: \"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390\") "
Nov 04 05:45:19.073254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.073205    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-kube-api-access-5c4bv\" (UniqueName: \"kubernetes.io/projected/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-kube-api-access-5c4bv\") pod \"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390\" (UID: \"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390\") "
Nov 04 05:45:19.073518 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.073475    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-maas-api-service-ca" pod "9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" (UID: "9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:19.073920 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.073897    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-maas-api-service-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:19.075350 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.075325    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-kube-api-access-5c4bv" pod "9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" (UID: "9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390"). InnerVolumeSpecName "kube-api-access-5c4bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:19.175822 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.175786    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c4bv\" (UniqueName: \"kubernetes.io/projected/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390-kube-api-access-5c4bv\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:19.180780 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.180750    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:19.276646 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.276603    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"]
Nov 04 05:45:19.277444 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277425    5079 cpu_manager.go:414] "containerMap: removing container" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerName="cleanup"
Nov 04 05:45:19.277483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277449    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerName="cleanup"
Nov 04 05:45:19.277483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277467    5079 cpu_manager.go:414] "containerMap: removing container" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerName="cleanup"
Nov 04 05:45:19.277483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277474    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerName="cleanup"
Nov 04 05:45:19.277581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277492    5079 cpu_manager.go:414] "containerMap: removing container" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy"
Nov 04 05:45:19.277581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277514    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy"
Nov 04 05:45:19.277581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277526    5079 cpu_manager.go:414] "containerMap: removing container" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerName="cleanup"
Nov 04 05:45:19.277581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277534    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerName="cleanup"
Nov 04 05:45:19.277581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277557    5079 cpu_manager.go:414] "containerMap: removing container" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerName="cleanup"
Nov 04 05:45:19.277581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277564    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerName="cleanup"
Nov 04 05:45:19.277581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277579    5079 cpu_manager.go:414] "containerMap: removing container" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerName="cleanup"
Nov 04 05:45:19.277791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277586    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerName="cleanup"
Nov 04 05:45:19.277791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277596    5079 cpu_manager.go:414] "containerMap: removing container" podUID="f1a5fcbf-d991-4394-a8b8-738e05834b0b" containerName="revoke-keys"
Nov 04 05:45:19.277791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277603    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f1a5fcbf-d991-4394-a8b8-738e05834b0b" containerName="revoke-keys"
Nov 04 05:45:19.277791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277652    5079 cpu_manager.go:414] "containerMap: removing container" podUID="61ffb3be-0163-44ae-a52d-3c14379a6f5b" containerName="revoke-keys"
Nov 04 05:45:19.277791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277660    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61ffb3be-0163-44ae-a52d-3c14379a6f5b" containerName="revoke-keys"
Nov 04 05:45:19.277791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277678    5079 cpu_manager.go:414] "containerMap: removing container" podUID="20482451-096b-4110-b818-baa7fd3a4042" containerName="revoke-keys"
Nov 04 05:45:19.277791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277685    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="20482451-096b-4110-b818-baa7fd3a4042" containerName="revoke-keys"
Nov 04 05:45:19.277982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277818    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy"
Nov 04 05:45:19.277982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277830    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerName="cleanup"
Nov 04 05:45:19.277982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277842    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="61ffb3be-0163-44ae-a52d-3c14379a6f5b" containerName="revoke-keys"
Nov 04 05:45:19.277982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277852    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="20482451-096b-4110-b818-baa7fd3a4042" containerName="revoke-keys"
Nov 04 05:45:19.277982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277863    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerName="cleanup"
Nov 04 05:45:19.277982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277871    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerName="cleanup"
Nov 04 05:45:19.277982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277880    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy"
Nov 04 05:45:19.277982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277887    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerName="cleanup"
Nov 04 05:45:19.277982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277897    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerName="cleanup"
Nov 04 05:45:19.277982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277904    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" containerName="cleanup"
Nov 04 05:45:19.277982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.277914    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="f1a5fcbf-d991-4394-a8b8-738e05834b0b" containerName="revoke-keys"
Nov 04 05:45:19.282159 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.282137    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.286716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.286458    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 04 05:45:19.286716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.286576    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qrh98\""
Nov 04 05:45:19.286716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.286626    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 04 05:45:19.286716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.286693    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 04 05:45:19.290460 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.290426    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"]
Nov 04 05:45:19.310831 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.308703    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" path="/var/lib/kubelet/pods/e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d/volumes"
Nov 04 05:45:19.369618 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.369573    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg" podUID="595c6133-3f19-4cb0-bf5f-b69e7554278b" containerName="payload-processing" containerID="cri-o://be2221b9e48ba6a5ecfc577c61b979ff5d9c53f8fbbb7e2888962fd0b58317af" gracePeriod=25
Nov 04 05:45:19.378778 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.378748    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.378908 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.378802    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqcq8\" (UniqueName: \"kubernetes.io/projected/e442681a-66b1-4f8b-930a-267fa563d3f2-kube-api-access-hqcq8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.378908 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.378886    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.379032 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.378990    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.379084 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.379052    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e442681a-66b1-4f8b-930a-267fa563d3f2-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.379167 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.379151    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e442681a-66b1-4f8b-930a-267fa563d3f2-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.379241 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.379228    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.480617 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.480531    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.480617 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.480587    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.480828 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.480630    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e442681a-66b1-4f8b-930a-267fa563d3f2-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.480828 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.480698    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e442681a-66b1-4f8b-930a-267fa563d3f2-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.480828 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.480803    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.480981 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.480943    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.481032 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.480978    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqcq8\" (UniqueName: \"kubernetes.io/projected/e442681a-66b1-4f8b-930a-267fa563d3f2-kube-api-access-hqcq8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.481655 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.481624    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.483922 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.483815    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e442681a-66b1-4f8b-930a-267fa563d3f2-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.483922 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.483876    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e442681a-66b1-4f8b-930a-267fa563d3f2-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.483922 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.483912    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.484073 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.483997    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.489462 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.489437    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e442681a-66b1-4f8b-930a-267fa563d3f2-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.489790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.489757    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqcq8\" (UniqueName: \"kubernetes.io/projected/e442681a-66b1-4f8b-930a-267fa563d3f2-kube-api-access-hqcq8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-c687j\" (UID: \"e442681a-66b1-4f8b-930a-267fa563d3f2\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.562741 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.562706    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:19.606433 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.606399    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:19.705131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.703230    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:45:19.732640 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.732539    5079 generic.go:356] "Generic (PLEG): container finished" podID="595c6133-3f19-4cb0-bf5f-b69e7554278b" containerID="be2221b9e48ba6a5ecfc577c61b979ff5d9c53f8fbbb7e2888962fd0b58317af" exitCode=0
Nov 04 05:45:19.732850 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.732644    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg" event={"ID":"595c6133-3f19-4cb0-bf5f-b69e7554278b","Type":"ContainerDied","Data":"be2221b9e48ba6a5ecfc577c61b979ff5d9c53f8fbbb7e2888962fd0b58317af"}
Nov 04 05:45:19.732850 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.732735    5079 scope.go:122] "RemoveContainer" containerID="be2221b9e48ba6a5ecfc577c61b979ff5d9c53f8fbbb7e2888962fd0b58317af"
Nov 04 05:45:19.733007 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.732882    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"
Nov 04 05:45:19.735580 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.735536    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7"
Nov 04 05:45:19.735752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.735726    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d8b0bd4-r84p7" event={"ID":"20482451-096b-4110-b818-baa7fd3a4042","Type":"ContainerDied","Data":"2c55480cf5bc0e3dd672cf819c7f8a23cda1cb5129ab53e1f63d2eac99de23e9"}
Nov 04 05:45:19.735881 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.735866    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c55480cf5bc0e3dd672cf819c7f8a23cda1cb5129ab53e1f63d2eac99de23e9"
Nov 04 05:45:19.737972 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.737953    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"
Nov 04 05:45:19.738175 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.738034    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q" event={"ID":"9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390","Type":"ContainerDied","Data":"4caaec119c1c7d92bdfb1442db46a448a3d908a41ff9a005fd2ea288e84d703f"}
Nov 04 05:45:19.755412 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.755381    5079 scope.go:122] "RemoveContainer" containerID="02f35d0447aaeb6042af58a114c48f61a290d44a3112b0b8219a0b4c840c74f2"
Nov 04 05:45:19.765557 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.765520    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"]
Nov 04 05:45:19.772060 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.771917    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f910f5-29896185-2hd8q"]
Nov 04 05:45:19.798525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.789723    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/595c6133-3f19-4cb0-bf5f-b69e7554278b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/595c6133-3f19-4cb0-bf5f-b69e7554278b-plugins-config-volume\") pod \"595c6133-3f19-4cb0-bf5f-b69e7554278b\" (UID: \"595c6133-3f19-4cb0-bf5f-b69e7554278b\") "
Nov 04 05:45:19.798525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.789778    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/595c6133-3f19-4cb0-bf5f-b69e7554278b-kube-api-access-8zb2p\" (UniqueName: \"kubernetes.io/projected/595c6133-3f19-4cb0-bf5f-b69e7554278b-kube-api-access-8zb2p\") pod \"595c6133-3f19-4cb0-bf5f-b69e7554278b\" (UID: \"595c6133-3f19-4cb0-bf5f-b69e7554278b\") "
Nov 04 05:45:19.798525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.796259    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/595c6133-3f19-4cb0-bf5f-b69e7554278b-plugins-config-volume" pod "595c6133-3f19-4cb0-bf5f-b69e7554278b" (UID: "595c6133-3f19-4cb0-bf5f-b69e7554278b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:19.813587 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.812726    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/595c6133-3f19-4cb0-bf5f-b69e7554278b-kube-api-access-8zb2p" pod "595c6133-3f19-4cb0-bf5f-b69e7554278b" (UID: "595c6133-3f19-4cb0-bf5f-b69e7554278b"). InnerVolumeSpecName "kube-api-access-8zb2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:19.891599 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.891567    5079 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/595c6133-3f19-4cb0-bf5f-b69e7554278b-plugins-config-volume\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:19.891599 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:19.891596    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zb2p\" (UniqueName: \"kubernetes.io/projected/595c6133-3f19-4cb0-bf5f-b69e7554278b-kube-api-access-8zb2p\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:20.004020 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:45:20.003986    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode442681a_66b1_4f8b_930a_267fa563d3f2.slice/crio-57a21af1c5f2115e9ec5a91e8f5639af2350e2bda51226c9cbafc8255b445ebe WatchSource:0}: Error finding container 57a21af1c5f2115e9ec5a91e8f5639af2350e2bda51226c9cbafc8255b445ebe: Status 404 returned error can't find the container with id 57a21af1c5f2115e9ec5a91e8f5639af2350e2bda51226c9cbafc8255b445ebe
Nov 04 05:45:20.004847 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:20.004821    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"]
Nov 04 05:45:20.057692 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:20.057657    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"]
Nov 04 05:45:20.060999 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:20.060968    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-2b14d0-66585647c6-l9shg"]
Nov 04 05:45:20.360982 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:20.360888    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:20.460828 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:20.460789    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:20.665199 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:20.665102    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:20.749295 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:20.749257    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"]
Nov 04 05:45:20.749833 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:20.749521    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" podUID="f07418fd-c953-42ed-a436-2e02cdfb7a05" containerName="istio-proxy" containerID="cri-o://ab60e625284833e10ada56437d6001a114ea0368947ea8f5828ad1ec96aa12d2" gracePeriod=30
Nov 04 05:45:20.760339 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:20.760295    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j" event={"ID":"e442681a-66b1-4f8b-930a-267fa563d3f2","Type":"ContainerStarted","Data":"57a21af1c5f2115e9ec5a91e8f5639af2350e2bda51226c9cbafc8255b445ebe"}
Nov 04 05:45:20.778350 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:20.778272    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:21.167156 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.167123    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:21.300830 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.300797    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="595c6133-3f19-4cb0-bf5f-b69e7554278b" path="/var/lib/kubelet/pods/595c6133-3f19-4cb0-bf5f-b69e7554278b/volumes"
Nov 04 05:45:21.301359 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.301337    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390" path="/var/lib/kubelet/pods/9d35ca3b-adcc-4c9a-bc02-ad6a17ec9390/volumes"
Nov 04 05:45:21.366206 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.366173    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:21.563144 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.563096    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"]
Nov 04 05:45:21.563804 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.563776    5079 cpu_manager.go:414] "containerMap: removing container" podUID="595c6133-3f19-4cb0-bf5f-b69e7554278b" containerName="payload-processing"
Nov 04 05:45:21.563804 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.563799    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="595c6133-3f19-4cb0-bf5f-b69e7554278b" containerName="payload-processing"
Nov 04 05:45:21.563960 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.563843    5079 cpu_manager.go:414] "containerMap: removing container" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerName="cleanup"
Nov 04 05:45:21.563960 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.563849    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9cc36a9-c2cf-4734-97f9-fd1f955e2a6d" containerName="cleanup"
Nov 04 05:45:21.563960 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.563858    5079 cpu_manager.go:414] "containerMap: removing container" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy"
Nov 04 05:45:21.563960 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.563863    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d4d61a7c-e515-4835-af73-9a4177e08880" containerName="istio-proxy"
Nov 04 05:45:21.564094 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.563973    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="595c6133-3f19-4cb0-bf5f-b69e7554278b" containerName="payload-processing"
Nov 04 05:45:21.568960 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.568942    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.587524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.578205    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"]
Nov 04 05:45:21.627553 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.623877    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.627553 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.624044    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbzps\" (UniqueName: \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-kube-api-access-gbzps\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.627553 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.624264    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.627553 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.624321    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.627553 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.624367    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.627553 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.624398    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.627553 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.624434    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.627553 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.624470    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.627553 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.624539    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.725319 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.725283    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.725471 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.725337    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.725471 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.725376    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.725471 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.725401    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.725646 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.725556    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.725646 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.725609    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.725738 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.725644    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.725738 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.725716    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.725825 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.725792    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbzps\" (UniqueName: \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-kube-api-access-gbzps\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.725880 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.725823    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-credential-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.726713 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.726164    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-certs\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.726836 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.726746    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-data\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.726836 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.726765    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-socket\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.726953 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.726880    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istiod-ca-cert\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.728775 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.728751    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-podinfo\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.734849 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.734408    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-envoy\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.737061 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.737035    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-token\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.737061 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.737030    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbzps\" (UniqueName: \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-kube-api-access-gbzps\") pod \"e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") " pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.793954 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.793867    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v" podUID="86fae14f-6a9a-4129-bb37-b412c2faa480" containerName="main" containerID="cri-o://312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1" gracePeriod=45
Nov 04 05:45:21.895079 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.895021    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"]
Nov 04 05:45:21.898075 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.898040    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:21.901996 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.900219    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:21.918742 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.918708    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"]
Nov 04 05:45:21.929254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.928688    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:21.929254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.928765    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:21.929254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.928798    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:21.929254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.928835    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:21.929254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.928859    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:21.929254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.928886    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:21.929254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.928941    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:21.929254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.928982    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:21.929254 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.929043    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cgm5\" (UniqueName: \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-kube-api-access-7cgm5\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:21.988565 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:21.988441    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:22.030535 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.030063    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.030535 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.030134    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.030535 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.030221    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cgm5\" (UniqueName: \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-kube-api-access-7cgm5\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.030535 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.030351    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.030535 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.030411    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.030535 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.030412    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.030535 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.030441    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.030535 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.030477    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.031086 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.030557    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.031086 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.030611    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.031086 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.031005    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-data\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.031215 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.031108    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-certs\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.031320 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.031294    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-credential-socket\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.031826 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.031796    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istiod-ca-cert\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.034574 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.034550    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-envoy\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.035534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.035475    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-podinfo\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.038619 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.038473    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cgm5\" (UniqueName: \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-kube-api-access-7cgm5\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.039352 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.038947    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-token\") pod \"e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") " pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.143042 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.143013    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:45:22.234343 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.233626    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-home\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-home\") pod \"86fae14f-6a9a-4129-bb37-b412c2faa480\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") "
Nov 04 05:45:22.234343 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.233686    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/86fae14f-6a9a-4129-bb37-b412c2faa480-tls-certs\" (UniqueName: \"kubernetes.io/secret/86fae14f-6a9a-4129-bb37-b412c2faa480-tls-certs\") pod \"86fae14f-6a9a-4129-bb37-b412c2faa480\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") "
Nov 04 05:45:22.234343 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.233760    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-tmp-dir\") pod \"86fae14f-6a9a-4129-bb37-b412c2faa480\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") "
Nov 04 05:45:22.234343 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.233924    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-model-cache\") pod \"86fae14f-6a9a-4129-bb37-b412c2faa480\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") "
Nov 04 05:45:22.234343 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.233950    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-dshm\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-dshm\") pod \"86fae14f-6a9a-4129-bb37-b412c2faa480\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") "
Nov 04 05:45:22.234343 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.234026    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86fae14f-6a9a-4129-bb37-b412c2faa480-kube-api-access-s8l8k\" (UniqueName: \"kubernetes.io/projected/86fae14f-6a9a-4129-bb37-b412c2faa480-kube-api-access-s8l8k\") pod \"86fae14f-6a9a-4129-bb37-b412c2faa480\" (UID: \"86fae14f-6a9a-4129-bb37-b412c2faa480\") "
Nov 04 05:45:22.235283 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.234961    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:22.235698 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.235667    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-tmp-dir" pod "86fae14f-6a9a-4129-bb37-b412c2faa480" (UID: "86fae14f-6a9a-4129-bb37-b412c2faa480"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:22.235857 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.235829    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-home" pod "86fae14f-6a9a-4129-bb37-b412c2faa480" (UID: "86fae14f-6a9a-4129-bb37-b412c2faa480"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:22.236025 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.236005    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-model-cache" pod "86fae14f-6a9a-4129-bb37-b412c2faa480" (UID: "86fae14f-6a9a-4129-bb37-b412c2faa480"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:22.238280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.238261    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-dshm" pod "86fae14f-6a9a-4129-bb37-b412c2faa480" (UID: "86fae14f-6a9a-4129-bb37-b412c2faa480"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:22.240435 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.240408    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86fae14f-6a9a-4129-bb37-b412c2faa480-kube-api-access-s8l8k" pod "86fae14f-6a9a-4129-bb37-b412c2faa480" (UID: "86fae14f-6a9a-4129-bb37-b412c2faa480"). InnerVolumeSpecName "kube-api-access-s8l8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:22.241763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.241737    5079 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-model-cache\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.241856 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.241766    5079 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-dshm\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.241856 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.241781    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8l8k\" (UniqueName: \"kubernetes.io/projected/86fae14f-6a9a-4129-bb37-b412c2faa480-kube-api-access-s8l8k\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.241856 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.241795    5079 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-home\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.241856 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.241811    5079 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86fae14f-6a9a-4129-bb37-b412c2faa480-tmp-dir\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.242045 ip-10-0-141-135 kubenswrapper[5079]: W1104 05:45:22.241867    5079 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d059a1_2b1f_47e1_be73_7d8223e2a64c.slice/crio-bd417dde99b76f9c431d02cbce352c0bcafc314d1b1df8bd906f3e414b1cc946 WatchSource:0}: Error finding container bd417dde99b76f9c431d02cbce352c0bcafc314d1b1df8bd906f3e414b1cc946: Status 404 returned error can't find the container with id bd417dde99b76f9c431d02cbce352c0bcafc314d1b1df8bd906f3e414b1cc946
Nov 04 05:45:22.242045 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.241961    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"]
Nov 04 05:45:22.244833 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.244801    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:22.244889 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.244879    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:22.244951 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.244937    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:22.246653 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.246628    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86fae14f-6a9a-4129-bb37-b412c2faa480-tls-certs" pod "86fae14f-6a9a-4129-bb37-b412c2faa480" (UID: "86fae14f-6a9a-4129-bb37-b412c2faa480"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:22.344696 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.344434    5079 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86fae14f-6a9a-4129-bb37-b412c2faa480-tls-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:22.523547 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.520215    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:22.570995 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.570963    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"]
Nov 04 05:45:22.577950 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.577913    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:22.578080 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.577983    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:22.578080 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.578022    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:22.792373 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.790275    5079 generic.go:356] "Generic (PLEG): container finished" podID="86fae14f-6a9a-4129-bb37-b412c2faa480" containerID="312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1" exitCode=0
Nov 04 05:45:22.792373 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.790347    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v" event={"ID":"86fae14f-6a9a-4129-bb37-b412c2faa480","Type":"ContainerDied","Data":"312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1"}
Nov 04 05:45:22.792373 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.790376    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v" event={"ID":"86fae14f-6a9a-4129-bb37-b412c2faa480","Type":"ContainerDied","Data":"1b8debc6cb0461510765ddb30bcdb494351117e0e8862a46b4a12f6137c2d55d"}
Nov 04 05:45:22.792373 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.790392    5079 scope.go:122] "RemoveContainer" containerID="312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1"
Nov 04 05:45:22.792373 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.790495    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"
Nov 04 05:45:22.803544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.803011    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" event={"ID":"e411b37f-4766-45c0-8c07-e2f5ee2e7780","Type":"ContainerStarted","Data":"26ca1d79e1add96e135bee59359469a6214cc04f5e4b3bfd6e8e966edcfa3832"}
Nov 04 05:45:22.803544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.803081    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" event={"ID":"e411b37f-4766-45c0-8c07-e2f5ee2e7780","Type":"ContainerStarted","Data":"8d08d440076e82014bbdfb6159744597903d52595dbd576bbc2aa5b7746e3ec2"}
Nov 04 05:45:22.810188 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.809043    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" event={"ID":"38d059a1-2b1f-47e1-be73-7d8223e2a64c","Type":"ContainerStarted","Data":"ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18"}
Nov 04 05:45:22.810188 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.809098    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" event={"ID":"38d059a1-2b1f-47e1-be73-7d8223e2a64c","Type":"ContainerStarted","Data":"bd417dde99b76f9c431d02cbce352c0bcafc314d1b1df8bd906f3e414b1cc946"}
Nov 04 05:45:22.821858 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.821835    5079 scope.go:122] "RemoveContainer" containerID="312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1"
Nov 04 05:45:22.822373 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:22.822339    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1\": container with ID starting with 312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1 not found: ID does not exist" containerID="312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1"
Nov 04 05:45:22.822490 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.822387    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1"} err="failed to get container status \"312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1\": rpc error: code = NotFound desc = could not find container \"312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1\": container with ID starting with 312801fe790c9094cbca93c84aabecfb58133bcc15a424ee66811355485642d1 not found: ID does not exist"
Nov 04 05:45:22.843487 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.843340    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podStartSLOduration=1.8431638339999998 podStartE2EDuration="1.843163834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:22.833648486 +0000 UTC m=+1017.691636311" watchObservedRunningTime="2026-11-04 05:45:22.843163834 +0000 UTC m=+1017.701151664"
Nov 04 05:45:22.862332 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.862295    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"]
Nov 04 05:45:22.870716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.869481    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-2b14d0/simulator-w6-2b14d0-kserve-6c57fd7d94-sbc5v"]
Nov 04 05:45:22.872386 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.872322    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:22.879737 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.879438    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podStartSLOduration=1.879419444 podStartE2EDuration="1.879419444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:22.876875946 +0000 UTC m=+1017.734863774" watchObservedRunningTime="2026-11-04 05:45:22.879419444 +0000 UTC m=+1017.737407275"
Nov 04 05:45:22.899175 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:22.899083    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:23.239357 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:23.239322    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:23.241143 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:23.241113    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 04 05:45:23.241293 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:23.241170    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 04 05:45:23.369325 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:23.369287    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86fae14f-6a9a-4129-bb37-b412c2faa480" path="/var/lib/kubelet/pods/86fae14f-6a9a-4129-bb37-b412c2faa480/volumes"
Nov 04 05:45:23.425934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:23.420248    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:23.526352 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:23.526255    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:23.796172 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:23.796086    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:24.082588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.076057    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 04 05:45:24.082588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.076149    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 04 05:45:24.253522 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.241026    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 04 05:45:24.253522 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.241091    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 04 05:45:24.378414 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.378316    5079 generic.go:356] "Generic (PLEG): container finished" podID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerID="285e696e0a8257d1255f090482f47f1cf5d26c6ac1b1a680b31b97c6aecc7a34" exitCode=0
Nov 04 05:45:24.399991 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.378733    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" event={"ID":"dad1f6bc-3194-46b3-bab1-6182c6534597","Type":"ContainerDied","Data":"285e696e0a8257d1255f090482f47f1cf5d26c6ac1b1a680b31b97c6aecc7a34"}
Nov 04 05:45:24.400337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.400318    5079 scope.go:122] "RemoveContainer" containerID="58d50c4f1deaf0619d509e02eb5e6ff3c0fa85a2c8cbd152922941b6e20cd353"
Nov 04 05:45:24.607922 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.607871    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk" podUID="524718b3-0092-4e88-a213-0e4d2263e6b6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.78:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:24.746531 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.731861    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:24.893369 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.893264    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:24.920529 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.901935    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 04 05:45:24.920529 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:24.902025    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 04 05:45:25.058552 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.054862    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:45:25.215279 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.215234    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-podinfo\") pod \"dad1f6bc-3194-46b3-bab1-6182c6534597\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") "
Nov 04 05:45:25.215904 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.215880    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dad1f6bc-3194-46b3-bab1-6182c6534597-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad1f6bc-3194-46b3-bab1-6182c6534597-istiod-ca-cert\") pod \"dad1f6bc-3194-46b3-bab1-6182c6534597\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") "
Nov 04 05:45:25.216040 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.216024    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-credential-socket\") pod \"dad1f6bc-3194-46b3-bab1-6182c6534597\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") "
Nov 04 05:45:25.216183 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.216168    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-token\" (UniqueName: \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-token\") pod \"dad1f6bc-3194-46b3-bab1-6182c6534597\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") "
Nov 04 05:45:25.216308 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.216293    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-certs\") pod \"dad1f6bc-3194-46b3-bab1-6182c6534597\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") "
Nov 04 05:45:25.216424 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.216411    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-data\") pod \"dad1f6bc-3194-46b3-bab1-6182c6534597\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") "
Nov 04 05:45:25.216542 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.216527    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-socket\") pod \"dad1f6bc-3194-46b3-bab1-6182c6534597\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") "
Nov 04 05:45:25.216854 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.216837    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-envoy\") pod \"dad1f6bc-3194-46b3-bab1-6182c6534597\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") "
Nov 04 05:45:25.217055 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.217041    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-kube-api-access-vxxdm\" (UniqueName: \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-kube-api-access-vxxdm\") pod \"dad1f6bc-3194-46b3-bab1-6182c6534597\" (UID: \"dad1f6bc-3194-46b3-bab1-6182c6534597\") "
Nov 04 05:45:25.264434 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.264060    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad1f6bc-3194-46b3-bab1-6182c6534597-istiod-ca-cert" pod "dad1f6bc-3194-46b3-bab1-6182c6534597" (UID: "dad1f6bc-3194-46b3-bab1-6182c6534597"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:25.272658 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.266892    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-socket" pod "dad1f6bc-3194-46b3-bab1-6182c6534597" (UID: "dad1f6bc-3194-46b3-bab1-6182c6534597"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:25.279559 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.279129    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-credential-socket" pod "dad1f6bc-3194-46b3-bab1-6182c6534597" (UID: "dad1f6bc-3194-46b3-bab1-6182c6534597"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:25.279559 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.279405    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-certs" pod "dad1f6bc-3194-46b3-bab1-6182c6534597" (UID: "dad1f6bc-3194-46b3-bab1-6182c6534597"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:25.284692 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.279874    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-data" pod "dad1f6bc-3194-46b3-bab1-6182c6534597" (UID: "dad1f6bc-3194-46b3-bab1-6182c6534597"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:25.309560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.280641    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 04 05:45:25.309851 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.309820    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 04 05:45:25.310343 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.308642    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws" podUID="246d0446-d674-4eb4-b6a0-a30dc42f3154" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:25.336728 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.282051    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-envoy" pod "dad1f6bc-3194-46b3-bab1-6182c6534597" (UID: "dad1f6bc-3194-46b3-bab1-6182c6534597"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:25.336955 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.314883    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr" podUID="5b48ad58-03f8-4046-b0bf-c4bd18508b93" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Nov 04 05:45:25.343044 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.336339    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad1f6bc-3194-46b3-bab1-6182c6534597-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:25.364676 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.364637    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:25.364917 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.364901    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:25.365028 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.365016    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:25.365115 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.365104    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:25.477527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.471313    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-podinfo" pod "dad1f6bc-3194-46b3-bab1-6182c6534597" (UID: "dad1f6bc-3194-46b3-bab1-6182c6534597"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:45:25.477527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.471489    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-kube-api-access-vxxdm" pod "dad1f6bc-3194-46b3-bab1-6182c6534597" (UID: "dad1f6bc-3194-46b3-bab1-6182c6534597"). InnerVolumeSpecName "kube-api-access-vxxdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:25.477527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.471607    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-token" pod "dad1f6bc-3194-46b3-bab1-6182c6534597" (UID: "dad1f6bc-3194-46b3-bab1-6182c6534597"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:25.477527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.472395    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:25.477527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.473442    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxxdm\" (UniqueName: \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-kube-api-access-vxxdm\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:25.477527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.473473    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:25.477527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.473494    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:25.477527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.473526    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad1f6bc-3194-46b3-bab1-6182c6534597-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:25.578441 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.578323    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:25.597301 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.597270    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"
Nov 04 05:45:25.625954 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.614557    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5" event={"ID":"dad1f6bc-3194-46b3-bab1-6182c6534597","Type":"ContainerDied","Data":"2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04"}
Nov 04 05:45:25.626300 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.626279    5079 scope.go:122] "RemoveContainer" containerID="285e696e0a8257d1255f090482f47f1cf5d26c6ac1b1a680b31b97c6aecc7a34"
Nov 04 05:45:25.626627 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.615551    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7" podUID="de75450b-a274-47d0-ba6a-94b47d9f5f01" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:25.628667 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.628640    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk" podUID="524718b3-0092-4e88-a213-0e4d2263e6b6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.78:8000/ready\": context deadline exceeded"
Nov 04 05:45:25.629163 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.629144    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:45:25.871681 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.871635    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:25.971529 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.946475    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 04 05:45:25.972894 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:25.972855    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 04 05:45:26.055569 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.053329    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"]
Nov 04 05:45:26.103579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.078460    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-f9b4a9-openshift-default-664576c68f-ssfb5"]
Nov 04 05:45:26.251066 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.251033    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 04 05:45:26.251742 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.251631    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 04 05:45:26.344575 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.341068    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr" podUID="5b48ad58-03f8-4046-b0bf-c4bd18508b93" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:26.344575 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.342352    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws" podUID="246d0446-d674-4eb4-b6a0-a30dc42f3154" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:26.344575 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.342746    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:45:26.344575 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.342805    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:45:26.500560 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.500494    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh" podUID="12343966-5a09-45e2-800a-b885d9417e6e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:26.622433 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.622401    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:26.649631 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.629901    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk" podUID="524718b3-0092-4e88-a213-0e4d2263e6b6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.78:8000/ready\": context deadline exceeded"
Nov 04 05:45:26.649631 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.630666    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7" podUID="de75450b-a274-47d0-ba6a-94b47d9f5f01" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Nov 04 05:45:26.649631 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.630980    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:45:26.951562 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.923135    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 04 05:45:26.951562 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:26.923200    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 04 05:45:27.037305 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.036748    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:45:27.037305 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.036811    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:27.176619 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.174476    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:27.755609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.207465    5079 generic.go:356] "Generic (PLEG): container finished" podID="f07418fd-c953-42ed-a436-2e02cdfb7a05" containerID="ab60e625284833e10ada56437d6001a114ea0368947ea8f5828ad1ec96aa12d2" exitCode=0
Nov 04 05:45:27.755609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.207517    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" event={"ID":"f07418fd-c953-42ed-a436-2e02cdfb7a05","Type":"ContainerDied","Data":"ab60e625284833e10ada56437d6001a114ea0368947ea8f5828ad1ec96aa12d2"}
Nov 04 05:45:27.755609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.748727    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"]
Nov 04 05:45:27.755609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.750105    5079 cpu_manager.go:414] "containerMap: removing container" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy"
Nov 04 05:45:27.755609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.750131    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy"
Nov 04 05:45:27.755609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.750158    5079 cpu_manager.go:414] "containerMap: removing container" podUID="86fae14f-6a9a-4129-bb37-b412c2faa480" containerName="main"
Nov 04 05:45:27.755609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.750168    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86fae14f-6a9a-4129-bb37-b412c2faa480" containerName="main"
Nov 04 05:45:27.755609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.750548    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy"
Nov 04 05:45:27.755609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.750569    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="86fae14f-6a9a-4129-bb37-b412c2faa480" containerName="main"
Nov 04 05:45:27.766663 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.254103    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 04 05:45:27.766663 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.766589    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 04 05:45:27.783577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.344192    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws" podUID="246d0446-d674-4eb4-b6a0-a30dc42f3154" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Nov 04 05:45:27.784227 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.344480    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr" podUID="5b48ad58-03f8-4046-b0bf-c4bd18508b93" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Nov 04 05:45:27.785167 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.592279    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh" podUID="12343966-5a09-45e2-800a-b885d9417e6e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:27.804613 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.682363    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7" podUID="de75450b-a274-47d0-ba6a-94b47d9f5f01" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:27.808914 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.682438    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk" podUID="524718b3-0092-4e88-a213-0e4d2263e6b6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.78:8000/ready\": context deadline exceeded"
Nov 04 05:45:27.882725 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.853107    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:45:27.926540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.926479    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:27.927284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.927266    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:27.973533 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.947045    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 05:45:27.988334 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.960175    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nsl8n\""
Nov 04 05:45:27.988583 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.961085    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 05:45:27.988701 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.962177    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 04 05:45:27.988873 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.988844    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 04 05:45:27.989001 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.971237    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e76d4112-zgmv6\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:27.989384 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.989360    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmnj2\" (UniqueName: \"kubernetes.io/projected/a9c373d8-8502-4663-8fe2-998e13b32f64-kube-api-access-jmnj2\") pod \"maas-api-revoke-sub-e76d4112-zgmv6\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:27.989593 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:27.989576    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e76d4112-zgmv6\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:28.052189 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.052157    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 05:45:28.187029 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.186993    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:28.294792 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.293328    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e76d4112-zgmv6\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:28.294792 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.293592    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmnj2\" (UniqueName: \"kubernetes.io/projected/a9c373d8-8502-4663-8fe2-998e13b32f64-kube-api-access-jmnj2\") pod \"maas-api-revoke-sub-e76d4112-zgmv6\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:28.294792 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.293670    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e76d4112-zgmv6\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:28.418188 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.417969    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:28.592884 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.456345    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 04 05:45:28.592884 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.589779    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 04 05:45:28.624020 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.611803    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e76d4112-zgmv6\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:28.812395 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.812332    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh" podUID="12343966-5a09-45e2-800a-b885d9417e6e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Nov 04 05:45:28.818646 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.818587    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7" podUID="de75450b-a274-47d0-ba6a-94b47d9f5f01" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Nov 04 05:45:28.971451 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.887778    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:29.009741 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.962430    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 04 05:45:29.010061 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.010025    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 04 05:45:29.010190 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.967140    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e76d4112-zgmv6\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:29.010302 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:28.966221    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws" podUID="246d0446-d674-4eb4-b6a0-a30dc42f3154" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:29.042732 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.033426    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" path="/var/lib/kubelet/pods/dad1f6bc-3194-46b3-bab1-6182c6534597/volumes"
Nov 04 05:45:29.042732 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:29.033914    5079 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.181s"
Nov 04 05:45:29.042732 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.034001    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"]
Nov 04 05:45:29.042732 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.034081    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:45:29.042732 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.034107    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"]
Nov 04 05:45:29.042732 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.034158    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:45:29.052701 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.052641    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmnj2\" (UniqueName: \"kubernetes.io/projected/a9c373d8-8502-4663-8fe2-998e13b32f64-kube-api-access-jmnj2\") pod \"maas-api-revoke-sub-e76d4112-zgmv6\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:29.058861 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.058217    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"]
Nov 04 05:45:29.059540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.059314    5079 cpu_manager.go:414] "containerMap: removing container" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy"
Nov 04 05:45:29.059540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.059339    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy"
Nov 04 05:45:29.103016 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.102986    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="dad1f6bc-3194-46b3-bab1-6182c6534597" containerName="istio-proxy"
Nov 04 05:45:29.157907 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.154386    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:29.241961 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.237309    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"]
Nov 04 05:45:29.241961 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.237362    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"]
Nov 04 05:45:29.361540 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.347851    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:29.376528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.367189    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6aeadf02-q2dnz\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:29.376900 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.376865    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq57t\" (UniqueName: \"kubernetes.io/projected/a626a041-2890-4f6c-b703-16c0eb761f04-kube-api-access-rq57t\") pod \"maas-api-revoke-sub-6aeadf02-q2dnz\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:29.383536 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.377173    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6aeadf02-q2dnz\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:29.396337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.382221    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:29.409367 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:29.409321    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache]"
Nov 04 05:45:29.455081 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.455047    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 04 05:45:29.455970 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.455363    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 04 05:45:29.465921 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.465896    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:45:29.477130 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.469356    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:45:29.477130 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.469414    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:45:29.477130 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.467700    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.523398    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.526041    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-credential-socket\") pod \"f07418fd-c953-42ed-a436-2e02cdfb7a05\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") "
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.526112    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-data\") pod \"f07418fd-c953-42ed-a436-2e02cdfb7a05\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") "
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.526151    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f07418fd-c953-42ed-a436-2e02cdfb7a05-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f07418fd-c953-42ed-a436-2e02cdfb7a05-istiod-ca-cert\") pod \"f07418fd-c953-42ed-a436-2e02cdfb7a05\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") "
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.526198    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-envoy\") pod \"f07418fd-c953-42ed-a436-2e02cdfb7a05\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") "
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.526224    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-token\" (UniqueName: \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-token\") pod \"f07418fd-c953-42ed-a436-2e02cdfb7a05\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") "
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.526347    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-certs\") pod \"f07418fd-c953-42ed-a436-2e02cdfb7a05\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") "
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.526417    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-kube-api-access-j5pvx\" (UniqueName: \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-kube-api-access-j5pvx\") pod \"f07418fd-c953-42ed-a436-2e02cdfb7a05\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") "
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.526756    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6aeadf02-q2dnz\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.526817    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq57t\" (UniqueName: \"kubernetes.io/projected/a626a041-2890-4f6c-b703-16c0eb761f04-kube-api-access-rq57t\") pod \"maas-api-revoke-sub-6aeadf02-q2dnz\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.526934    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6aeadf02-q2dnz\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.530088    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6aeadf02-q2dnz\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.530285    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-credential-socket" pod "f07418fd-c953-42ed-a436-2e02cdfb7a05" (UID: "f07418fd-c953-42ed-a436-2e02cdfb7a05"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.530441    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-data" pod "f07418fd-c953-42ed-a436-2e02cdfb7a05" (UID: "f07418fd-c953-42ed-a436-2e02cdfb7a05"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.530707    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f07418fd-c953-42ed-a436-2e02cdfb7a05-istiod-ca-cert" pod "f07418fd-c953-42ed-a436-2e02cdfb7a05" (UID: "f07418fd-c953-42ed-a436-2e02cdfb7a05"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.540196    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-envoy" pod "f07418fd-c953-42ed-a436-2e02cdfb7a05" (UID: "f07418fd-c953-42ed-a436-2e02cdfb7a05"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.540858    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-kube-api-access-j5pvx" pod "f07418fd-c953-42ed-a436-2e02cdfb7a05" (UID: "f07418fd-c953-42ed-a436-2e02cdfb7a05"). InnerVolumeSpecName "kube-api-access-j5pvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:29.542610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.540991    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6aeadf02-q2dnz\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:29.551548 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.547532    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-certs" pod "f07418fd-c953-42ed-a436-2e02cdfb7a05" (UID: "f07418fd-c953-42ed-a436-2e02cdfb7a05"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:29.561757 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.561674    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:29.564712 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.564676    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-token" pod "f07418fd-c953-42ed-a436-2e02cdfb7a05" (UID: "f07418fd-c953-42ed-a436-2e02cdfb7a05"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:29.581567 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.566839    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq57t\" (UniqueName: \"kubernetes.io/projected/a626a041-2890-4f6c-b703-16c0eb761f04-kube-api-access-rq57t\") pod \"maas-api-revoke-sub-6aeadf02-q2dnz\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:29.631213 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.629997    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-podinfo\") pod \"f07418fd-c953-42ed-a436-2e02cdfb7a05\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") "
Nov 04 05:45:29.631213 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.630070    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-socket\") pod \"f07418fd-c953-42ed-a436-2e02cdfb7a05\" (UID: \"f07418fd-c953-42ed-a436-2e02cdfb7a05\") "
Nov 04 05:45:29.631213 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.630738    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:29.631213 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.630765    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f07418fd-c953-42ed-a436-2e02cdfb7a05-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:29.631213 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.630780    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:29.631213 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.630794    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:29.631213 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.630811    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:29.631213 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.630826    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5pvx\" (UniqueName: \"kubernetes.io/projected/f07418fd-c953-42ed-a436-2e02cdfb7a05-kube-api-access-j5pvx\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:29.631213 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.630842    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:29.650881 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.649656    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-socket" pod "f07418fd-c953-42ed-a436-2e02cdfb7a05" (UID: "f07418fd-c953-42ed-a436-2e02cdfb7a05"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:29.710554 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.700765    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:29.738476 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.737748    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f07418fd-c953-42ed-a436-2e02cdfb7a05-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:29.847581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.843642    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:29.909545 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.901024    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 04 05:45:29.909545 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:29.901089    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 04 05:45:29.959854 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:29.959800    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache]"
Nov 04 05:45:30.062283 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.062249    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-podinfo" pod "f07418fd-c953-42ed-a436-2e02cdfb7a05" (UID: "f07418fd-c953-42ed-a436-2e02cdfb7a05"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:45:30.092541 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.075739    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f07418fd-c953-42ed-a436-2e02cdfb7a05-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:30.150833 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:30.150793    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache]"
Nov 04 05:45:30.236527 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:30.143476    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache]"
Nov 04 05:45:30.260700 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.256094    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:30.260700 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.258932    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 04 05:45:30.260700 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.259109    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 04 05:45:30.309794 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.309740    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws" podUID="246d0446-d674-4eb4-b6a0-a30dc42f3154" containerName="main" containerID="cri-o://7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553" gracePeriod=45
Nov 04 05:45:30.353189 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.347640    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd" event={"ID":"f07418fd-c953-42ed-a436-2e02cdfb7a05","Type":"ContainerDied","Data":"d8334952ac69e8e3c11a1c5744cc3832ce994c7af0edb877c2c8b8b327483d49"}
Nov 04 05:45:30.353189 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.347732    5079 scope.go:122] "RemoveContainer" containerID="ab60e625284833e10ada56437d6001a114ea0368947ea8f5828ad1ec96aa12d2"
Nov 04 05:45:30.353189 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.347999    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"
Nov 04 05:45:30.367600 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.367084    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws" podUID="246d0446-d674-4eb4-b6a0-a30dc42f3154" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": EOF"
Nov 04 05:45:30.523231 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.523190    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"]
Nov 04 05:45:30.526791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.526596    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr" podUID="5b48ad58-03f8-4046-b0bf-c4bd18508b93" containerName="main" containerID="cri-o://1fcdae0eaa2da2688e1d40f01c9509f48aa2c376a916f76e0c54125978e26c83" gracePeriod=45
Nov 04 05:45:30.528064 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.527935    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk" podUID="524718b3-0092-4e88-a213-0e4d2263e6b6" containerName="main" containerID="cri-o://4b4456f04fbaf57946bc17582d982dc516e2b56c1ac7ff15dfc45ad9012974ee" gracePeriod=45
Nov 04 05:45:30.537034 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.536995    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9a0c8b-openshift-default-66f94db8c5-69ftd"]
Nov 04 05:45:30.643806 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.592047    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk" podUID="524718b3-0092-4e88-a213-0e4d2263e6b6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.78:8000/ready\": dial tcp 10.132.0.78:8000: connect: connection refused"
Nov 04 05:45:30.643806 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.592737    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"]
Nov 04 05:45:30.776734 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.775003    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"]
Nov 04 05:45:30.940204 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.937733    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 04 05:45:30.940204 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:30.937808    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 04 05:45:31.240034 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.239918    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 04 05:45:31.240034 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.239978    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 04 05:45:31.255676 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.255637    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:45:31.338528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.320912    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-dshm\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-dshm\") pod \"246d0446-d674-4eb4-b6a0-a30dc42f3154\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") "
Nov 04 05:45:31.338528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.321003    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-home\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-home\") pod \"246d0446-d674-4eb4-b6a0-a30dc42f3154\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") "
Nov 04 05:45:31.338528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.321082    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-tmp-dir\") pod \"246d0446-d674-4eb4-b6a0-a30dc42f3154\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") "
Nov 04 05:45:31.338528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.321152    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-model-cache\") pod \"246d0446-d674-4eb4-b6a0-a30dc42f3154\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") "
Nov 04 05:45:31.338528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.321257    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/246d0446-d674-4eb4-b6a0-a30dc42f3154-kube-api-access-4wwm6\" (UniqueName: \"kubernetes.io/projected/246d0446-d674-4eb4-b6a0-a30dc42f3154-kube-api-access-4wwm6\") pod \"246d0446-d674-4eb4-b6a0-a30dc42f3154\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") "
Nov 04 05:45:31.338528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.321325    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/246d0446-d674-4eb4-b6a0-a30dc42f3154-tls-certs\" (UniqueName: \"kubernetes.io/secret/246d0446-d674-4eb4-b6a0-a30dc42f3154-tls-certs\") pod \"246d0446-d674-4eb4-b6a0-a30dc42f3154\" (UID: \"246d0446-d674-4eb4-b6a0-a30dc42f3154\") "
Nov 04 05:45:31.343921 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.343872    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-tmp-dir" pod "246d0446-d674-4eb4-b6a0-a30dc42f3154" (UID: "246d0446-d674-4eb4-b6a0-a30dc42f3154"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.346941 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.346599    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-model-cache" pod "246d0446-d674-4eb4-b6a0-a30dc42f3154" (UID: "246d0446-d674-4eb4-b6a0-a30dc42f3154"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.346941 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.346839    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-home" pod "246d0446-d674-4eb4-b6a0-a30dc42f3154" (UID: "246d0446-d674-4eb4-b6a0-a30dc42f3154"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.351586 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.350301    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/246d0446-d674-4eb4-b6a0-a30dc42f3154-tls-certs" pod "246d0446-d674-4eb4-b6a0-a30dc42f3154" (UID: "246d0446-d674-4eb4-b6a0-a30dc42f3154"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:31.351586 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.350417    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/246d0446-d674-4eb4-b6a0-a30dc42f3154-kube-api-access-4wwm6" pod "246d0446-d674-4eb4-b6a0-a30dc42f3154" (UID: "246d0446-d674-4eb4-b6a0-a30dc42f3154"). InnerVolumeSpecName "kube-api-access-4wwm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:31.351756 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.351711    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f07418fd-c953-42ed-a436-2e02cdfb7a05" path="/var/lib/kubelet/pods/f07418fd-c953-42ed-a436-2e02cdfb7a05/volumes"
Nov 04 05:45:31.352755 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.352681    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-dshm" pod "246d0446-d674-4eb4-b6a0-a30dc42f3154" (UID: "246d0446-d674-4eb4-b6a0-a30dc42f3154"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.439715 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.438992    5079 generic.go:356] "Generic (PLEG): container finished" podID="524718b3-0092-4e88-a213-0e4d2263e6b6" containerID="4b4456f04fbaf57946bc17582d982dc516e2b56c1ac7ff15dfc45ad9012974ee" exitCode=0
Nov 04 05:45:31.439715 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.439134    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk" event={"ID":"524718b3-0092-4e88-a213-0e4d2263e6b6","Type":"ContainerDied","Data":"4b4456f04fbaf57946bc17582d982dc516e2b56c1ac7ff15dfc45ad9012974ee"}
Nov 04 05:45:31.442432 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.441696    5079 generic.go:356] "Generic (PLEG): container finished" podID="5b48ad58-03f8-4046-b0bf-c4bd18508b93" containerID="1fcdae0eaa2da2688e1d40f01c9509f48aa2c376a916f76e0c54125978e26c83" exitCode=0
Nov 04 05:45:31.442432 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.441837    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr" event={"ID":"5b48ad58-03f8-4046-b0bf-c4bd18508b93","Type":"ContainerDied","Data":"1fcdae0eaa2da2688e1d40f01c9509f48aa2c376a916f76e0c54125978e26c83"}
Nov 04 05:45:31.442432 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.441887    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr" event={"ID":"5b48ad58-03f8-4046-b0bf-c4bd18508b93","Type":"ContainerDied","Data":"d1548b44a341d516ea505eac968bf29e4e528ff41d30772bf046a44511dfe7d9"}
Nov 04 05:45:31.442432 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.441908    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1548b44a341d516ea505eac968bf29e4e528ff41d30772bf046a44511dfe7d9"
Nov 04 05:45:31.444516 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.444468    5079 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-dshm\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.444785 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.444683    5079 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-home\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.444785 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.444706    5079 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-tmp-dir\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.444785 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.444727    5079 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/246d0446-d674-4eb4-b6a0-a30dc42f3154-model-cache\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.444785 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.444742    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wwm6\" (UniqueName: \"kubernetes.io/projected/246d0446-d674-4eb4-b6a0-a30dc42f3154-kube-api-access-4wwm6\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.444785 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.444757    5079 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246d0446-d674-4eb4-b6a0-a30dc42f3154-tls-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.450525 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.449783    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:45:31.460202 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.460174    5079 generic.go:356] "Generic (PLEG): container finished" podID="246d0446-d674-4eb4-b6a0-a30dc42f3154" containerID="7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553" exitCode=0
Nov 04 05:45:31.460584 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.460558    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws" event={"ID":"246d0446-d674-4eb4-b6a0-a30dc42f3154","Type":"ContainerDied","Data":"7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553"}
Nov 04 05:45:31.460760 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.460743    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws" event={"ID":"246d0446-d674-4eb4-b6a0-a30dc42f3154","Type":"ContainerDied","Data":"26c770af5f0fe64662727499d27b2a9ee203aab5c6f7231687301b9e60158546"}
Nov 04 05:45:31.460869 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.460852    5079 scope.go:122] "RemoveContainer" containerID="7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553"
Nov 04 05:45:31.460990 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.460977    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"
Nov 04 05:45:31.461959 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.461939    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:45:31.469366 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.469291    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6" event={"ID":"a9c373d8-8502-4663-8fe2-998e13b32f64","Type":"ContainerStarted","Data":"9c1e6eef977d3ad6df484bb13fefdf342ad21ac1ee207fb5264be7b1c58d402b"}
Nov 04 05:45:31.522724 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.521993    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz" event={"ID":"a626a041-2890-4f6c-b703-16c0eb761f04","Type":"ContainerStarted","Data":"9d365c0f61c325f90974ed78381f6e7efe56193a76ffb092a990c5fdb8e77a86"}
Nov 04 05:45:31.536149 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.536124    5079 scope.go:122] "RemoveContainer" containerID="7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553"
Nov 04 05:45:31.536766 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:31.536742    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553\": container with ID starting with 7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553 not found: ID does not exist" containerID="7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553"
Nov 04 05:45:31.537267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.537233    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553"} err="failed to get container status \"7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553\": rpc error: code = NotFound desc = could not find container \"7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553\": container with ID starting with 7abafd6575094889baa375bc53d72787965a0de97f8eb5e022d1cf5212f37553 not found: ID does not exist"
Nov 04 05:45:31.545492 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.545455    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-home\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-home\") pod \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") "
Nov 04 05:45:31.545672 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.545535    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-dshm\") pod \"524718b3-0092-4e88-a213-0e4d2263e6b6\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") "
Nov 04 05:45:31.545672 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.545571    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b48ad58-03f8-4046-b0bf-c4bd18508b93-kube-api-access-9fd94\" (UniqueName: \"kubernetes.io/projected/5b48ad58-03f8-4046-b0bf-c4bd18508b93-kube-api-access-9fd94\") pod \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") "
Nov 04 05:45:31.545784 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.545680    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-model-cache\") pod \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") "
Nov 04 05:45:31.545784 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.545729    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-model-cache\") pod \"524718b3-0092-4e88-a213-0e4d2263e6b6\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") "
Nov 04 05:45:31.545892 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.545839    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-tmp-dir\") pod \"524718b3-0092-4e88-a213-0e4d2263e6b6\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") "
Nov 04 05:45:31.545892 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.545867    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/524718b3-0092-4e88-a213-0e4d2263e6b6-tls-certs\" (UniqueName: \"kubernetes.io/secret/524718b3-0092-4e88-a213-0e4d2263e6b6-tls-certs\") pod \"524718b3-0092-4e88-a213-0e4d2263e6b6\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") "
Nov 04 05:45:31.545994 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.545893    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-dshm\") pod \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") "
Nov 04 05:45:31.545994 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.545930    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-home\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-home\") pod \"524718b3-0092-4e88-a213-0e4d2263e6b6\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") "
Nov 04 05:45:31.545994 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.545987    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/524718b3-0092-4e88-a213-0e4d2263e6b6-kube-api-access-jsjdl\" (UniqueName: \"kubernetes.io/projected/524718b3-0092-4e88-a213-0e4d2263e6b6-kube-api-access-jsjdl\") pod \"524718b3-0092-4e88-a213-0e4d2263e6b6\" (UID: \"524718b3-0092-4e88-a213-0e4d2263e6b6\") "
Nov 04 05:45:31.546148 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.546027    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tls-certs\") pod \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") "
Nov 04 05:45:31.546148 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.546101    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tmp-dir\") pod \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\" (UID: \"5b48ad58-03f8-4046-b0bf-c4bd18508b93\") "
Nov 04 05:45:31.547191 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.547166    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-model-cache" pod "524718b3-0092-4e88-a213-0e4d2263e6b6" (UID: "524718b3-0092-4e88-a213-0e4d2263e6b6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.547681 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.547658    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-home" pod "5b48ad58-03f8-4046-b0bf-c4bd18508b93" (UID: "5b48ad58-03f8-4046-b0bf-c4bd18508b93"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.552592 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.549844    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-tmp-dir" pod "524718b3-0092-4e88-a213-0e4d2263e6b6" (UID: "524718b3-0092-4e88-a213-0e4d2263e6b6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.552845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.552820    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-model-cache" pod "5b48ad58-03f8-4046-b0bf-c4bd18508b93" (UID: "5b48ad58-03f8-4046-b0bf-c4bd18508b93"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.554131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.554107    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-home" pod "524718b3-0092-4e88-a213-0e4d2263e6b6" (UID: "524718b3-0092-4e88-a213-0e4d2263e6b6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.554271 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.554253    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"]
Nov 04 05:45:31.554690 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.554670    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tmp-dir" pod "5b48ad58-03f8-4046-b0bf-c4bd18508b93" (UID: "5b48ad58-03f8-4046-b0bf-c4bd18508b93"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.556888 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.556869    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-27935d/simulator-w0-27935d-kserve-b4d66ccbf-ffpws"]
Nov 04 05:45:31.559146 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.559111    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/524718b3-0092-4e88-a213-0e4d2263e6b6-tls-certs" pod "524718b3-0092-4e88-a213-0e4d2263e6b6" (UID: "524718b3-0092-4e88-a213-0e4d2263e6b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:31.562556 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.561490    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tls-certs" pod "5b48ad58-03f8-4046-b0bf-c4bd18508b93" (UID: "5b48ad58-03f8-4046-b0bf-c4bd18508b93"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:31.562556 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.561573    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/524718b3-0092-4e88-a213-0e4d2263e6b6-kube-api-access-jsjdl" pod "524718b3-0092-4e88-a213-0e4d2263e6b6" (UID: "524718b3-0092-4e88-a213-0e4d2263e6b6"). InnerVolumeSpecName "kube-api-access-jsjdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:31.563138 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.562825    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-dshm" pod "5b48ad58-03f8-4046-b0bf-c4bd18508b93" (UID: "5b48ad58-03f8-4046-b0bf-c4bd18508b93"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.575305 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.575262    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-dshm" pod "524718b3-0092-4e88-a213-0e4d2263e6b6" (UID: "524718b3-0092-4e88-a213-0e4d2263e6b6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:31.577851 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.577807    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b48ad58-03f8-4046-b0bf-c4bd18508b93-kube-api-access-9fd94" pod "5b48ad58-03f8-4046-b0bf-c4bd18508b93" (UID: "5b48ad58-03f8-4046-b0bf-c4bd18508b93"). InnerVolumeSpecName "kube-api-access-9fd94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:31.648260 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648219    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fd94\" (UniqueName: \"kubernetes.io/projected/5b48ad58-03f8-4046-b0bf-c4bd18508b93-kube-api-access-9fd94\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.648260 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648252    5079 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-model-cache\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.648656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648266    5079 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-model-cache\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.648656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648281    5079 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-tmp-dir\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.648656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648293    5079 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/524718b3-0092-4e88-a213-0e4d2263e6b6-tls-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.648656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648303    5079 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-dshm\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.648656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648316    5079 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-home\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.648656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648329    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsjdl\" (UniqueName: \"kubernetes.io/projected/524718b3-0092-4e88-a213-0e4d2263e6b6-kube-api-access-jsjdl\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.648656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648341    5079 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tls-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.648656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648353    5079 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-tmp-dir\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.648656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648366    5079 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b48ad58-03f8-4046-b0bf-c4bd18508b93-home\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.648656 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.648377    5079 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/524718b3-0092-4e88-a213-0e4d2263e6b6-dshm\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:31.861569 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.858787    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7" podUID="de75450b-a274-47d0-ba6a-94b47d9f5f01" containerName="main" containerID="cri-o://79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0" gracePeriod=45
Nov 04 05:45:31.866657 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.866615    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh" podUID="12343966-5a09-45e2-800a-b885d9417e6e" containerName="main" containerID="cri-o://fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e" gracePeriod=45
Nov 04 05:45:31.898853 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.898810    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Nov 04 05:45:31.899036 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:31.898883    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Nov 04 05:45:32.233787 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.233179    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr" podUID="5b48ad58-03f8-4046-b0bf-c4bd18508b93" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:32.238966 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.238866    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Nov 04 05:45:32.238966 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.238927    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Nov 04 05:45:32.270173 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.269355    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:45:32.296673 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.296199    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:45:32.361098 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.359967    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-home\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-home\") pod \"de75450b-a274-47d0-ba6a-94b47d9f5f01\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") "
Nov 04 05:45:32.361098 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.360089    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de75450b-a274-47d0-ba6a-94b47d9f5f01-kube-api-access-n8pgv\" (UniqueName: \"kubernetes.io/projected/de75450b-a274-47d0-ba6a-94b47d9f5f01-kube-api-access-n8pgv\") pod \"de75450b-a274-47d0-ba6a-94b47d9f5f01\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") "
Nov 04 05:45:32.361098 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.360155    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-model-cache\") pod \"de75450b-a274-47d0-ba6a-94b47d9f5f01\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") "
Nov 04 05:45:32.361098 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.360205    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de75450b-a274-47d0-ba6a-94b47d9f5f01-tls-certs\" (UniqueName: \"kubernetes.io/secret/de75450b-a274-47d0-ba6a-94b47d9f5f01-tls-certs\") pod \"de75450b-a274-47d0-ba6a-94b47d9f5f01\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") "
Nov 04 05:45:32.361098 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.360329    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-dshm\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-dshm\") pod \"de75450b-a274-47d0-ba6a-94b47d9f5f01\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") "
Nov 04 05:45:32.361098 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.360376    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-tmp-dir\") pod \"de75450b-a274-47d0-ba6a-94b47d9f5f01\" (UID: \"de75450b-a274-47d0-ba6a-94b47d9f5f01\") "
Nov 04 05:45:32.362186 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.361651    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-tmp-dir" pod "de75450b-a274-47d0-ba6a-94b47d9f5f01" (UID: "de75450b-a274-47d0-ba6a-94b47d9f5f01"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.362186 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.361865    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-home" pod "de75450b-a274-47d0-ba6a-94b47d9f5f01" (UID: "de75450b-a274-47d0-ba6a-94b47d9f5f01"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.363329 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.363308    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-model-cache" pod "de75450b-a274-47d0-ba6a-94b47d9f5f01" (UID: "de75450b-a274-47d0-ba6a-94b47d9f5f01"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.366594 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.366559    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de75450b-a274-47d0-ba6a-94b47d9f5f01-tls-certs" pod "de75450b-a274-47d0-ba6a-94b47d9f5f01" (UID: "de75450b-a274-47d0-ba6a-94b47d9f5f01"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:32.399639 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.399582    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de75450b-a274-47d0-ba6a-94b47d9f5f01-kube-api-access-n8pgv" pod "de75450b-a274-47d0-ba6a-94b47d9f5f01" (UID: "de75450b-a274-47d0-ba6a-94b47d9f5f01"). InnerVolumeSpecName "kube-api-access-n8pgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:32.402694 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.402634    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-dshm" pod "de75450b-a274-47d0-ba6a-94b47d9f5f01" (UID: "de75450b-a274-47d0-ba6a-94b47d9f5f01"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462195    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-tmp-dir\") pod \"12343966-5a09-45e2-800a-b885d9417e6e\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") "
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462315    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-home\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-home\") pod \"12343966-5a09-45e2-800a-b885d9417e6e\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") "
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462377    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-model-cache\") pod \"12343966-5a09-45e2-800a-b885d9417e6e\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") "
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462408    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12343966-5a09-45e2-800a-b885d9417e6e-kube-api-access-nkkph\" (UniqueName: \"kubernetes.io/projected/12343966-5a09-45e2-800a-b885d9417e6e-kube-api-access-nkkph\") pod \"12343966-5a09-45e2-800a-b885d9417e6e\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") "
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462470    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/12343966-5a09-45e2-800a-b885d9417e6e-tls-certs\" (UniqueName: \"kubernetes.io/secret/12343966-5a09-45e2-800a-b885d9417e6e-tls-certs\") pod \"12343966-5a09-45e2-800a-b885d9417e6e\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") "
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462485    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-dshm\") pod \"12343966-5a09-45e2-800a-b885d9417e6e\" (UID: \"12343966-5a09-45e2-800a-b885d9417e6e\") "
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462878    5079 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-dshm\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462891    5079 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-tmp-dir\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462901    5079 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-home\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462911    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8pgv\" (UniqueName: \"kubernetes.io/projected/de75450b-a274-47d0-ba6a-94b47d9f5f01-kube-api-access-n8pgv\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462920    5079 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de75450b-a274-47d0-ba6a-94b47d9f5f01-model-cache\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.463752 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.462929    5079 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de75450b-a274-47d0-ba6a-94b47d9f5f01-tls-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.464727 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.464008    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-model-cache" pod "12343966-5a09-45e2-800a-b885d9417e6e" (UID: "12343966-5a09-45e2-800a-b885d9417e6e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.464727 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.464199    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-home" pod "12343966-5a09-45e2-800a-b885d9417e6e" (UID: "12343966-5a09-45e2-800a-b885d9417e6e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.465131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.465061    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-tmp-dir" pod "12343966-5a09-45e2-800a-b885d9417e6e" (UID: "12343966-5a09-45e2-800a-b885d9417e6e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.466535 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.466488    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12343966-5a09-45e2-800a-b885d9417e6e-tls-certs" pod "12343966-5a09-45e2-800a-b885d9417e6e" (UID: "12343966-5a09-45e2-800a-b885d9417e6e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:32.466936 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.466905    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-dshm" pod "12343966-5a09-45e2-800a-b885d9417e6e" (UID: "12343966-5a09-45e2-800a-b885d9417e6e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:32.468005 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.467984    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12343966-5a09-45e2-800a-b885d9417e6e-kube-api-access-nkkph" pod "12343966-5a09-45e2-800a-b885d9417e6e" (UID: "12343966-5a09-45e2-800a-b885d9417e6e"). InnerVolumeSpecName "kube-api-access-nkkph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:32.536172 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.534214    5079 generic.go:356] "Generic (PLEG): container finished" podID="12343966-5a09-45e2-800a-b885d9417e6e" containerID="fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e" exitCode=0
Nov 04 05:45:32.536172 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.534306    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh" event={"ID":"12343966-5a09-45e2-800a-b885d9417e6e","Type":"ContainerDied","Data":"fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e"}
Nov 04 05:45:32.536172 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.534344    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh" event={"ID":"12343966-5a09-45e2-800a-b885d9417e6e","Type":"ContainerDied","Data":"1251c84f185a89dfc2d7c5b1d61f673f8d0530346b69c54aae71f24cf8b6f13b"}
Nov 04 05:45:32.536172 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.534364    5079 scope.go:122] "RemoveContainer" containerID="fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e"
Nov 04 05:45:32.536172 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.534466    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"
Nov 04 05:45:32.540604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.539609    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk" event={"ID":"524718b3-0092-4e88-a213-0e4d2263e6b6","Type":"ContainerDied","Data":"f9e7c08336d12cc5adb1888ac5f0d1d2573f6899ad6afdc3c357dd4188c15155"}
Nov 04 05:45:32.540604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.539709    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"
Nov 04 05:45:32.543266 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.543232    5079 generic.go:356] "Generic (PLEG): container finished" podID="de75450b-a274-47d0-ba6a-94b47d9f5f01" containerID="79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0" exitCode=0
Nov 04 05:45:32.543415 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.543396    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7" event={"ID":"de75450b-a274-47d0-ba6a-94b47d9f5f01","Type":"ContainerDied","Data":"79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0"}
Nov 04 05:45:32.543481 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.543438    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7" event={"ID":"de75450b-a274-47d0-ba6a-94b47d9f5f01","Type":"ContainerDied","Data":"7cf847141221a49d13c91c23bbcc13727b1f900a00c525bdd613ea1e953543be"}
Nov 04 05:45:32.543567 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.543526    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"
Nov 04 05:45:32.555326 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.555302    5079 scope.go:122] "RemoveContainer" containerID="fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e"
Nov 04 05:45:32.555905 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.555871    5079 generic.go:356] "Generic (PLEG): container finished" podID="a9c373d8-8502-4663-8fe2-998e13b32f64" containerID="6b9527c2330adf230497fc7974b4c8bcaea946fd61c0319c1ff4d908b98dd922" exitCode=0
Nov 04 05:45:32.555999 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.555961    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6" event={"ID":"a9c373d8-8502-4663-8fe2-998e13b32f64","Type":"ContainerDied","Data":"6b9527c2330adf230497fc7974b4c8bcaea946fd61c0319c1ff4d908b98dd922"}
Nov 04 05:45:32.556050 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:32.556027    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e\": container with ID starting with fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e not found: ID does not exist" containerID="fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e"
Nov 04 05:45:32.556102 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.556053    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e"} err="failed to get container status \"fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e\": rpc error: code = NotFound desc = could not find container \"fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e\": container with ID starting with fa143559f2c5d5789395d850b534bc0240e3723b75c68dc6db290da398f7cd5e not found: ID does not exist"
Nov 04 05:45:32.556102 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.556069    5079 scope.go:122] "RemoveContainer" containerID="4b4456f04fbaf57946bc17582d982dc516e2b56c1ac7ff15dfc45ad9012974ee"
Nov 04 05:45:32.559382 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.559104    5079 generic.go:356] "Generic (PLEG): container finished" podID="a626a041-2890-4f6c-b703-16c0eb761f04" containerID="300c94bc0d4094bc36365411df435f337151c7f918be170a400f25f27256c978" exitCode=0
Nov 04 05:45:32.559382 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.559199    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"
Nov 04 05:45:32.559536 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.559398    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz" event={"ID":"a626a041-2890-4f6c-b703-16c0eb761f04","Type":"ContainerDied","Data":"300c94bc0d4094bc36365411df435f337151c7f918be170a400f25f27256c978"}
Nov 04 05:45:32.564155 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.564132    5079 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-tmp-dir\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.564258 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.564159    5079 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-home\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.564258 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.564173    5079 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-model-cache\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.564258 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.564186    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkkph\" (UniqueName: \"kubernetes.io/projected/12343966-5a09-45e2-800a-b885d9417e6e-kube-api-access-nkkph\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.564258 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.564201    5079 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12343966-5a09-45e2-800a-b885d9417e6e-tls-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.564258 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.564215    5079 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12343966-5a09-45e2-800a-b885d9417e6e-dshm\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:32.617888 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.617767    5079 scope.go:122] "RemoveContainer" containerID="79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0"
Nov 04 05:45:32.675142 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.675065    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"]
Nov 04 05:45:32.692576 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.692542    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-w3-f910f5-kserve-6d6cb646c9-wzfpk"]
Nov 04 05:45:32.704484 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.704425    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"]
Nov 04 05:45:32.718450 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.718322    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/premium-w5-9d808e-kserve-6bccb94fd7-jw6sh"]
Nov 04 05:45:32.723202 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.723081    5079 scope.go:122] "RemoveContainer" containerID="79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0"
Nov 04 05:45:32.723579 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:32.723484    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0\": container with ID starting with 79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0 not found: ID does not exist" containerID="79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0"
Nov 04 05:45:32.723579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.723549    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0"} err="failed to get container status \"79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0\": rpc error: code = NotFound desc = could not find container \"79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0\": container with ID starting with 79b2c761ecf618491b4aa1d1a4c1164581609c2cb1d400eed5995d50dd48aff0 not found: ID does not exist"
Nov 04 05:45:32.726236 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.726214    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"]
Nov 04 05:45:32.732291 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.732236    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-9d808e/distinct-w5-9d808e-kserve-5d888cfbfd-wjvc7"]
Nov 04 05:45:32.737917 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.737859    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"]
Nov 04 05:45:32.743275 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:32.743223    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-f910f5/distinct-2-w3-f910f5-kserve-78957ff584-stkkr"]
Nov 04 05:45:33.322274 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:33.322215    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="12343966-5a09-45e2-800a-b885d9417e6e" path="/var/lib/kubelet/pods/12343966-5a09-45e2-800a-b885d9417e6e/volumes"
Nov 04 05:45:33.323089 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:33.323063    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="246d0446-d674-4eb4-b6a0-a30dc42f3154" path="/var/lib/kubelet/pods/246d0446-d674-4eb4-b6a0-a30dc42f3154/volumes"
Nov 04 05:45:33.323805 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:33.323781    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="524718b3-0092-4e88-a213-0e4d2263e6b6" path="/var/lib/kubelet/pods/524718b3-0092-4e88-a213-0e4d2263e6b6/volumes"
Nov 04 05:45:33.324907 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:33.324883    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b48ad58-03f8-4046-b0bf-c4bd18508b93" path="/var/lib/kubelet/pods/5b48ad58-03f8-4046-b0bf-c4bd18508b93/volumes"
Nov 04 05:45:33.325492 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:33.325471    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de75450b-a274-47d0-ba6a-94b47d9f5f01" path="/var/lib/kubelet/pods/de75450b-a274-47d0-ba6a-94b47d9f5f01/volumes"
Nov 04 05:45:33.591542 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:33.588151    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:33.703960 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:33.703881    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:33.869403 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:33.869303    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:33.907000 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:33.905813    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:45:33.907000 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:33.905878    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:34.000676 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.000648    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:34.005687 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.005654    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:34.047677 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.046901    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7" podUID="9934b5bc-40dd-42f6-b4e5-5b2843bc5a60" containerName="payload-processing" containerID="cri-o://2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e" gracePeriod=25
Nov 04 05:45:34.136685 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.121923    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-openshift-ca\") pod \"a9c373d8-8502-4663-8fe2-998e13b32f64\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") "
Nov 04 05:45:34.136685 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.122042    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a626a041-2890-4f6c-b703-16c0eb761f04-kube-api-access-rq57t\" (UniqueName: \"kubernetes.io/projected/a626a041-2890-4f6c-b703-16c0eb761f04-kube-api-access-rq57t\") pod \"a626a041-2890-4f6c-b703-16c0eb761f04\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") "
Nov 04 05:45:34.136685 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.122098    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-openshift-ca\") pod \"a626a041-2890-4f6c-b703-16c0eb761f04\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") "
Nov 04 05:45:34.136685 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.122208    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9c373d8-8502-4663-8fe2-998e13b32f64-kube-api-access-jmnj2\" (UniqueName: \"kubernetes.io/projected/a9c373d8-8502-4663-8fe2-998e13b32f64-kube-api-access-jmnj2\") pod \"a9c373d8-8502-4663-8fe2-998e13b32f64\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") "
Nov 04 05:45:34.136685 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.122280    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-xks-ca\") pod \"a9c373d8-8502-4663-8fe2-998e13b32f64\" (UID: \"a9c373d8-8502-4663-8fe2-998e13b32f64\") "
Nov 04 05:45:34.136685 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.122309    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-xks-ca\") pod \"a626a041-2890-4f6c-b703-16c0eb761f04\" (UID: \"a626a041-2890-4f6c-b703-16c0eb761f04\") "
Nov 04 05:45:34.143758 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.143717    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-openshift-ca" pod "a9c373d8-8502-4663-8fe2-998e13b32f64" (UID: "a9c373d8-8502-4663-8fe2-998e13b32f64"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:34.170791 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.170732    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-openshift-ca" pod "a626a041-2890-4f6c-b703-16c0eb761f04" (UID: "a626a041-2890-4f6c-b703-16c0eb761f04"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:34.223909 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.223827    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-openshift-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:34.223909 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.223871    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-openshift-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:34.239937 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.239165    5079 patch_prober.go:29] interesting pod/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:45:34.239937 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.239232    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:34.250817 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.250759    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c373d8-8502-4663-8fe2-998e13b32f64-kube-api-access-jmnj2" pod "a9c373d8-8502-4663-8fe2-998e13b32f64" (UID: "a9c373d8-8502-4663-8fe2-998e13b32f64"). InnerVolumeSpecName "kube-api-access-jmnj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:34.251117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.251079    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a626a041-2890-4f6c-b703-16c0eb761f04-kube-api-access-rq57t" pod "a626a041-2890-4f6c-b703-16c0eb761f04" (UID: "a626a041-2890-4f6c-b703-16c0eb761f04"). InnerVolumeSpecName "kube-api-access-rq57t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:34.251281 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.251248    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-xks-ca" pod "a626a041-2890-4f6c-b703-16c0eb761f04" (UID: "a626a041-2890-4f6c-b703-16c0eb761f04"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:34.307331 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.306257    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t" podUID="3f9ca4aa-f1a8-455a-98e2-11942289e9ec" containerName="payload-pre-processing" containerID="cri-o://f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f" gracePeriod=25
Nov 04 05:45:34.342939 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.326465    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a626a041-2890-4f6c-b703-16c0eb761f04-maas-api-xks-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:34.342939 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.326519    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq57t\" (UniqueName: \"kubernetes.io/projected/a626a041-2890-4f6c-b703-16c0eb761f04-kube-api-access-rq57t\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:34.342939 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.326536    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmnj2\" (UniqueName: \"kubernetes.io/projected/a9c373d8-8502-4663-8fe2-998e13b32f64-kube-api-access-jmnj2\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:34.345900 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.345836    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-xks-ca" pod "a9c373d8-8502-4663-8fe2-998e13b32f64" (UID: "a9c373d8-8502-4663-8fe2-998e13b32f64"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 05:45:34.434527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.427525    5079 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a9c373d8-8502-4663-8fe2-998e13b32f64-maas-api-xks-ca\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:34.635528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.627306    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6" event={"ID":"a9c373d8-8502-4663-8fe2-998e13b32f64","Type":"ContainerDied","Data":"9c1e6eef977d3ad6df484bb13fefdf342ad21ac1ee207fb5264be7b1c58d402b"}
Nov 04 05:45:34.635528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.627376    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c1e6eef977d3ad6df484bb13fefdf342ad21ac1ee207fb5264be7b1c58d402b"
Nov 04 05:45:34.635528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.627463    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e76d4112-zgmv6"
Nov 04 05:45:34.648661 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.644781    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz" event={"ID":"a626a041-2890-4f6c-b703-16c0eb761f04","Type":"ContainerDied","Data":"9d365c0f61c325f90974ed78381f6e7efe56193a76ffb092a990c5fdb8e77a86"}
Nov 04 05:45:34.648661 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.644854    5079 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d365c0f61c325f90974ed78381f6e7efe56193a76ffb092a990c5fdb8e77a86"
Nov 04 05:45:34.648661 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.644935    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6aeadf02-q2dnz"
Nov 04 05:45:34.947762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.947645    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 05:45:34.947762 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:34.947709    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 05:45:35.111526 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:35.110989    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:35.115524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:35.113148    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:35.115524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:35.114110    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:45:35.497564 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:35.497471    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:35.498648 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:35.498624    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:35.499212 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:35.499190    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:35.508456 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:35.508426    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:35.508595 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:35.508488    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:35.665652 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:35.665610    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j" event={"ID":"e442681a-66b1-4f8b-930a-267fa563d3f2","Type":"ContainerStarted","Data":"71feddea249950f60c0868f6708b3d978a8c33e9b40c6c0dcb65e098989a416c"}
Nov 04 05:45:35.665856 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:35.665692    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:35.905547 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:35.905406    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:36.144073 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:36.144041    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:36.676140 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:36.676113    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j"
Nov 04 05:45:36.699684 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:36.699632    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-c687j" podStartSLOduration=2.198927727 podStartE2EDuration="17.699618085s" totalImagesPullingTime="15.500690358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:35.687851882 +0000 UTC m=+1030.545839717" watchObservedRunningTime="2026-11-04 05:45:36.699618085 +0000 UTC m=+1031.557605914"
Nov 04 05:45:39.430983 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:39.430949    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:39.531187 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:39.531154    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:39.624614 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:39.624576    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:39.701920 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:39.695007    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:40.100873 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:40.100774    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache]"
Nov 04 05:45:40.663867 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:40.663824    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7" podUID="9934b5bc-40dd-42f6-b4e5-5b2843bc5a60" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:41.311769 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:41.311733    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:41.412255 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:41.412222    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:41.671850 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:41.671811    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t" podUID="3f9ca4aa-f1a8-455a-98e2-11942289e9ec" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:41.899171 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:41.899135    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:41.996515 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:41.996408    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:42.254688 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:42.254594    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache]"
Nov 04 05:45:43.336692 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:43.336643    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:43.434948 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:43.434916    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:44.442008 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:44.441979    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:44.665974 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:44.665937    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-dqbgz"]
Nov 04 05:45:45.044394 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:45.044355    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:45.465527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:45.441151    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"]
Nov 04 05:45:45.493534 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:45.466375    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" containerID="cri-o://ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18" gracePeriod=30
Nov 04 05:45:45.626542 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:45.596836    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"]
Nov 04 05:45:45.665840 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:45.665795    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" podUID="3ef99e53-7236-44f4-91df-8d774a75ce86" containerName="istio-proxy" containerID="cri-o://c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764" gracePeriod=30
Nov 04 05:45:45.672524 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:45.635769    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:45.934584 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:45.929153    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:46.079340 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:46.079302    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:46.662856 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:46.662808    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:45:50.119739 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:50.119688    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:50.176113 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:50.176068    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache]"
Nov 04 05:45:50.219904 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:50.219865    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:50.501451 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:50.501408    5079 patch_prober.go:29] interesting pod/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:45:50.501641 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:50.501493    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:45:50.664306 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:50.664270    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7" podUID="9934b5bc-40dd-42f6-b4e5-5b2843bc5a60" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:51.598832 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.598433    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:45:51.602700 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.602605    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:51.675686 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.675024    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t" podUID="3f9ca4aa-f1a8-455a-98e2-11942289e9ec" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 05:45:51.697067 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.697006    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"]
Nov 04 05:45:51.718588 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.718557    5079 cpu_manager.go:414] "containerMap: removing container" podUID="de75450b-a274-47d0-ba6a-94b47d9f5f01" containerName="main"
Nov 04 05:45:51.718800 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.718787    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de75450b-a274-47d0-ba6a-94b47d9f5f01" containerName="main"
Nov 04 05:45:51.719400 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.719380    5079 cpu_manager.go:414] "containerMap: removing container" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy"
Nov 04 05:45:51.719581 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.719570    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy"
Nov 04 05:45:51.719673 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.719664    5079 cpu_manager.go:414] "containerMap: removing container" podUID="a9c373d8-8502-4663-8fe2-998e13b32f64" containerName="revoke-keys"
Nov 04 05:45:51.719738 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.719730    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9c373d8-8502-4663-8fe2-998e13b32f64" containerName="revoke-keys"
Nov 04 05:45:51.719828 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.719820    5079 cpu_manager.go:414] "containerMap: removing container" podUID="12343966-5a09-45e2-800a-b885d9417e6e" containerName="main"
Nov 04 05:45:51.719890 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.719881    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="12343966-5a09-45e2-800a-b885d9417e6e" containerName="main"
Nov 04 05:45:51.719963 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.719955    5079 cpu_manager.go:414] "containerMap: removing container" podUID="3ef99e53-7236-44f4-91df-8d774a75ce86" containerName="istio-proxy"
Nov 04 05:45:51.720025 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.720017    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ef99e53-7236-44f4-91df-8d774a75ce86" containerName="istio-proxy"
Nov 04 05:45:51.720095 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.720087    5079 cpu_manager.go:414] "containerMap: removing container" podUID="5b48ad58-03f8-4046-b0bf-c4bd18508b93" containerName="main"
Nov 04 05:45:51.720176 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.720167    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b48ad58-03f8-4046-b0bf-c4bd18508b93" containerName="main"
Nov 04 05:45:51.720240 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.720232    5079 cpu_manager.go:414] "containerMap: removing container" podUID="a626a041-2890-4f6c-b703-16c0eb761f04" containerName="revoke-keys"
Nov 04 05:45:51.720310 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.720301    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a626a041-2890-4f6c-b703-16c0eb761f04" containerName="revoke-keys"
Nov 04 05:45:51.720934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.720919    5079 cpu_manager.go:414] "containerMap: removing container" podUID="246d0446-d674-4eb4-b6a0-a30dc42f3154" containerName="main"
Nov 04 05:45:51.721058 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.721048    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="246d0446-d674-4eb4-b6a0-a30dc42f3154" containerName="main"
Nov 04 05:45:51.721141 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.721133    5079 cpu_manager.go:414] "containerMap: removing container" podUID="f07418fd-c953-42ed-a436-2e02cdfb7a05" containerName="istio-proxy"
Nov 04 05:45:51.721203 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.721194    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f07418fd-c953-42ed-a436-2e02cdfb7a05" containerName="istio-proxy"
Nov 04 05:45:51.721273 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.721264    5079 cpu_manager.go:414] "containerMap: removing container" podUID="524718b3-0092-4e88-a213-0e4d2263e6b6" containerName="main"
Nov 04 05:45:51.721339 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.721330    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="524718b3-0092-4e88-a213-0e4d2263e6b6" containerName="main"
Nov 04 05:45:51.721609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.721594    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="de75450b-a274-47d0-ba6a-94b47d9f5f01" containerName="main"
Nov 04 05:45:51.721717 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.721706    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerName="istio-proxy"
Nov 04 05:45:51.721817 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.721807    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9c373d8-8502-4663-8fe2-998e13b32f64" containerName="revoke-keys"
Nov 04 05:45:51.721901 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.721893    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="12343966-5a09-45e2-800a-b885d9417e6e" containerName="main"
Nov 04 05:45:51.721971 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.721962    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ef99e53-7236-44f4-91df-8d774a75ce86" containerName="istio-proxy"
Nov 04 05:45:51.722048 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.722039    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b48ad58-03f8-4046-b0bf-c4bd18508b93" containerName="main"
Nov 04 05:45:51.722115 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.722107    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="a626a041-2890-4f6c-b703-16c0eb761f04" containerName="revoke-keys"
Nov 04 05:45:51.722179 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.722171    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="246d0446-d674-4eb4-b6a0-a30dc42f3154" containerName="main"
Nov 04 05:45:51.722242 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.722235    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="f07418fd-c953-42ed-a436-2e02cdfb7a05" containerName="istio-proxy"
Nov 04 05:45:51.722310 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.722302    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="524718b3-0092-4e88-a213-0e4d2263e6b6" containerName="main"
Nov 04 05:45:51.724870 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.723921    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-socket\") pod \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") "
Nov 04 05:45:51.724870 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.724001    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-envoy\") pod \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") "
Nov 04 05:45:51.724870 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.724037    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-podinfo\") pod \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") "
Nov 04 05:45:51.725316 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.725207    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-certs\") pod \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") "
Nov 04 05:45:51.725316 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.725270    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-token\" (UniqueName: \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-token\") pod \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") "
Nov 04 05:45:51.726055 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.725630    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-credential-socket\") pod \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") "
Nov 04 05:45:51.726055 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.725666    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-socket\") pod \"3ef99e53-7236-44f4-91df-8d774a75ce86\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") "
Nov 04 05:45:51.726055 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.725739    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-kube-api-access-gbzps\" (UniqueName: \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-kube-api-access-gbzps\") pod \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") "
Nov 04 05:45:51.726055 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.725792    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-certs\") pod \"3ef99e53-7236-44f4-91df-8d774a75ce86\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") "
Nov 04 05:45:51.726055 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.725846    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istiod-ca-cert\") pod \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") "
Nov 04 05:45:51.726055 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.725879    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-data\") pod \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\" (UID: \"38d059a1-2b1f-47e1-be73-7d8223e2a64c\") "
Nov 04 05:45:51.726055 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.725970    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-envoy\") pod \"3ef99e53-7236-44f4-91df-8d774a75ce86\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") "
Nov 04 05:45:51.727012 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.726830    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-credential-socket" pod "38d059a1-2b1f-47e1-be73-7d8223e2a64c" (UID: "38d059a1-2b1f-47e1-be73-7d8223e2a64c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.728269 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.727103    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-data\") pod \"3ef99e53-7236-44f4-91df-8d774a75ce86\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") "
Nov 04 05:45:51.728269 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.727166    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-token\" (UniqueName: \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-token\") pod \"3ef99e53-7236-44f4-91df-8d774a75ce86\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") "
Nov 04 05:45:51.728269 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.727186    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3ef99e53-7236-44f4-91df-8d774a75ce86-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ef99e53-7236-44f4-91df-8d774a75ce86-istiod-ca-cert\") pod \"3ef99e53-7236-44f4-91df-8d774a75ce86\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") "
Nov 04 05:45:51.728269 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.727215    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-credential-socket\") pod \"3ef99e53-7236-44f4-91df-8d774a75ce86\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") "
Nov 04 05:45:51.728269 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.727233    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-kube-api-access-5mdzg\" (UniqueName: \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-kube-api-access-5mdzg\") pod \"3ef99e53-7236-44f4-91df-8d774a75ce86\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") "
Nov 04 05:45:51.728269 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.727260    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-podinfo\") pod \"3ef99e53-7236-44f4-91df-8d774a75ce86\" (UID: \"3ef99e53-7236-44f4-91df-8d774a75ce86\") "
Nov 04 05:45:51.728269 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.727896    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.728766 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.728618    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"]
Nov 04 05:45:51.728766 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.728731    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.729375 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.729073    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-socket" pod "38d059a1-2b1f-47e1-be73-7d8223e2a64c" (UID: "38d059a1-2b1f-47e1-be73-7d8223e2a64c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.730544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.730276    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-certs" pod "3ef99e53-7236-44f4-91df-8d774a75ce86" (UID: "3ef99e53-7236-44f4-91df-8d774a75ce86"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.730544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.730352    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-certs" pod "38d059a1-2b1f-47e1-be73-7d8223e2a64c" (UID: "38d059a1-2b1f-47e1-be73-7d8223e2a64c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.730544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.730492    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-socket" pod "3ef99e53-7236-44f4-91df-8d774a75ce86" (UID: "3ef99e53-7236-44f4-91df-8d774a75ce86"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.740025 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.738890    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ef99e53-7236-44f4-91df-8d774a75ce86-istiod-ca-cert" pod "3ef99e53-7236-44f4-91df-8d774a75ce86" (UID: "3ef99e53-7236-44f4-91df-8d774a75ce86"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:51.740025 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.739717    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istiod-ca-cert" pod "38d059a1-2b1f-47e1-be73-7d8223e2a64c" (UID: "38d059a1-2b1f-47e1-be73-7d8223e2a64c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:51.740538 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.740478    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-data" pod "38d059a1-2b1f-47e1-be73-7d8223e2a64c" (UID: "38d059a1-2b1f-47e1-be73-7d8223e2a64c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.741065 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.740777    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-credential-socket" pod "3ef99e53-7236-44f4-91df-8d774a75ce86" (UID: "3ef99e53-7236-44f4-91df-8d774a75ce86"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.760555 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.743748    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-data" pod "3ef99e53-7236-44f4-91df-8d774a75ce86" (UID: "3ef99e53-7236-44f4-91df-8d774a75ce86"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.760555 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.745848    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-kube-api-access-5mdzg" pod "3ef99e53-7236-44f4-91df-8d774a75ce86" (UID: "3ef99e53-7236-44f4-91df-8d774a75ce86"). InnerVolumeSpecName "kube-api-access-5mdzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:51.761209 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.761169    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-token" pod "3ef99e53-7236-44f4-91df-8d774a75ce86" (UID: "3ef99e53-7236-44f4-91df-8d774a75ce86"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:51.761740 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.761683    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-envoy" pod "38d059a1-2b1f-47e1-be73-7d8223e2a64c" (UID: "38d059a1-2b1f-47e1-be73-7d8223e2a64c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.761740 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.761698    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-podinfo" pod "38d059a1-2b1f-47e1-be73-7d8223e2a64c" (UID: "38d059a1-2b1f-47e1-be73-7d8223e2a64c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:45:51.761896 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.761806    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-kube-api-access-gbzps" pod "38d059a1-2b1f-47e1-be73-7d8223e2a64c" (UID: "38d059a1-2b1f-47e1-be73-7d8223e2a64c"). InnerVolumeSpecName "kube-api-access-gbzps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:51.761896 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.761865    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-envoy" pod "3ef99e53-7236-44f4-91df-8d774a75ce86" (UID: "3ef99e53-7236-44f4-91df-8d774a75ce86"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:45:51.762105 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.762085    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-podinfo" pod "3ef99e53-7236-44f4-91df-8d774a75ce86" (UID: "3ef99e53-7236-44f4-91df-8d774a75ce86"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:45:51.765908 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.765880    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-token" pod "38d059a1-2b1f-47e1-be73-7d8223e2a64c" (UID: "38d059a1-2b1f-47e1-be73-7d8223e2a64c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:51.829004 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.828959    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.829182 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829032    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.829182 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829147    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.829309 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829201    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.829309 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829279    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70210096-5533-4963-b4f4-853f998cc6bc-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.829309 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829304    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5kfh\" (UniqueName: \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-kube-api-access-c5kfh\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.829438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829352    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70210096-5533-4963-b4f4-853f998cc6bc-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.829438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829401    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.829438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829432    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.829604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829512    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.829604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829531    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbzps\" (UniqueName: \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-kube-api-access-gbzps\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.829604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829547    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.829604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829557    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.829604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829566    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.829604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829575    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.829604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829583    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.829604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829591    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.829604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829599    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ef99e53-7236-44f4-91df-8d774a75ce86-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.829604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829607    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ef99e53-7236-44f4-91df-8d774a75ce86-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.830066 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829616    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mdzg\" (UniqueName: \"kubernetes.io/projected/3ef99e53-7236-44f4-91df-8d774a75ce86-kube-api-access-5mdzg\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.830066 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829624    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ef99e53-7236-44f4-91df-8d774a75ce86-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.830066 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829634    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.830066 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829643    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.830066 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829651    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.830066 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829660    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d059a1-2b1f-47e1-be73-7d8223e2a64c-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.830066 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.829668    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d059a1-2b1f-47e1-be73-7d8223e2a64c-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:51.911834 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.911795    5079 generic.go:356] "Generic (PLEG): container finished" podID="3ef99e53-7236-44f4-91df-8d774a75ce86" containerID="c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764" exitCode=0
Nov 04 05:45:51.912040 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.911946    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" event={"ID":"3ef99e53-7236-44f4-91df-8d774a75ce86","Type":"ContainerDied","Data":"c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764"}
Nov 04 05:45:51.912040 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.912013    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc" event={"ID":"3ef99e53-7236-44f4-91df-8d774a75ce86","Type":"ContainerDied","Data":"f5e31b7e847724967844d7805195c0ac78bb3a738f48798c333b8871bbeaccc6"}
Nov 04 05:45:51.912040 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.912034    5079 scope.go:122] "RemoveContainer" containerID="c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764"
Nov 04 05:45:51.912214 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.912154    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"
Nov 04 05:45:51.914875 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.914839    5079 generic.go:356] "Generic (PLEG): container finished" podID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" containerID="ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18" exitCode=0
Nov 04 05:45:51.915024 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.914939    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" event={"ID":"38d059a1-2b1f-47e1-be73-7d8223e2a64c","Type":"ContainerDied","Data":"ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18"}
Nov 04 05:45:51.915024 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.914986    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc" event={"ID":"38d059a1-2b1f-47e1-be73-7d8223e2a64c","Type":"ContainerDied","Data":"bd417dde99b76f9c431d02cbce352c0bcafc314d1b1df8bd906f3e414b1cc946"}
Nov 04 05:45:51.915131 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.915074    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"
Nov 04 05:45:51.927726 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.927700    5079 scope.go:122] "RemoveContainer" containerID="c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764"
Nov 04 05:45:51.928123 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:51.928095    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764\": container with ID starting with c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764 not found: ID does not exist" containerID="c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764"
Nov 04 05:45:51.928247 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.928135    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764"} err="failed to get container status \"c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764\": rpc error: code = NotFound desc = could not find container \"c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764\": container with ID starting with c09fd5ccf9a5ed11c20e048454e74500885f3ea91e431a441ed18126a17da764 not found: ID does not exist"
Nov 04 05:45:51.928247 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.928157    5079 scope.go:122] "RemoveContainer" containerID="ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18"
Nov 04 05:45:51.931002 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.930976    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931087 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931072    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931148 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931132    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931206 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931177    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70210096-5533-4963-b4f4-853f998cc6bc-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931257 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931202    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5kfh\" (UniqueName: \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-kube-api-access-c5kfh\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931309 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931257    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70210096-5533-4963-b4f4-853f998cc6bc-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931309 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931298    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931411 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931348    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931411 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931406    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931610 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931432    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-credential-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931736 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931717    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-certs\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931817 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931795    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-data\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.931943 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.931923    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-socket\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.932137 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.932114    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70210096-5533-4963-b4f4-853f998cc6bc-istiod-ca-cert\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.934219 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.934200    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-envoy\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.934860 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.934834    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70210096-5533-4963-b4f4-853f998cc6bc-istio-podinfo\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.939621 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.939600    5079 scope.go:122] "RemoveContainer" containerID="ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18"
Nov 04 05:45:51.939966 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.939945    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-istio-token\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.939966 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:51.939956    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18\": container with ID starting with ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18 not found: ID does not exist" containerID="ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18"
Nov 04 05:45:51.940092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.939980    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18"} err="failed to get container status \"ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18\": rpc error: code = NotFound desc = could not find container \"ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18\": container with ID starting with ae5113f00258888735e120a9c71cc918ca9872708114e9e49f07d882d7bc4a18 not found: ID does not exist"
Nov 04 05:45:51.940092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.939959    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5kfh\" (UniqueName: \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-kube-api-access-c5kfh\") pod \"e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") " pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:51.945141 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.945112    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"]
Nov 04 05:45:51.950766 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.950728    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-8h8bc"]
Nov 04 05:45:51.959699 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.959664    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"]
Nov 04 05:45:51.963285 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:51.963251    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-2b14d0-openshift-default-57ff65bf59-mjhhc"]
Nov 04 05:45:52.077664 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:52.074856    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:52.378587 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:52.378439    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"]
Nov 04 05:45:52.393550 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:52.384320    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:52.424673 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:52.424420    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:52.424673 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:52.424548    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:52.424673 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:52.424617    5079 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Nov 04 05:45:52.474783 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:52.474687    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:52.928212 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:52.928171    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7" event={"ID":"70210096-5533-4963-b4f4-853f998cc6bc","Type":"ContainerStarted","Data":"dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17"}
Nov 04 05:45:52.928732 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:52.928239    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7" event={"ID":"70210096-5533-4963-b4f4-853f998cc6bc","Type":"ContainerStarted","Data":"43b879dcf8b03261e86d5d0eb319fa1043a47c6efe2ae3c4f97e1a59a5453329"}
Nov 04 05:45:52.958307 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:52.958252    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7" podStartSLOduration=1.958237543 podStartE2EDuration="1.958237543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:45:52.950173102 +0000 UTC m=+1047.808160932" watchObservedRunningTime="2026-11-04 05:45:52.958237543 +0000 UTC m=+1047.816225372"
Nov 04 05:45:53.020921 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:53.020545    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:53.075897 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:53.075699    5079 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:45:53.078145 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:53.078074    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Nov 04 05:45:53.078145 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:53.078164    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7" podUID="70210096-5533-4963-b4f4-853f998cc6bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Nov 04 05:45:53.140558 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:53.136694    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:53.236441 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:53.236060    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:53.330622 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:53.330433    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:53.340099 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:53.340066    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="38d059a1-2b1f-47e1-be73-7d8223e2a64c" path="/var/lib/kubelet/pods/38d059a1-2b1f-47e1-be73-7d8223e2a64c/volumes"
Nov 04 05:45:53.341012 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:53.340988    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3ef99e53-7236-44f4-91df-8d774a75ce86" path="/var/lib/kubelet/pods/3ef99e53-7236-44f4-91df-8d774a75ce86/volumes"
Nov 04 05:45:54.091527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.085195    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Nov 04 05:45:54.091527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.085258    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7" podUID="70210096-5533-4963-b4f4-853f998cc6bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Nov 04 05:45:54.425723 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.425692    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:45:54.539133 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.539095    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-kube-api-access-h65nw\" (UniqueName: \"kubernetes.io/projected/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-kube-api-access-h65nw\") pod \"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60\" (UID: \"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60\") "
Nov 04 05:45:54.539376 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.539243    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-plugins-config-volume\") pod \"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60\" (UID: \"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60\") "
Nov 04 05:45:54.540092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.540063    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-plugins-config-volume" pod "9934b5bc-40dd-42f6-b4e5-5b2843bc5a60" (UID: "9934b5bc-40dd-42f6-b4e5-5b2843bc5a60"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:54.553439 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.553366    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-kube-api-access-h65nw" pod "9934b5bc-40dd-42f6-b4e5-5b2843bc5a60" (UID: "9934b5bc-40dd-42f6-b4e5-5b2843bc5a60"). InnerVolumeSpecName "kube-api-access-h65nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:54.643984 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.643886    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h65nw\" (UniqueName: \"kubernetes.io/projected/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-kube-api-access-h65nw\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:54.644246 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.644226    5079 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60-plugins-config-volume\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:54.669232 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.669204    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:45:54.845935 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.845899    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-plugins-config-volume\") pod \"3f9ca4aa-f1a8-455a-98e2-11942289e9ec\" (UID: \"3f9ca4aa-f1a8-455a-98e2-11942289e9ec\") "
Nov 04 05:45:54.846177 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.846053    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-kube-api-access-wr979\" (UniqueName: \"kubernetes.io/projected/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-kube-api-access-wr979\") pod \"3f9ca4aa-f1a8-455a-98e2-11942289e9ec\" (UID: \"3f9ca4aa-f1a8-455a-98e2-11942289e9ec\") "
Nov 04 05:45:54.846403 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.846374    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-plugins-config-volume" pod "3f9ca4aa-f1a8-455a-98e2-11942289e9ec" (UID: "3f9ca4aa-f1a8-455a-98e2-11942289e9ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:45:54.848396 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.848368    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-kube-api-access-wr979" pod "3f9ca4aa-f1a8-455a-98e2-11942289e9ec" (UID: "3f9ca4aa-f1a8-455a-98e2-11942289e9ec"). InnerVolumeSpecName "kube-api-access-wr979". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:45:54.947275 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.947238    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr979\" (UniqueName: \"kubernetes.io/projected/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-kube-api-access-wr979\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:54.947275 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.947271    5079 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f9ca4aa-f1a8-455a-98e2-11942289e9ec-plugins-config-volume\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:45:54.967205 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.967169    5079 generic.go:356] "Generic (PLEG): container finished" podID="3f9ca4aa-f1a8-455a-98e2-11942289e9ec" containerID="f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f" exitCode=0
Nov 04 05:45:54.967399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.967220    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"
Nov 04 05:45:54.967399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.967253    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t" event={"ID":"3f9ca4aa-f1a8-455a-98e2-11942289e9ec","Type":"ContainerDied","Data":"f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f"}
Nov 04 05:45:54.967399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.967315    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t" event={"ID":"3f9ca4aa-f1a8-455a-98e2-11942289e9ec","Type":"ContainerDied","Data":"00e7827ea4d550c182c136d92d263b0baf98b5b1bbebb6f4cb9c06e39504f0a8"}
Nov 04 05:45:54.967399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.967339    5079 scope.go:122] "RemoveContainer" containerID="f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f"
Nov 04 05:45:54.969180 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.969155    5079 generic.go:356] "Generic (PLEG): container finished" podID="9934b5bc-40dd-42f6-b4e5-5b2843bc5a60" containerID="2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e" exitCode=0
Nov 04 05:45:54.969300 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.969226    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"
Nov 04 05:45:54.969300 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.969246    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7" event={"ID":"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60","Type":"ContainerDied","Data":"2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e"}
Nov 04 05:45:54.969387 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:54.969301    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7" event={"ID":"9934b5bc-40dd-42f6-b4e5-5b2843bc5a60","Type":"ContainerDied","Data":"3ca02b1197e6e4f7f1d509b7142a7307768e1f46af8dca79457a427d9fcd0f0e"}
Nov 04 05:45:55.017744 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.017660    5079 scope.go:122] "RemoveContainer" containerID="f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f"
Nov 04 05:45:55.018220 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:55.018074    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f\": container with ID starting with f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f not found: ID does not exist" containerID="f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f"
Nov 04 05:45:55.018220 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.018111    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f"} err="failed to get container status \"f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f\": rpc error: code = NotFound desc = could not find container \"f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f\": container with ID starting with f8860d07f4d7523c63b30372bab8833fbbc6e330bb1bacf69f771b0110d76a7f not found: ID does not exist"
Nov 04 05:45:55.018220 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.018135    5079 scope.go:122] "RemoveContainer" containerID="2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e"
Nov 04 05:45:55.031738 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.031687    5079 scope.go:122] "RemoveContainer" containerID="2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e"
Nov 04 05:45:55.032358 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:55.032092    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e\": container with ID starting with 2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e not found: ID does not exist" containerID="2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e"
Nov 04 05:45:55.032358 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.032132    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e"} err="failed to get container status \"2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e\": rpc error: code = NotFound desc = could not find container \"2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e\": container with ID starting with 2f4a3e862c9a200baf35e20336ee3b31cadb6c32b93f1093fe2eb2e328a9587e not found: ID does not exist"
Nov 04 05:45:55.033276 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.033257    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"]
Nov 04 05:45:55.037881 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.037845    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-9d808e-c6d7db587-qdm7t"]
Nov 04 05:45:55.055907 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.055872    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"]
Nov 04 05:45:55.059407 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.059375    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-27935d-5d6c877f7d-9l7h7"]
Nov 04 05:45:55.101224 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.093037    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Nov 04 05:45:55.101224 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.100677    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7" podUID="70210096-5533-4963-b4f4-853f998cc6bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Nov 04 05:45:55.315284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.315139    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:55.319742 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.319709    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f9ca4aa-f1a8-455a-98e2-11942289e9ec" path="/var/lib/kubelet/pods/3f9ca4aa-f1a8-455a-98e2-11942289e9ec/volumes"
Nov 04 05:45:55.320309 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.320288    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9934b5bc-40dd-42f6-b4e5-5b2843bc5a60" path="/var/lib/kubelet/pods/9934b5bc-40dd-42f6-b4e5-5b2843bc5a60/volumes"
Nov 04 05:45:55.438719 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.438680    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:55.622947 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:55.622867    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:56.092566 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:56.092534    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Nov 04 05:45:56.096566 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:56.095653    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7" podUID="70210096-5533-4963-b4f4-853f998cc6bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Nov 04 05:45:57.080005 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.079966    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Nov 04 05:45:57.080688 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.080655    5079 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7" podUID="70210096-5533-4963-b4f4-853f998cc6bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Nov 04 05:45:57.247774 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.247736    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:57.327890 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:45:57.327846    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache]"
Nov 04 05:45:57.494862 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.494627    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:57.626905 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.626868    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:57.627226 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.627207    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"]
Nov 04 05:45:57.627646 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.627618    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy" containerID="cri-o://f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7" gracePeriod=30
Nov 04 05:45:57.632259 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.632234    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"]
Nov 04 05:45:57.632893 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.632761    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerName="istio-proxy" containerID="cri-o://2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24" gracePeriod=30
Nov 04 05:45:57.645938 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.636184    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"]
Nov 04 05:45:57.645938 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.636383    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7" podUID="70210096-5533-4963-b4f4-853f998cc6bc" containerName="istio-proxy" containerID="cri-o://dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17" gracePeriod=30
Nov 04 05:45:57.857770 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.857670    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"]
Nov 04 05:45:57.858669 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.857957    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy" containerID="cri-o://f1042fe5c408cc319ddb3c086eebe36ab2895805fe93049aa60b28bd1e4b46c8" gracePeriod=30
Nov 04 05:45:57.863805 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.862933    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"]
Nov 04 05:45:57.863805 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.863150    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy" containerID="cri-o://26ca1d79e1add96e135bee59359469a6214cc04f5e4b3bfd6e8e966edcfa3832" gracePeriod=30
Nov 04 05:45:57.910526 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:57.909176    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:58.500724 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:58.500685    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:58.907584 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:58.907067    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"]
Nov 04 05:45:58.907584 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:58.907353    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerName="istio-proxy" containerID="cri-o://900a79525ef91f12f7d9a77de4ac4bf0af9889aae1961a2fd1fad3ab4245362f" gracePeriod=30
Nov 04 05:45:58.918466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:58.914608    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"]
Nov 04 05:45:58.918466 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:58.914846    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy" containerID="cri-o://f390cb41f41af142b91eaf546ce30aefd30b8cf586aee2fd26ffdd9fc03b4330" gracePeriod=30
Nov 04 05:45:58.923158 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:58.923122    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:45:59.603427 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:59.603392    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:45:59.603929 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:59.603458    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:45:59.799934 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:59.799896    5079 patch_prober.go:29] interesting pod/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:45:59.800106 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:45:59.799957    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:46:00.058595 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:00.058558    5079 patch_prober.go:29] interesting pod/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 05:46:00.058776 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:00.058638    5079 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 05:46:00.191225 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:46:00.191175    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache]"
Nov 04 05:46:00.704750 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:00.704718    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58f5b47bf6-c4rt8_b1d03acd-2d0f-4053-a284-031b589768e2/authorino/0.log"
Nov 04 05:46:01.272083 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:01.272043    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:46:01.350651 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:01.350613    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:46:01.454113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:01.454073    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:46:01.557365 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:01.557284    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:46:03.011809 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.011780    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:46:03.020120 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.020092    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:46:03.091983 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.091940    5079 generic.go:356] "Generic (PLEG): container finished" podID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerID="f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7" exitCode=0
Nov 04 05:46:03.093837 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.092113    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" event={"ID":"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6","Type":"ContainerDied","Data":"f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7"}
Nov 04 05:46:03.094075 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.094008    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs" event={"ID":"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6","Type":"ContainerDied","Data":"29594e23c13fbda4f720f54ab66fdf379851081e9bd582fc1e902f9df92190b4"}
Nov 04 05:46:03.094182 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.094097    5079 scope.go:122] "RemoveContainer" containerID="f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7"
Nov 04 05:46:03.094238 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.092225    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"
Nov 04 05:46:03.100302 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.100274    5079 generic.go:356] "Generic (PLEG): container finished" podID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerID="f1042fe5c408cc319ddb3c086eebe36ab2895805fe93049aa60b28bd1e4b46c8" exitCode=0
Nov 04 05:46:03.100447 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.100351    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" event={"ID":"870d4866-24fe-4fa0-89dc-63a5ed9b0e02","Type":"ContainerDied","Data":"f1042fe5c408cc319ddb3c086eebe36ab2895805fe93049aa60b28bd1e4b46c8"}
Nov 04 05:46:03.102161 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.102117    5079 generic.go:356] "Generic (PLEG): container finished" podID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerID="2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24" exitCode=0
Nov 04 05:46:03.102238 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.102186    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" event={"ID":"44fe3523-7b6a-4fe9-b56c-35106a80a83e","Type":"ContainerDied","Data":"2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24"}
Nov 04 05:46:03.102300 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.102239    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5" event={"ID":"44fe3523-7b6a-4fe9-b56c-35106a80a83e","Type":"ContainerDied","Data":"241b7dc84020a07f43572f15d79569453b1c45aeecc3b6fca5587c7a58be76ea"}
Nov 04 05:46:03.102358 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.102324    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"
Nov 04 05:46:03.104273 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.104241    5079 generic.go:356] "Generic (PLEG): container finished" podID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerID="26ca1d79e1add96e135bee59359469a6214cc04f5e4b3bfd6e8e966edcfa3832" exitCode=0
Nov 04 05:46:03.104411 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.104364    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" event={"ID":"e411b37f-4766-45c0-8c07-e2f5ee2e7780","Type":"ContainerDied","Data":"26ca1d79e1add96e135bee59359469a6214cc04f5e4b3bfd6e8e966edcfa3832"}
Nov 04 05:46:03.124913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.124199    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istiod-ca-cert\") pod \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") "
Nov 04 05:46:03.124913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.124305    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-socket\") pod \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") "
Nov 04 05:46:03.124913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.124400    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istiod-ca-cert\") pod \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") "
Nov 04 05:46:03.124913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.124490    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-envoy\") pod \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") "
Nov 04 05:46:03.124913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.124595    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-socket\") pod \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") "
Nov 04 05:46:03.124913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.124630    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-credential-socket\") pod \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") "
Nov 04 05:46:03.124913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.124687    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-podinfo\") pod \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") "
Nov 04 05:46:03.124913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.124755    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-token\" (UniqueName: \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-token\") pod \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") "
Nov 04 05:46:03.124913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.124852    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-envoy\") pod \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") "
Nov 04 05:46:03.124913 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.124920    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-certs\") pod \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") "
Nov 04 05:46:03.125585 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.124984    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-token\" (UniqueName: \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-token\") pod \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") "
Nov 04 05:46:03.125585 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.125046    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-kube-api-access-r7lfv\" (UniqueName: \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-kube-api-access-r7lfv\") pod \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") "
Nov 04 05:46:03.125585 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.125115    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-credential-socket\") pod \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") "
Nov 04 05:46:03.125585 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.125167    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-data\") pod \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") "
Nov 04 05:46:03.125585 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.125200    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-podinfo\") pod \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\" (UID: \"44fe3523-7b6a-4fe9-b56c-35106a80a83e\") "
Nov 04 05:46:03.125585 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.125397    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-credential-socket" pod "44fe3523-7b6a-4fe9-b56c-35106a80a83e" (UID: "44fe3523-7b6a-4fe9-b56c-35106a80a83e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.125892 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.125789    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istiod-ca-cert" pod "44fe3523-7b6a-4fe9-b56c-35106a80a83e" (UID: "44fe3523-7b6a-4fe9-b56c-35106a80a83e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:03.125892 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.125819    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-kube-api-access-wdtrv\" (UniqueName: \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-kube-api-access-wdtrv\") pod \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") "
Nov 04 05:46:03.125995 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.125894    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-data\") pod \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") "
Nov 04 05:46:03.126334 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.126301    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-certs\") pod \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\" (UID: \"bbf2963f-1201-4fcc-afe4-e2c6d6e389a6\") "
Nov 04 05:46:03.127261 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.127238    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.127399 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.127385    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.127736 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.127717    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-certs" pod "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" (UID: "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.128134 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.128108    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-data" pod "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" (UID: "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.128263 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.128242    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-data" pod "44fe3523-7b6a-4fe9-b56c-35106a80a83e" (UID: "44fe3523-7b6a-4fe9-b56c-35106a80a83e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.128742 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.128712    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istiod-ca-cert" pod "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" (UID: "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:03.129389 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.129022    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-socket" pod "44fe3523-7b6a-4fe9-b56c-35106a80a83e" (UID: "44fe3523-7b6a-4fe9-b56c-35106a80a83e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.129389 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.129212    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-socket" pod "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" (UID: "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.131325 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.131150    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-credential-socket" pod "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" (UID: "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.131544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.131455    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-certs" pod "44fe3523-7b6a-4fe9-b56c-35106a80a83e" (UID: "44fe3523-7b6a-4fe9-b56c-35106a80a83e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.136561 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.134294    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-kube-api-access-r7lfv" pod "44fe3523-7b6a-4fe9-b56c-35106a80a83e" (UID: "44fe3523-7b6a-4fe9-b56c-35106a80a83e"). InnerVolumeSpecName "kube-api-access-r7lfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.137825 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.137787    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-envoy" pod "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" (UID: "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.137944 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.137926    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-envoy" pod "44fe3523-7b6a-4fe9-b56c-35106a80a83e" (UID: "44fe3523-7b6a-4fe9-b56c-35106a80a83e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.138022 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.137957    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-podinfo" pod "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" (UID: "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:03.138022 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.137988    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-token" pod "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" (UID: "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.138299 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.138042    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-podinfo" pod "44fe3523-7b6a-4fe9-b56c-35106a80a83e" (UID: "44fe3523-7b6a-4fe9-b56c-35106a80a83e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:03.141267 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.141221    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-token" pod "44fe3523-7b6a-4fe9-b56c-35106a80a83e" (UID: "44fe3523-7b6a-4fe9-b56c-35106a80a83e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.147529 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.143249    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-kube-api-access-wdtrv" pod "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" (UID: "bbf2963f-1201-4fcc-afe4-e2c6d6e389a6"). InnerVolumeSpecName "kube-api-access-wdtrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.147529 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.145072    5079 scope.go:122] "RemoveContainer" containerID="703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363"
Nov 04 05:46:03.162558 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.162316    5079 scope.go:122] "RemoveContainer" containerID="f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7"
Nov 04 05:46:03.163527 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:46:03.162805    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7\": container with ID starting with f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7 not found: ID does not exist" containerID="f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7"
Nov 04 05:46:03.163527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.162852    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7"} err="failed to get container status \"f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7\": rpc error: code = NotFound desc = could not find container \"f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7\": container with ID starting with f91c45d4809b40dd8f878421f02bfde1eeb6b4040a0b336adf78c8bf74bf5fe7 not found: ID does not exist"
Nov 04 05:46:03.163527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.162881    5079 scope.go:122] "RemoveContainer" containerID="703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363"
Nov 04 05:46:03.163527 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:46:03.163204    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363\": container with ID starting with 703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363 not found: ID does not exist" containerID="703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363"
Nov 04 05:46:03.163527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.163244    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363"} err="failed to get container status \"703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363\": rpc error: code = NotFound desc = could not find container \"703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363\": container with ID starting with 703bcb977b191e3d4835e3df20f9ed1755dc0f3cbf42d7f216aa588697d0e363 not found: ID does not exist"
Nov 04 05:46:03.163527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.163267    5079 scope.go:122] "RemoveContainer" containerID="3d8bfb9ff13df6f1bdccfd228a4a58ae7a6a1c610b04b35d23432393aa0fbff6"
Nov 04 05:46:03.176043 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.176005    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:46:03.176552 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.176431    5079 scope.go:122] "RemoveContainer" containerID="2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24"
Nov 04 05:46:03.187630 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.187594    5079 scope.go:122] "RemoveContainer" containerID="2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24"
Nov 04 05:46:03.188031 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:46:03.188008    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24\": container with ID starting with 2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24 not found: ID does not exist" containerID="2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24"
Nov 04 05:46:03.188128 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.188034    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24"} err="failed to get container status \"2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24\": rpc error: code = NotFound desc = could not find container \"2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24\": container with ID starting with 2e9f1ca6e0e4713b12227d0038c6604277346879bd0e7d0748f7585ed140fe24 not found: ID does not exist"
Nov 04 05:46:03.218036 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.218003    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:46:03.227948 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.227866    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istiod-ca-cert\") pod \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") "
Nov 04 05:46:03.227948 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.227921    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-token\" (UniqueName: \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-token\") pod \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") "
Nov 04 05:46:03.227948 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.227949    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-data\") pod \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") "
Nov 04 05:46:03.228337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228034    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-certs\") pod \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") "
Nov 04 05:46:03.228337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228124    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-envoy\") pod \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") "
Nov 04 05:46:03.228337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228162    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-credential-socket\") pod \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") "
Nov 04 05:46:03.228337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228181    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-kube-api-access-2ks59\" (UniqueName: \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-kube-api-access-2ks59\") pod \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") "
Nov 04 05:46:03.228337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228214    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-socket\") pod \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") "
Nov 04 05:46:03.228337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228253    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-podinfo\") pod \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\" (UID: \"870d4866-24fe-4fa0-89dc-63a5ed9b0e02\") "
Nov 04 05:46:03.228705 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228545    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-credential-socket" pod "870d4866-24fe-4fa0-89dc-63a5ed9b0e02" (UID: "870d4866-24fe-4fa0-89dc-63a5ed9b0e02"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.228841 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228816    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-certs" pod "870d4866-24fe-4fa0-89dc-63a5ed9b0e02" (UID: "870d4866-24fe-4fa0-89dc-63a5ed9b0e02"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.228914 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228850    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.228914 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228870    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.228914 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228884    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.228914 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228899    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228915    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7lfv\" (UniqueName: \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-kube-api-access-r7lfv\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228930    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228944    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228957    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228973    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdtrv\" (UniqueName: \"kubernetes.io/projected/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-kube-api-access-wdtrv\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.228987    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.229000    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.229013    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.229003    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-socket" pod "870d4866-24fe-4fa0-89dc-63a5ed9b0e02" (UID: "870d4866-24fe-4fa0-89dc-63a5ed9b0e02"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.229028    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44fe3523-7b6a-4fe9-b56c-35106a80a83e-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.229063    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.229083    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.229099    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.229114    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44fe3523-7b6a-4fe9-b56c-35106a80a83e-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.229761 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.229276    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-data" pod "870d4866-24fe-4fa0-89dc-63a5ed9b0e02" (UID: "870d4866-24fe-4fa0-89dc-63a5ed9b0e02"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.229761 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.229483    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istiod-ca-cert" pod "870d4866-24fe-4fa0-89dc-63a5ed9b0e02" (UID: "870d4866-24fe-4fa0-89dc-63a5ed9b0e02"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:03.231544 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.231482    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-envoy" pod "870d4866-24fe-4fa0-89dc-63a5ed9b0e02" (UID: "870d4866-24fe-4fa0-89dc-63a5ed9b0e02"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.231669 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.231613    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-podinfo" pod "870d4866-24fe-4fa0-89dc-63a5ed9b0e02" (UID: "870d4866-24fe-4fa0-89dc-63a5ed9b0e02"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:03.231669 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.231624    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-kube-api-access-2ks59" pod "870d4866-24fe-4fa0-89dc-63a5ed9b0e02" (UID: "870d4866-24fe-4fa0-89dc-63a5ed9b0e02"). InnerVolumeSpecName "kube-api-access-2ks59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.231669 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.231613    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-token" pod "870d4866-24fe-4fa0-89dc-63a5ed9b0e02" (UID: "870d4866-24fe-4fa0-89dc-63a5ed9b0e02"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.330543 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.330215    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-socket\") pod \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") "
Nov 04 05:46:03.331768 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.331734    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-kube-api-access-7cgm5\" (UniqueName: \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-kube-api-access-7cgm5\") pod \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") "
Nov 04 05:46:03.332237 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.332211    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-credential-socket\") pod \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") "
Nov 04 05:46:03.332347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.332271    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-envoy\") pod \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") "
Nov 04 05:46:03.332347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.332336    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-token\" (UniqueName: \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-token\") pod \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") "
Nov 04 05:46:03.332464 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.332420    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istiod-ca-cert\") pod \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") "
Nov 04 05:46:03.332464 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.332448    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-certs\") pod \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") "
Nov 04 05:46:03.333373 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.333336    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istiod-ca-cert" pod "e411b37f-4766-45c0-8c07-e2f5ee2e7780" (UID: "e411b37f-4766-45c0-8c07-e2f5ee2e7780"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:03.333619 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.333597    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-certs" pod "e411b37f-4766-45c0-8c07-e2f5ee2e7780" (UID: "e411b37f-4766-45c0-8c07-e2f5ee2e7780"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.333711 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.333668    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-socket" pod "e411b37f-4766-45c0-8c07-e2f5ee2e7780" (UID: "e411b37f-4766-45c0-8c07-e2f5ee2e7780"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.333711 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.333677    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-credential-socket" pod "e411b37f-4766-45c0-8c07-e2f5ee2e7780" (UID: "e411b37f-4766-45c0-8c07-e2f5ee2e7780"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.334244 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.332490    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-podinfo\") pod \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") "
Nov 04 05:46:03.334336 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.334287    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-data\") pod \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\" (UID: \"e411b37f-4766-45c0-8c07-e2f5ee2e7780\") "
Nov 04 05:46:03.334598 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.334575    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-data" pod "e411b37f-4766-45c0-8c07-e2f5ee2e7780" (UID: "e411b37f-4766-45c0-8c07-e2f5ee2e7780"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.335125 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335105    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.335255 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335241    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.335341 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335330    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.335422 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335412    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.335513 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335486    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.335614 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335601    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.335702 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335691    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.335782 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335770    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.335878 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335848    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.335878 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335867    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.336051 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335885    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ks59\" (UniqueName: \"kubernetes.io/projected/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-kube-api-access-2ks59\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.336051 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335902    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.336051 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.335917    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/870d4866-24fe-4fa0-89dc-63a5ed9b0e02-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.336310 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.336288    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-token" pod "e411b37f-4766-45c0-8c07-e2f5ee2e7780" (UID: "e411b37f-4766-45c0-8c07-e2f5ee2e7780"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.338219 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.338191    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-podinfo" pod "e411b37f-4766-45c0-8c07-e2f5ee2e7780" (UID: "e411b37f-4766-45c0-8c07-e2f5ee2e7780"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:03.339465 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.339433    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-kube-api-access-7cgm5" pod "e411b37f-4766-45c0-8c07-e2f5ee2e7780" (UID: "e411b37f-4766-45c0-8c07-e2f5ee2e7780"). InnerVolumeSpecName "kube-api-access-7cgm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:03.345917 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.345890    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-envoy" pod "e411b37f-4766-45c0-8c07-e2f5ee2e7780" (UID: "e411b37f-4766-45c0-8c07-e2f5ee2e7780"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:03.414104 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.413966    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"]
Nov 04 05:46:03.420857 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.420820    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-hwkqs"]
Nov 04 05:46:03.428763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.428731    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"]
Nov 04 05:46:03.434297 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.434268    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-qs2z5"]
Nov 04 05:46:03.436457 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.436436    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.436539 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.436460    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.436539 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.436471    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e411b37f-4766-45c0-8c07-e2f5ee2e7780-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:03.436539 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:03.436481    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cgm5\" (UniqueName: \"kubernetes.io/projected/e411b37f-4766-45c0-8c07-e2f5ee2e7780-kube-api-access-7cgm5\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.115621 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.115563    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v" event={"ID":"870d4866-24fe-4fa0-89dc-63a5ed9b0e02","Type":"ContainerDied","Data":"8ce9054e6b6693f6e687a35bd365d0ebad84e583f74510548ae3ae613fccf1aa"}
Nov 04 05:46:04.116117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.115671    5079 scope.go:122] "RemoveContainer" containerID="f1042fe5c408cc319ddb3c086eebe36ab2895805fe93049aa60b28bd1e4b46c8"
Nov 04 05:46:04.116117 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.115830    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"
Nov 04 05:46:04.128598 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.123150    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d" event={"ID":"e411b37f-4766-45c0-8c07-e2f5ee2e7780","Type":"ContainerDied","Data":"8d08d440076e82014bbdfb6159744597903d52595dbd576bbc2aa5b7746e3ec2"}
Nov 04 05:46:04.128598 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.123292    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"
Nov 04 05:46:04.134084 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.134042    5079 generic.go:356] "Generic (PLEG): container finished" podID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerID="900a79525ef91f12f7d9a77de4ac4bf0af9889aae1961a2fd1fad3ab4245362f" exitCode=0
Nov 04 05:46:04.134225 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.134144    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" event={"ID":"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340","Type":"ContainerDied","Data":"900a79525ef91f12f7d9a77de4ac4bf0af9889aae1961a2fd1fad3ab4245362f"}
Nov 04 05:46:04.134642 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.134620    5079 scope.go:122] "RemoveContainer" containerID="26ca1d79e1add96e135bee59359469a6214cc04f5e4b3bfd6e8e966edcfa3832"
Nov 04 05:46:04.136972 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.136947    5079 generic.go:356] "Generic (PLEG): container finished" podID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerID="f390cb41f41af142b91eaf546ce30aefd30b8cf586aee2fd26ffdd9fc03b4330" exitCode=0
Nov 04 05:46:04.137113 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.137031    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" event={"ID":"623e0836-ea01-418c-95a0-5027a0e7be4d","Type":"ContainerDied","Data":"f390cb41f41af142b91eaf546ce30aefd30b8cf586aee2fd26ffdd9fc03b4330"}
Nov 04 05:46:04.156089 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.156055    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"]
Nov 04 05:46:04.160804 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.160608    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-s9j5v"]
Nov 04 05:46:04.170702 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.170667    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"]
Nov 04 05:46:04.174565 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.174530    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-27935d-openshift-default-6cb57f858f-lhh7d"]
Nov 04 05:46:04.212347 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.212317    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:46:04.235702 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.235670    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:46:04.345814 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.345780    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-credential-socket\") pod \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") "
Nov 04 05:46:04.345814 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.345819    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-token\" (UniqueName: \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-token\") pod \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") "
Nov 04 05:46:04.346059 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.345852    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-podinfo\") pod \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") "
Nov 04 05:46:04.346059 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.345878    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-credential-socket\") pod \"623e0836-ea01-418c-95a0-5027a0e7be4d\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") "
Nov 04 05:46:04.346059 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.345922    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istiod-ca-cert\") pod \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") "
Nov 04 05:46:04.346059 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.345959    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-kube-api-access-rdhv6\" (UniqueName: \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-kube-api-access-rdhv6\") pod \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") "
Nov 04 05:46:04.346059 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.345988    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-envoy\") pod \"623e0836-ea01-418c-95a0-5027a0e7be4d\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") "
Nov 04 05:46:04.346059 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346036    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-podinfo\") pod \"623e0836-ea01-418c-95a0-5027a0e7be4d\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") "
Nov 04 05:46:04.346438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346083    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-token\" (UniqueName: \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-token\") pod \"623e0836-ea01-418c-95a0-5027a0e7be4d\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") "
Nov 04 05:46:04.346438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346113    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-data\") pod \"623e0836-ea01-418c-95a0-5027a0e7be4d\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") "
Nov 04 05:46:04.346438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346142    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-certs\") pod \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") "
Nov 04 05:46:04.346438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346135    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-credential-socket" pod "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" (UID: "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.346438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346211    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-socket\") pod \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") "
Nov 04 05:46:04.346438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346251    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-data\") pod \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") "
Nov 04 05:46:04.346438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346296    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/623e0836-ea01-418c-95a0-5027a0e7be4d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/623e0836-ea01-418c-95a0-5027a0e7be4d-istiod-ca-cert\") pod \"623e0836-ea01-418c-95a0-5027a0e7be4d\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") "
Nov 04 05:46:04.346438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346343    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-envoy\") pod \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\" (UID: \"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340\") "
Nov 04 05:46:04.346438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346359    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-credential-socket" pod "623e0836-ea01-418c-95a0-5027a0e7be4d" (UID: "623e0836-ea01-418c-95a0-5027a0e7be4d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.346438 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346385    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-certs\") pod \"623e0836-ea01-418c-95a0-5027a0e7be4d\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") "
Nov 04 05:46:04.346958 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346459    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-socket\") pod \"623e0836-ea01-418c-95a0-5027a0e7be4d\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") "
Nov 04 05:46:04.346958 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.346521    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-kube-api-access-xxkv6\" (UniqueName: \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-kube-api-access-xxkv6\") pod \"623e0836-ea01-418c-95a0-5027a0e7be4d\" (UID: \"623e0836-ea01-418c-95a0-5027a0e7be4d\") "
Nov 04 05:46:04.347085 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.347062    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.347149 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.347090    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.348430 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.347455    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istiod-ca-cert" pod "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" (UID: "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:04.348430 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.347821    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-data" pod "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" (UID: "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.348430 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.348005    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-data" pod "623e0836-ea01-418c-95a0-5027a0e7be4d" (UID: "623e0836-ea01-418c-95a0-5027a0e7be4d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.348430 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.348218    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-certs" pod "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" (UID: "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.348758 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.348464    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-socket" pod "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" (UID: "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.348758 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.348741    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-envoy" pod "623e0836-ea01-418c-95a0-5027a0e7be4d" (UID: "623e0836-ea01-418c-95a0-5027a0e7be4d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.348882 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.348777    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-token" pod "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" (UID: "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:04.348882 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.348786    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-podinfo" pod "623e0836-ea01-418c-95a0-5027a0e7be4d" (UID: "623e0836-ea01-418c-95a0-5027a0e7be4d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:04.348998 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.348963    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-certs" pod "623e0836-ea01-418c-95a0-5027a0e7be4d" (UID: "623e0836-ea01-418c-95a0-5027a0e7be4d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.349086 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.349061    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-socket" pod "623e0836-ea01-418c-95a0-5027a0e7be4d" (UID: "623e0836-ea01-418c-95a0-5027a0e7be4d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.349193 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.349150    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-podinfo" pod "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" (UID: "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:04.349255 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.349191    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/623e0836-ea01-418c-95a0-5027a0e7be4d-istiod-ca-cert" pod "623e0836-ea01-418c-95a0-5027a0e7be4d" (UID: "623e0836-ea01-418c-95a0-5027a0e7be4d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:04.349255 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.349224    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-kube-api-access-rdhv6" pod "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" (UID: "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340"). InnerVolumeSpecName "kube-api-access-rdhv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:04.349528 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.349481    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-kube-api-access-xxkv6" pod "623e0836-ea01-418c-95a0-5027a0e7be4d" (UID: "623e0836-ea01-418c-95a0-5027a0e7be4d"). InnerVolumeSpecName "kube-api-access-xxkv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:04.350030 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.350000    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-token" pod "623e0836-ea01-418c-95a0-5027a0e7be4d" (UID: "623e0836-ea01-418c-95a0-5027a0e7be4d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:04.350822 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.350800    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-envoy" pod "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" (UID: "94ce8b9d-5f15-4752-9bd7-d7dcc61b3340"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.448796 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448719    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.448796 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448747    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.448796 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448757    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdhv6\" (UniqueName: \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-kube-api-access-rdhv6\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.448796 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448771    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.448796 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448783    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.448796 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448793    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.448796 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448801    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.449114 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448810    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.449114 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448818    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.449114 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448826    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.449114 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448834    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/623e0836-ea01-418c-95a0-5027a0e7be4d-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.449114 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448843    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.449114 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448856    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.449114 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448869    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/623e0836-ea01-418c-95a0-5027a0e7be4d-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.449114 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448885    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxkv6\" (UniqueName: \"kubernetes.io/projected/623e0836-ea01-418c-95a0-5027a0e7be4d-kube-api-access-xxkv6\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.449114 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.448894    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.593670 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.593642    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:46:04.651294 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651259    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-credential-socket\") pod \"70210096-5533-4963-b4f4-853f998cc6bc\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") "
Nov 04 05:46:04.651482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651319    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/70210096-5533-4963-b4f4-853f998cc6bc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70210096-5533-4963-b4f4-853f998cc6bc-istiod-ca-cert\") pod \"70210096-5533-4963-b4f4-853f998cc6bc\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") "
Nov 04 05:46:04.651482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651368    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/70210096-5533-4963-b4f4-853f998cc6bc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70210096-5533-4963-b4f4-853f998cc6bc-istio-podinfo\") pod \"70210096-5533-4963-b4f4-853f998cc6bc\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") "
Nov 04 05:46:04.651482 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651468    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-socket\") pod \"70210096-5533-4963-b4f4-853f998cc6bc\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") "
Nov 04 05:46:04.651644 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651556    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-data\") pod \"70210096-5533-4963-b4f4-853f998cc6bc\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") "
Nov 04 05:46:04.651644 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651587    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-istio-token\" (UniqueName: \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-istio-token\") pod \"70210096-5533-4963-b4f4-853f998cc6bc\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") "
Nov 04 05:46:04.651644 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651617    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-envoy\") pod \"70210096-5533-4963-b4f4-853f998cc6bc\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") "
Nov 04 05:46:04.651804 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651652    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-certs\") pod \"70210096-5533-4963-b4f4-853f998cc6bc\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") "
Nov 04 05:46:04.651804 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651715    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-kube-api-access-c5kfh\" (UniqueName: \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-kube-api-access-c5kfh\") pod \"70210096-5533-4963-b4f4-853f998cc6bc\" (UID: \"70210096-5533-4963-b4f4-853f998cc6bc\") "
Nov 04 05:46:04.651907 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651609    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-credential-socket" pod "70210096-5533-4963-b4f4-853f998cc6bc" (UID: "70210096-5533-4963-b4f4-853f998cc6bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.652286 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.652260    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.652286 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651829    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70210096-5533-4963-b4f4-853f998cc6bc-istiod-ca-cert" pod "70210096-5533-4963-b4f4-853f998cc6bc" (UID: "70210096-5533-4963-b4f4-853f998cc6bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:04.652554 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651834    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-socket" pod "70210096-5533-4963-b4f4-853f998cc6bc" (UID: "70210096-5533-4963-b4f4-853f998cc6bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.652554 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.651845    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-data" pod "70210096-5533-4963-b4f4-853f998cc6bc" (UID: "70210096-5533-4963-b4f4-853f998cc6bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.652665 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.652574    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-certs" pod "70210096-5533-4963-b4f4-853f998cc6bc" (UID: "70210096-5533-4963-b4f4-853f998cc6bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.654421 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.654390    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70210096-5533-4963-b4f4-853f998cc6bc-istio-podinfo" pod "70210096-5533-4963-b4f4-853f998cc6bc" (UID: "70210096-5533-4963-b4f4-853f998cc6bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:04.654567 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.654493    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-envoy" pod "70210096-5533-4963-b4f4-853f998cc6bc" (UID: "70210096-5533-4963-b4f4-853f998cc6bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:04.654567 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.654545    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-kube-api-access-c5kfh" pod "70210096-5533-4963-b4f4-853f998cc6bc" (UID: "70210096-5533-4963-b4f4-853f998cc6bc"). InnerVolumeSpecName "kube-api-access-c5kfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:04.655390 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.655368    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-istio-token" pod "70210096-5533-4963-b4f4-853f998cc6bc" (UID: "70210096-5533-4963-b4f4-853f998cc6bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:04.753985 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.753892    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70210096-5533-4963-b4f4-853f998cc6bc-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.753985 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.753924    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70210096-5533-4963-b4f4-853f998cc6bc-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.753985 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.753937    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.753985 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.753946    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.753985 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.753955    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.753985 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.753963    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.753985 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.753988    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70210096-5533-4963-b4f4-853f998cc6bc-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:04.754371 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:04.754003    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5kfh\" (UniqueName: \"kubernetes.io/projected/70210096-5533-4963-b4f4-853f998cc6bc-kube-api-access-c5kfh\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:05.146717 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.146635    5079 generic.go:356] "Generic (PLEG): container finished" podID="70210096-5533-4963-b4f4-853f998cc6bc" containerID="dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17" exitCode=0
Nov 04 05:46:05.146717 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.146688    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"
Nov 04 05:46:05.147240 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.146726    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7" event={"ID":"70210096-5533-4963-b4f4-853f998cc6bc","Type":"ContainerDied","Data":"dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17"}
Nov 04 05:46:05.147240 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.146797    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7" event={"ID":"70210096-5533-4963-b4f4-853f998cc6bc","Type":"ContainerDied","Data":"43b879dcf8b03261e86d5d0eb319fa1043a47c6efe2ae3c4f97e1a59a5453329"}
Nov 04 05:46:05.147240 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.146831    5079 scope.go:122] "RemoveContainer" containerID="dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17"
Nov 04 05:46:05.149568 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.149543    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm" event={"ID":"94ce8b9d-5f15-4752-9bd7-d7dcc61b3340","Type":"ContainerDied","Data":"5faece7e54f05bd6ab39c37dbb973828400bb54574d336f65a59f74271c6c529"}
Nov 04 05:46:05.149745 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.149614    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"
Nov 04 05:46:05.151279 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.151260    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"
Nov 04 05:46:05.151381 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.151290    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7" event={"ID":"623e0836-ea01-418c-95a0-5027a0e7be4d","Type":"ContainerDied","Data":"849fec0ded064676b40a4a63df6f19793f8a0d3d68f1943cb814d0b5a8a25f75"}
Nov 04 05:46:05.166030 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.166001    5079 scope.go:122] "RemoveContainer" containerID="dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17"
Nov 04 05:46:05.166749 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:46:05.166722    5079 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17\": container with ID starting with dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17 not found: ID does not exist" containerID="dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17"
Nov 04 05:46:05.166841 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.166763    5079 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17"} err="failed to get container status \"dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17\": rpc error: code = NotFound desc = could not find container \"dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17\": container with ID starting with dcb7581e5cb338cb2349981ca38eddb9cff372bd01c94f048addcf15bad8ce17 not found: ID does not exist"
Nov 04 05:46:05.166841 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.166787    5079 scope.go:122] "RemoveContainer" containerID="900a79525ef91f12f7d9a77de4ac4bf0af9889aae1961a2fd1fad3ab4245362f"
Nov 04 05:46:05.179609 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.179581    5079 scope.go:122] "RemoveContainer" containerID="f390cb41f41af142b91eaf546ce30aefd30b8cf586aee2fd26ffdd9fc03b4330"
Nov 04 05:46:05.180320 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.180301    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"]
Nov 04 05:46:05.183805 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.183778    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-9d808e-openshift-default-54986c8d59-vtpv7"]
Nov 04 05:46:05.192183 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.192154    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"]
Nov 04 05:46:05.195559 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.195533    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-g4bbm"]
Nov 04 05:46:05.205543 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.205516    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"]
Nov 04 05:46:05.210925 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.210902    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f910f5-openshift-default-7fc8dc77d5-brwz7"]
Nov 04 05:46:05.299085 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.299049    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" path="/var/lib/kubelet/pods/44fe3523-7b6a-4fe9-b56c-35106a80a83e/volumes"
Nov 04 05:46:05.299597 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.299576    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" path="/var/lib/kubelet/pods/623e0836-ea01-418c-95a0-5027a0e7be4d/volumes"
Nov 04 05:46:05.300058 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.300040    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="70210096-5533-4963-b4f4-853f998cc6bc" path="/var/lib/kubelet/pods/70210096-5533-4963-b4f4-853f998cc6bc/volumes"
Nov 04 05:46:05.300861 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.300840    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" path="/var/lib/kubelet/pods/870d4866-24fe-4fa0-89dc-63a5ed9b0e02/volumes"
Nov 04 05:46:05.301272 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.301260    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" path="/var/lib/kubelet/pods/94ce8b9d-5f15-4752-9bd7-d7dcc61b3340/volumes"
Nov 04 05:46:05.301706 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.301693    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" path="/var/lib/kubelet/pods/bbf2963f-1201-4fcc-afe4-e2c6d6e389a6/volumes"
Nov 04 05:46:05.302402 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:05.302388    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" path="/var/lib/kubelet/pods/e411b37f-4766-45c0-8c07-e2f5ee2e7780/volumes"
Nov 04 05:46:10.260658 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:46:10.260620    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache]"
Nov 04 05:46:12.233067 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:46:12.233020    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache]"
Nov 04 05:46:13.086353 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:13.086322    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-jfdzn_8e42d496-8250-4c50-ad2b-8ad68b603fd5/server/0.log"
Nov 04 05:46:13.278083 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:13.278043    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-qrwmn_732ab79a-2426-4dab-a1ba-e1e12c5ab51b/manager/0.log"
Nov 04 05:46:14.810309 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:14.810277    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-25dd93bf-8zbsp_f1a5fcbf-d991-4394-a8b8-738e05834b0b/revoke-keys/0.log"
Nov 04 05:46:14.978142 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:14.978110    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3d8b0bd4-r84p7_20482451-096b-4110-b818-baa7fd3a4042/revoke-keys/0.log"
Nov 04 05:46:15.167600 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:15.167522    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3dff2ea7-c6xcz_f995d94d-abb9-46ae-9398-7f2507a2dc3b/revoke-keys/0.log"
Nov 04 05:46:15.527355 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:15.527315    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6aeadf02-q2dnz_a626a041-2890-4f6c-b703-16c0eb761f04/revoke-keys/0.log"
Nov 04 05:46:15.701110 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:15.701079    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-71199809-hjkw7_70eab7c8-032d-4542-a906-ad1bcdd9dc17/revoke-keys/0.log"
Nov 04 05:46:15.780287 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:15.780201    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:46:16.041717 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:16.041639    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-94658290-8vppk_22713897-972b-44f4-bc1f-5d0786f45dae/revoke-keys/0.log"
Nov 04 05:46:16.214091 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:16.214057    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-a24ab2f5-l6mwl_b3a881d7-3de2-416c-a6a2-2a9503249471/revoke-keys/0.log"
Nov 04 05:46:16.397751 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:16.397670    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-ab03cae5-6dmpb_61ffb3be-0163-44ae-a52d-3c14379a6f5b/revoke-keys/0.log"
Nov 04 05:46:16.658764 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:46:16.658661    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:46:16.740979 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:16.740948    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-cb56d506-fl25h_04a4ca71-22c5-4bc3-9bc3-4dcda28c2472/revoke-keys/0.log"
Nov 04 05:46:16.935771 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:16.935742    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-e3392fc5-6r58z_344436f0-10e1-4ec1-a5e2-944e957ca7ad/revoke-keys/0.log"
Nov 04 05:46:17.119256 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:17.119226    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-e76d4112-zgmv6_a9c373d8-8502-4663-8fe2-998e13b32f64/revoke-keys/0.log"
Nov 04 05:46:19.155619 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:19.155585    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58f5b47bf6-c4rt8_b1d03acd-2d0f-4053-a284-031b589768e2/authorino/0.log"
Nov 04 05:46:19.351325 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:19.351295    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-pfgtk_332adc32-bf35-47e2-ae29-4eaf1bcef74a/manager/0.log"
Nov 04 05:46:19.531042 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:19.531013    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-pfrmk_cc28d785-961f-4cc6-8346-a9439d7dfa7d/manager/0.log"
Nov 04 05:46:20.325580 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:46:20.325544    5079 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice/crio-2e2d07da3520be3e624419dad16929b6c9be6270f8a25cabb83491e6340c3b04\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad1f6bc_3194_46b3_bab1_6182c6534597.slice\": RecentStats: unable to find data in memory cache]"
Nov 04 05:46:20.486770 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:20.486740    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-qq5sn_9975e9d8-c75c-4088-9750-aa17233fc931/manager/0.log"
Nov 04 05:46:20.730284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:20.730253    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-dqbgz_11975d98-03f4-44e2-9c6a-ada5d2b9f4ab/limitador/0.log"
Nov 04 05:46:20.915087 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:20.915047    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-sgjcg_f1e10797-fe13-4d1b-99d1-f45d6ea59671/manager/0.log"
Nov 04 05:46:21.860875 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:21.860841    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-c4c65fbf-dllds_03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a/istio-proxy/0.log"
Nov 04 05:46:22.223483 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:22.223442    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-c687j_e442681a-66b1-4f8b-930a-267fa563d3f2/discovery/0.log"
Nov 04 05:46:22.753140 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:22.753107    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-29554_c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9/istio-proxy/0.log"
Nov 04 05:46:22.927129 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:22.927099    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-49xlm_c5caedfb-913d-4da3-ac56-23844cad0558/istio-proxy/0.log"
Nov 04 05:46:23.300342 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:23.300310    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6m8sf_ffe94fbe-c512-43cf-976f-f64c6dc2c358/istio-proxy/1.log"
Nov 04 05:46:24.099318 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:24.099281    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"]
Nov 04 05:46:24.099873 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:24.099514    5079 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerName="istio-proxy" containerID="cri-o://51957645f64388ecd298c90372c0482dc77effc3018851e90572117f939be913" gracePeriod=30
Nov 04 05:46:24.177251 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:24.177215    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-vbkzk_c3be71ef-7da5-4d37-972e-e62a7ef9a8ba/istio-proxy/0.log"
Nov 04 05:46:24.539336 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:24.539300    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc_4fee91e3-f9b7-4de9-9ec0-ac215dbca143/istio-proxy/0.log"
Nov 04 05:46:24.722792 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:24.722759    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w9hd8_5e007401-e826-4127-af45-411d29d3fd97/payload-pre-processing/0.log"
Nov 04 05:46:24.896876 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:24.896794    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-l8b4p_4d6dbed6-4d50-4d61-bb77-b907c1440446/payload-processing/0.log"
Nov 04 05:46:25.072831 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:25.072795    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d8999f8d7-rwnj7_3024b38f-4b25-45ec-8a49-40a3859ca462/router/0.log"
Nov 04 05:46:25.699253 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:25.699222    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6m8sf_ffe94fbe-c512-43cf-976f-f64c6dc2c358/istio-proxy/0.log"
Nov 04 05:46:26.216894 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:26.216862    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p_769d7484-a452-422e-9966-3a0b2d3142ba/main/0.log"
Nov 04 05:46:26.574323 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:26.574233    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-g8l57_21870e7a-ac3d-432e-af7f-96b33002f7f5/main/0.log"
Nov 04 05:46:26.743021 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:26.742987    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-j56jh_b88e9ac9-df69-4b39-ba8a-62a91f0402b1/main/0.log"
Nov 04 05:46:26.904789 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:26.904704    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj_1be94026-28dc-4059-94c4-77b63205298a/main/0.log"
Nov 04 05:46:28.531603 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:28.531566    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58f5b47bf6-c4rt8_b1d03acd-2d0f-4053-a284-031b589768e2/authorino/0.log"
Nov 04 05:46:29.324823 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.324793    5079 generic.go:356] "Generic (PLEG): container finished" podID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerID="51957645f64388ecd298c90372c0482dc77effc3018851e90572117f939be913" exitCode=0
Nov 04 05:46:29.325065 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.324829    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" event={"ID":"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9","Type":"ContainerDied","Data":"51957645f64388ecd298c90372c0482dc77effc3018851e90572117f939be913"}
Nov 04 05:46:29.353888 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.353853    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:46:29.403032 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.402935    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-podinfo\") pod \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") "
Nov 04 05:46:29.403032 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.402999    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istiod-ca-cert\") pod \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") "
Nov 04 05:46:29.403284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403062    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-socket\") pod \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") "
Nov 04 05:46:29.403284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403089    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-token\" (UniqueName: \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-token\") pod \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") "
Nov 04 05:46:29.403284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403121    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-data\") pod \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") "
Nov 04 05:46:29.403284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403169    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-certs\") pod \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") "
Nov 04 05:46:29.403284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403216    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-envoy\") pod \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") "
Nov 04 05:46:29.403284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403255    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-credential-socket\") pod \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") "
Nov 04 05:46:29.403631 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403288    5079 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-kube-api-access-d2p4b\" (UniqueName: \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-kube-api-access-d2p4b\") pod \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\" (UID: \"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9\") "
Nov 04 05:46:29.403631 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403380    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-socket" pod "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" (UID: "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:29.403631 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403478    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istiod-ca-cert" pod "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" (UID: "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 05:46:29.403905 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403848    5079 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istiod-ca-cert\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:29.403905 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403879    5079 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:29.403905 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403877    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-data" pod "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" (UID: "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:29.404148 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.403936    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-certs" pod "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" (UID: "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:29.404148 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.404088    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-credential-socket" pod "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" (UID: "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:29.405591 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.405569    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-kube-api-access-d2p4b" pod "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" (UID: "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9"). InnerVolumeSpecName "kube-api-access-d2p4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:29.405845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.405828    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-token" pod "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" (UID: "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 05:46:29.406034 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.406017    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-podinfo" pod "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" (UID: "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 05:46:29.406110 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.406086    5079 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-envoy" pod "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" (UID: "c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 05:46:29.505021 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.504998    5079 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-token\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:29.505103 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.505024    5079 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-data\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:29.505103 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.505035    5079 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-workload-certs\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:29.505103 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.505047    5079 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-envoy\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:29.505103 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.505057    5079 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-credential-socket\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:29.505103 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.505066    5079 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2p4b\" (UniqueName: \"kubernetes.io/projected/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-kube-api-access-d2p4b\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:29.505103 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:29.505076    5079 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9-istio-podinfo\") on node \"ip-10-0-141-135.us-east-2.compute.internal\" DevicePath \"\""
Nov 04 05:46:30.333260 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:30.333227    5079 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"
Nov 04 05:46:30.333260 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:30.333242    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554" event={"ID":"c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9","Type":"ContainerDied","Data":"6eb8f93f5e420080c5b265dcf14881a0e95b1e0d27ff8945c0085feb5b48e3dd"}
Nov 04 05:46:30.333796 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:30.333316    5079 scope.go:122] "RemoveContainer" containerID="51957645f64388ecd298c90372c0482dc77effc3018851e90572117f939be913"
Nov 04 05:46:30.360135 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:30.360106    5079 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"]
Nov 04 05:46:30.362640 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:30.362618    5079 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-694db55c87-29554"]
Nov 04 05:46:31.296697 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:31.296661    5079 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" path="/var/lib/kubelet/pods/c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9/volumes"
Nov 04 05:46:38.490550 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:38.490492    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-jfdzn_8e42d496-8250-4c50-ad2b-8ad68b603fd5/server/0.log"
Nov 04 05:46:38.656765 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:38.656729    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-qrwmn_732ab79a-2426-4dab-a1ba-e1e12c5ab51b/manager/0.log"
Nov 04 05:46:39.587548 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:39.587490    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-25dd93bf-8zbsp_f1a5fcbf-d991-4394-a8b8-738e05834b0b/revoke-keys/0.log"
Nov 04 05:46:39.751097 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:39.751072    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3d8b0bd4-r84p7_20482451-096b-4110-b818-baa7fd3a4042/revoke-keys/0.log"
Nov 04 05:46:39.925284 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:39.925259    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3dff2ea7-c6xcz_f995d94d-abb9-46ae-9398-7f2507a2dc3b/revoke-keys/0.log"
Nov 04 05:46:40.265053 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:40.264957    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6aeadf02-q2dnz_a626a041-2890-4f6c-b703-16c0eb761f04/revoke-keys/0.log"
Nov 04 05:46:40.424283 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:40.424254    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-71199809-hjkw7_70eab7c8-032d-4542-a906-ad1bcdd9dc17/revoke-keys/0.log"
Nov 04 05:46:40.750470 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:40.750443    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-94658290-8vppk_22713897-972b-44f4-bc1f-5d0786f45dae/revoke-keys/0.log"
Nov 04 05:46:40.928096 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:40.928061    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-a24ab2f5-l6mwl_b3a881d7-3de2-416c-a6a2-2a9503249471/revoke-keys/0.log"
Nov 04 05:46:41.097781 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:41.097690    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-ab03cae5-6dmpb_61ffb3be-0163-44ae-a52d-3c14379a6f5b/revoke-keys/0.log"
Nov 04 05:46:41.453138 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:41.453112    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-cb56d506-fl25h_04a4ca71-22c5-4bc3-9bc3-4dcda28c2472/revoke-keys/0.log"
Nov 04 05:46:41.625682 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:41.625654    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-e3392fc5-6r58z_344436f0-10e1-4ec1-a5e2-944e957ca7ad/revoke-keys/0.log"
Nov 04 05:46:41.791385 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:41.791303    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-e76d4112-zgmv6_a9c373d8-8502-4663-8fe2-998e13b32f64/revoke-keys/0.log"
Nov 04 05:46:43.061348 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:43.061309    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58f5b47bf6-c4rt8_b1d03acd-2d0f-4053-a284-031b589768e2/authorino/0.log"
Nov 04 05:46:43.259441 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:43.259387    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-pfgtk_332adc32-bf35-47e2-ae29-4eaf1bcef74a/manager/0.log"
Nov 04 05:46:43.445519 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:43.445471    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-pfrmk_cc28d785-961f-4cc6-8346-a9439d7dfa7d/manager/0.log"
Nov 04 05:46:43.818527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:43.818419    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-qq5sn_9975e9d8-c75c-4088-9750-aa17233fc931/manager/0.log"
Nov 04 05:46:44.035243 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:44.035210    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-dqbgz_11975d98-03f4-44e2-9c6a-ada5d2b9f4ab/limitador/0.log"
Nov 04 05:46:44.233627 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:44.233587    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-sgjcg_f1e10797-fe13-4d1b-99d1-f45d6ea59671/manager/0.log"
Nov 04 05:46:44.789949 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:44.789905    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-c4c65fbf-dllds_03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a/istio-proxy/0.log"
Nov 04 05:46:45.178975 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:45.178943    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-c687j_e442681a-66b1-4f8b-930a-267fa563d3f2/discovery/0.log"
Nov 04 05:46:45.745262 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:45.745230    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-49xlm_c5caedfb-913d-4da3-ac56-23844cad0558/istio-proxy/0.log"
Nov 04 05:46:46.140800 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:46.140715    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6m8sf_ffe94fbe-c512-43cf-976f-f64c6dc2c358/istio-proxy/1.log"
Nov 04 05:46:46.656897 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:46:46.656860    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:46:47.025097 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:47.025060    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-vbkzk_c3be71ef-7da5-4d37-972e-e62a7ef9a8ba/istio-proxy/0.log"
Nov 04 05:46:47.369462 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:47.369375    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc_4fee91e3-f9b7-4de9-9ec0-ac215dbca143/istio-proxy/0.log"
Nov 04 05:46:47.548085 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:47.548057    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w9hd8_5e007401-e826-4127-af45-411d29d3fd97/payload-pre-processing/0.log"
Nov 04 05:46:47.726979 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:47.726949    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-l8b4p_4d6dbed6-4d50-4d61-bb77-b907c1440446/payload-processing/0.log"
Nov 04 05:46:47.913915 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:47.913884    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d8999f8d7-rwnj7_3024b38f-4b25-45ec-8a49-40a3859ca462/router/0.log"
Nov 04 05:46:48.455531 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:48.455474    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-7wl2p_769d7484-a452-422e-9966-3a0b2d3142ba/main/0.log"
Nov 04 05:46:48.828144 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:48.828055    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-g8l57_21870e7a-ac3d-432e-af7f-96b33002f7f5/main/0.log"
Nov 04 05:46:49.008837 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:49.008805    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-j56jh_b88e9ac9-df69-4b39-ba8a-62a91f0402b1/main/0.log"
Nov 04 05:46:49.197643 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:46:49.197612    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j28pj_1be94026-28dc-4059-94c4-77b63205298a/main/0.log"
Nov 04 05:47:06.089457 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:06.089374    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:47:14.237776 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:14.237735    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-l8b4p_4d6dbed6-4d50-4d61-bb77-b907c1440446/payload-processing/0.log"
Nov 04 05:47:14.406743 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:14.406712    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-l8b4p_4d6dbed6-4d50-4d61-bb77-b907c1440446/payload-processing/0.log"
Nov 04 05:47:15.817664 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:15.817632    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:47:16.657322 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:47:16.657284    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:47:46.658277 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:47:46.658237    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:47:50.966596 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:50.966549    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:47:51.736287 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:51.736255    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-l8b4p_4d6dbed6-4d50-4d61-bb77-b907c1440446/payload-processing/0.log"
Nov 04 05:47:51.916072 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:51.916036    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-l8b4p_4d6dbed6-4d50-4d61-bb77-b907c1440446/payload-processing/0.log"
Nov 04 05:47:52.232248 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:52.232204    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:47:52.313657 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:52.313617    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:47:55.262374 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:55.262348    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tgz7l_9ba6f7a7-c835-4c2b-8e17-32015f629d52/global-pull-secret-syncer/0.log"
Nov 04 05:47:55.301297 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:55.301272    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-2z628_f20a6d3d-6645-4b3a-af29-0c208025ddda/connection-checker/0.log"
Nov 04 05:47:55.325238 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:55.325208    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-bsk42_6b1bfba7-f83b-46fc-b06b-2a736bad505f/connection-checker/0.log"
Nov 04 05:47:55.350246 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:55.350219    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-sh897_40a2fd4e-7382-4886-8853-15b7387a53b3/connection-checker/0.log"
Nov 04 05:47:55.390355 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:55.390321    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log"
Nov 04 05:47:55.523814 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:55.523734    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-135.us-east-2.compute.internal_ebe8f4db5b3dfd0d97b0792740b3bd94/haproxy/0.log"
Nov 04 05:47:58.756423 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:47:58.756388    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:48:02.262201 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:02.262159    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58f5b47bf6-c4rt8_b1d03acd-2d0f-4053-a284-031b589768e2/authorino/0.log"
Nov 04 05:48:02.293142 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:02.293109    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-pfgtk_332adc32-bf35-47e2-ae29-4eaf1bcef74a/manager/0.log"
Nov 04 05:48:02.325236 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:02.325205    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-pfrmk_cc28d785-961f-4cc6-8346-a9439d7dfa7d/manager/0.log"
Nov 04 05:48:02.620784 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:02.620686    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-qq5sn_9975e9d8-c75c-4088-9750-aa17233fc931/manager/0.log"
Nov 04 05:48:02.648090 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:02.648063    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-dqbgz_11975d98-03f4-44e2-9c6a-ada5d2b9f4ab/limitador/0.log"
Nov 04 05:48:02.702586 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:02.702555    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-sgjcg_f1e10797-fe13-4d1b-99d1-f45d6ea59671/manager/0.log"
Nov 04 05:48:03.957716 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:03.957681    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-mxz59_907d151f-d95c-40e6-95af-4198aec88c33/cluster-monitoring-operator/0.log"
Nov 04 05:48:04.124163 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.124136    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctncw_f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3/node-exporter/0.log"
Nov 04 05:48:04.145960 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.145931    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctncw_f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3/kube-rbac-proxy/0.log"
Nov 04 05:48:04.168693 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.168669    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctncw_f0ba30ae-b6c3-47aa-b9b2-67fb361f7bd3/init-textfile/0.log"
Nov 04 05:48:04.391069 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.390993    5079 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"]
Nov 04 05:48:04.391562 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391545    5079 cpu_manager.go:414] "containerMap: removing container" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy"
Nov 04 05:48:04.391616 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391563    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy"
Nov 04 05:48:04.391616 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391575    5079 cpu_manager.go:414] "containerMap: removing container" podUID="9934b5bc-40dd-42f6-b4e5-5b2843bc5a60" containerName="payload-processing"
Nov 04 05:48:04.391616 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391581    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9934b5bc-40dd-42f6-b4e5-5b2843bc5a60" containerName="payload-processing"
Nov 04 05:48:04.391616 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391591    5079 cpu_manager.go:414] "containerMap: removing container" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerName="istio-proxy"
Nov 04 05:48:04.391616 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391596    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerName="istio-proxy"
Nov 04 05:48:04.391616 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391612    5079 cpu_manager.go:414] "containerMap: removing container" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy"
Nov 04 05:48:04.391616 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391618    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391626    5079 cpu_manager.go:414] "containerMap: removing container" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391631    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391644    5079 cpu_manager.go:414] "containerMap: removing container" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391649    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391656    5079 cpu_manager.go:414] "containerMap: removing container" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391660    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391670    5079 cpu_manager.go:414] "containerMap: removing container" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391675    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391682    5079 cpu_manager.go:414] "containerMap: removing container" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391686    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391694    5079 cpu_manager.go:414] "containerMap: removing container" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391698    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391706    5079 cpu_manager.go:414] "containerMap: removing container" podUID="3f9ca4aa-f1a8-455a-98e2-11942289e9ec" containerName="payload-pre-processing"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391711    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f9ca4aa-f1a8-455a-98e2-11942289e9ec" containerName="payload-pre-processing"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391719    5079 cpu_manager.go:414] "containerMap: removing container" podUID="70210096-5533-4963-b4f4-853f998cc6bc" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391723    5079 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="70210096-5533-4963-b4f4-853f998cc6bc" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391793    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="623e0836-ea01-418c-95a0-5027a0e7be4d" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391802    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f9ca4aa-f1a8-455a-98e2-11942289e9ec" containerName="payload-pre-processing"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391808    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="70210096-5533-4963-b4f4-853f998cc6bc" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391816    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391823    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="9934b5bc-40dd-42f6-b4e5-5b2843bc5a60" containerName="payload-processing"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391828    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="94ce8b9d-5f15-4752-9bd7-d7dcc61b3340" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391835    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="bbf2963f-1201-4fcc-afe4-e2c6d6e389a6" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391841    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391847    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="e411b37f-4766-45c0-8c07-e2f5ee2e7780" containerName="istio-proxy"
Nov 04 05:48:04.391845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391852    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="870d4866-24fe-4fa0-89dc-63a5ed9b0e02" containerName="istio-proxy"
Nov 04 05:48:04.392617 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391859    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="44fe3523-7b6a-4fe9-b56c-35106a80a83e" containerName="istio-proxy"
Nov 04 05:48:04.392617 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.391865    5079 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0bff93b-b1b8-4041-a5a4-0ffcc2cf02e9" containerName="istio-proxy"
Nov 04 05:48:04.394682 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.394665    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.405553 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.405529    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"]
Nov 04 05:48:04.451337 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.451298    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrfcm\" (UniqueName: \"kubernetes.io/projected/8e99b62d-e248-421a-a5cf-0b495b9c5156-kube-api-access-vrfcm\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.451579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.451349    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-podres\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.451579 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.451560    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-proc\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.451720 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.451603    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-lib-modules\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.451763 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.451728    5079 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-sys\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.490527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.490467    5079 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z96kl\"/\"default-dockercfg-8kdm5\""
Nov 04 05:48:04.490527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.490479    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z96kl\"/\"openshift-service-ca.crt\""
Nov 04 05:48:04.490527 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.490526    5079 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z96kl\"/\"kube-root-ca.crt\""
Nov 04 05:48:04.552280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.552240    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrfcm\" (UniqueName: \"kubernetes.io/projected/8e99b62d-e248-421a-a5cf-0b495b9c5156-kube-api-access-vrfcm\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.552280 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.552288    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-podres\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.552577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.552343    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-proc\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.552577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.552361    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-lib-modules\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.552577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.552443    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-podres\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.552577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.552452    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-lib-modules\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.552577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.552453    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-proc\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.552577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.552475    5079 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-sys\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.552577 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.552571    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e99b62d-e248-421a-a5cf-0b495b9c5156-sys\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.560296 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.560262    5079 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrfcm\" (UniqueName: \"kubernetes.io/projected/8e99b62d-e248-421a-a5cf-0b495b9c5156-kube-api-access-vrfcm\") pod \"perf-node-gather-daemonset-jl46j\" (UID: \"8e99b62d-e248-421a-a5cf-0b495b9c5156\") " pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.708155 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.708121    5079 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:04.994145 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:04.994119    5079 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"]
Nov 04 05:48:05.908790 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:05.908749    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j" event={"ID":"8e99b62d-e248-421a-a5cf-0b495b9c5156","Type":"ContainerStarted","Data":"f4389609b595c191d44b6719423c4cf43db1e2981bd76b4c78842e0123b10f69"}
Nov 04 05:48:05.908973 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:05.908803    5079 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j" event={"ID":"8e99b62d-e248-421a-a5cf-0b495b9c5156","Type":"ContainerStarted","Data":"b0ec4d0d581a2af217dfaaab2d4f5a2901a5124aee69c4231bf4f976d869847c"}
Nov 04 05:48:05.908973 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:05.908846    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:05.925843 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:05.925791    5079 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j" podStartSLOduration=1.925775939 podStartE2EDuration="1.925775939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:48:05.923224208 +0000 UTC m=+1180.781212038" watchObservedRunningTime="2026-11-04 05:48:05.925775939 +0000 UTC m=+1180.783763802"
Nov 04 05:48:06.271877 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:06.271845    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-8dsn9_41a1a23a-cfae-43f1-b639-b30b4448ea40/networking-console-plugin/0.log"
Nov 04 05:48:06.789574 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:06.789542    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/1.log"
Nov 04 05:48:06.798194 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:06.798154    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-jvwgz_8e7e37c2-a915-457b-a553-b53f25aaba42/console-operator/2.log"
Nov 04 05:48:07.827830 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:07.827796    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-7gnk7_08f68bfa-5fe7-4cc2-a833-9f0c72871994/volume-data-source-validator/0.log"
Nov 04 05:48:08.934865 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:08.934817    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dqblv_a2a942cf-93c8-445a-b6b6-cbda93d99210/dns/0.log"
Nov 04 05:48:08.958023 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:08.957983    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dqblv_a2a942cf-93c8-445a-b6b6-cbda93d99210/kube-rbac-proxy/0.log"
Nov 04 05:48:09.083138 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:09.083113    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zgr4j_e02ac97f-6e15-4540-8b31-a7208f55217a/dns-node-resolver/0.log"
Nov 04 05:48:09.673331 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:09.673299    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j2n64_8dd81a50-cf93-4c73-a2cf-793fee04c292/node-ca/0.log"
Nov 04 05:48:10.670620 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:10.670591    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-c4c65fbf-dllds_03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a/istio-proxy/0.log"
Nov 04 05:48:11.368223 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:11.368189    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-c687j_e442681a-66b1-4f8b-930a-267fa563d3f2/discovery/0.log"
Nov 04 05:48:11.466909 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:11.466879    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-49xlm_c5caedfb-913d-4da3-ac56-23844cad0558/istio-proxy/0.log"
Nov 04 05:48:11.579552 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:11.579513    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6m8sf_ffe94fbe-c512-43cf-976f-f64c6dc2c358/istio-proxy/0.log"
Nov 04 05:48:11.580234 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:11.580196    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6m8sf_ffe94fbe-c512-43cf-976f-f64c6dc2c358/istio-proxy/1.log"
Nov 04 05:48:11.725385 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:11.725342    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-vbkzk_c3be71ef-7da5-4d37-972e-e62a7ef9a8ba/istio-proxy/0.log"
Nov 04 05:48:11.778978 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:11.778946    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc_4fee91e3-f9b7-4de9-9ec0-ac215dbca143/istio-proxy/0.log"
Nov 04 05:48:11.803457 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:11.803430    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w9hd8_5e007401-e826-4127-af45-411d29d3fd97/payload-pre-processing/0.log"
Nov 04 05:48:11.827661 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:11.827625    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-l8b4p_4d6dbed6-4d50-4d61-bb77-b907c1440446/payload-processing/0.log"
Nov 04 05:48:11.855654 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:11.855628    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d8999f8d7-rwnj7_3024b38f-4b25-45ec-8a49-40a3859ca462/router/0.log"
Nov 04 05:48:11.925606 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:11.925575    5079 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z96kl/perf-node-gather-daemonset-jl46j"
Nov 04 05:48:12.929235 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:12.929206    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qfz8d_c7b2d156-2b78-4114-9980-8543ed070a9a/serve-healthcheck-canary/0.log"
Nov 04 05:48:13.398078 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:13.397993    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-5skd7_5794b522-36b9-4e80-b852-deff2905e1c7/insights-operator/0.log"
Nov 04 05:48:13.399005 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:13.398981    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-5skd7_5794b522-36b9-4e80-b852-deff2905e1c7/insights-operator/1.log"
Nov 04 05:48:13.421092 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:13.421064    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m8zlm_4952ed47-5e12-468b-9b7a-12566b6cffa5/kube-rbac-proxy/0.log"
Nov 04 05:48:13.443357 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:13.443328    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m8zlm_4952ed47-5e12-468b-9b7a-12566b6cffa5/exporter/0.log"
Nov 04 05:48:13.467207 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:13.467179    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m8zlm_4952ed47-5e12-468b-9b7a-12566b6cffa5/extractor/0.log"
Nov 04 05:48:13.656380 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:13.656289    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-6nbrq-l9jvf_2ecc44fb-b2c4-408f-8d31-860181ce53b7/insights-gathering/0.log"
Nov 04 05:48:14.773646 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:14.773614    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-c4c65fbf-dllds_03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a/istio-proxy/0.log"
Nov 04 05:48:15.012493 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:15.012459    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:48:15.457660 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:15.457626    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-c687j_e442681a-66b1-4f8b-930a-267fa563d3f2/discovery/0.log"
Nov 04 05:48:15.508444 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:15.508410    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-49xlm_c5caedfb-913d-4da3-ac56-23844cad0558/istio-proxy/0.log"
Nov 04 05:48:15.550572 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:15.550539    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6m8sf_ffe94fbe-c512-43cf-976f-f64c6dc2c358/istio-proxy/0.log"
Nov 04 05:48:15.551323 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:15.551287    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6m8sf_ffe94fbe-c512-43cf-976f-f64c6dc2c358/istio-proxy/1.log"
Nov 04 05:48:15.619462 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:15.619431    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-vbkzk_c3be71ef-7da5-4d37-972e-e62a7ef9a8ba/istio-proxy/0.log"
Nov 04 05:48:15.651747 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:15.651712    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc_4fee91e3-f9b7-4de9-9ec0-ac215dbca143/istio-proxy/0.log"
Nov 04 05:48:15.667381 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:15.667351    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w9hd8_5e007401-e826-4127-af45-411d29d3fd97/payload-pre-processing/0.log"
Nov 04 05:48:15.685965 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:15.685936    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-l8b4p_4d6dbed6-4d50-4d61-bb77-b907c1440446/payload-processing/0.log"
Nov 04 05:48:15.706374 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:15.706346    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d8999f8d7-rwnj7_3024b38f-4b25-45ec-8a49-40a3859ca462/router/0.log"
Nov 04 05:48:16.392630 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:16.392587    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-56cd9ffd8-nfw2h_e721b740-6386-42e4-a1fb-dfbc1137928a/manager/0.log"
Nov 04 05:48:16.413143 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:16.413117    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-56cd9ffd8-nfw2h_e721b740-6386-42e4-a1fb-dfbc1137928a/copy-manifests/0.log"
Nov 04 05:48:16.617805 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:16.617767    5079 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bcklp_8ed3306b-cf7a-4c8a-9d8d-8a9db2bc64bb/konnectivity-agent/0.log" limit=1024
Nov 04 05:48:16.659418 ip-10-0-141-135 kubenswrapper[5079]: E1104 05:48:16.659328    5079 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-m8zlm" containerName="extractor"
Nov 04 05:48:17.342604 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:17.342579    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-c4c65fbf-dllds_03592be9-67c3-46ca-b3c0-dc6ca7f5ac2a/istio-proxy/0.log"
Nov 04 05:48:18.053547 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:18.053496    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-c687j_e442681a-66b1-4f8b-930a-267fa563d3f2/discovery/0.log"
Nov 04 05:48:18.094845 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:18.094816    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-49xlm_c5caedfb-913d-4da3-ac56-23844cad0558/istio-proxy/0.log"
Nov 04 05:48:18.133617 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:18.133580    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6m8sf_ffe94fbe-c512-43cf-976f-f64c6dc2c358/istio-proxy/0.log"
Nov 04 05:48:18.134321 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:18.134300    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-6m8sf_ffe94fbe-c512-43cf-976f-f64c6dc2c358/istio-proxy/1.log"
Nov 04 05:48:18.199962 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:18.199933    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-694db55c87-vbkzk_c3be71ef-7da5-4d37-972e-e62a7ef9a8ba/istio-proxy/0.log"
Nov 04 05:48:18.233753 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:18.233723    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-856cdd999f-7g9zc_4fee91e3-f9b7-4de9-9ec0-ac215dbca143/istio-proxy/0.log"
Nov 04 05:48:18.247159 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:18.247142    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w9hd8_5e007401-e826-4127-af45-411d29d3fd97/payload-pre-processing/0.log"
Nov 04 05:48:18.261729 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:18.261709    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-l8b4p_4d6dbed6-4d50-4d61-bb77-b907c1440446/payload-processing/0.log"
Nov 04 05:48:18.281155 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:18.281131    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d8999f8d7-rwnj7_3024b38f-4b25-45ec-8a49-40a3859ca462/router/0.log"
Nov 04 05:48:18.755940 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:18.755912    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-jfdzn_8e42d496-8250-4c50-ad2b-8ad68b603fd5/server/0.log"
Nov 04 05:48:19.088877 ip-10-0-141-135 kubenswrapper[5079]: I1104 05:48:19.088791    5079 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-qrwmn_732ab79a-2426-4dab-a1ba-e1e12c5ab51b/manager/0.log"