Nov 04 02:12:59.612962 ip-10-0-136-190 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Nov 04 02:12:59.612976 ip-10-0-136-190 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Nov 04 02:12:59.612986 ip-10-0-136-190 systemd[1]: kubelet.service: Failed with result 'resources'.
Nov 04 02:12:59.613332 ip-10-0-136-190 systemd[1]: Failed to start Kubernetes Kubelet.
Nov 04 02:13:09.734820 ip-10-0-136-190 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Nov 04 02:13:09.734841 ip-10-0-136-190 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6640e8cb9ab2467a9f28b2e327f19af4 --
Nov 04 02:15:15.501072 ip-10-0-136-190 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 02:15:15.871634 ip-10-0-136-190 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:15:15.871634 ip-10-0-136-190 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 02:15:15.871634 ip-10-0-136-190 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:15:15.871634 ip-10-0-136-190 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:15:15.878051 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.877881    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:15.878051 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878046    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:15.878051 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878051    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:15.878051 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878054    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:15.878051 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878058    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878062    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878065    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878067    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878070    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878074    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878083    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878086    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878089    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878092    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878094    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878097    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878100    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878103    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878105    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878109    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878111    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878114    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878116    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878120    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:15.878199 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878123    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878125    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878129    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878133    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878137    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878140    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878143    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878148    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878152    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878154    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878157    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878160    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878163    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878166    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878169    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878172    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878175    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878177    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878180    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:15.878678 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878183    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878186    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878189    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878192    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878194    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878197    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878200    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878202    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878205    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878208    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878210    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878213    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878216    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878218    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878221    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878224    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878227    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878229    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878232    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:15.879173 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878235    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878237    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878240    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878242    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878245    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878248    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878250    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878254    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878257    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878260    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878262    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878265    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878268    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878270    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878274    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878276    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878279    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878281    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878284    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:15.879611 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878286    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878288    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878291    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878294    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878296    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878299    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878302    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878305    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878307    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878310    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878312    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878315    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878317    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878320    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878323    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878325    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878328    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878331    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878334    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878336    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:15.880135 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878339    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878343    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878346    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878349    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.878351    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879199    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879208    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879212    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879216    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879218    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879222    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879224    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879227    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879230    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879232    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879236    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879238    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879241    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879244    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:15.880609 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879246    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879249    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879251    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879254    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879256    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879259    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879262    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879264    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879267    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879270    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879273    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879276    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879278    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879281    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879285    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879288    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879291    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879293    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879295    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879298    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:15.881089 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879301    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879305    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879308    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879311    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879313    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879316    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879318    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879321    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879324    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879326    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879329    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879331    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879334    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879338    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879342    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879345    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879347    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879350    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879352    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:15.881575 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879355    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879358    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879361    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879363    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879366    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879369    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879371    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879374    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879377    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879380    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879383    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879385    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879388    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879391    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879393    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879396    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879399    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879402    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879405    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879407    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:15.882044 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879409    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879412    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879414    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879417    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879419    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879422    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879424    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879427    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879429    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879431    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879434    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879437    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879439    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879442    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879448    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879451    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879454    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879457    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879459    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:15.882560 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879462    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879464    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879467    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879472    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879475    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879478    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879481    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879484    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879487    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879490    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879493    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879496    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879498    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.879501    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880072    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880080    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880084    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880087    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880090    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:15.883027 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880094    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880096    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880099    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880102    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880104    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880107    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880110    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880113    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880116    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880119    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880122    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880124    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880127    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880129    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880132    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880135    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880138    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880140    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880143    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:15.883481 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880146    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880149    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880152    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880155    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880158    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880160    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880163    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880166    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880168    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880171    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880174    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880176    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880179    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880182    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880185    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880187    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880190    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880193    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880195    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:15.883952 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880198    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880200    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880203    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880206    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880208    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880211    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880213    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880216    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880219    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880221    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880224    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880226    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880228    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880231    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880233    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880236    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880239    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880242    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880245    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880247    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:15.884407 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880250    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880253    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880256    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880259    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880261    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880264    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880266    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880269    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880271    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880274    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880276    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880279    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880281    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880284    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880287    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880289    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880292    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880295    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880297    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880300    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:15.884907 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880303    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880305    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880308    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880310    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880312    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880315    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880317    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880320    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880322    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880325    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880327    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880330    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880333    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880336    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880339    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880341    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880344    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880346    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880348    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:15.885379 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880351    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880355    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880360    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.880364    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881467    2575 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881478    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881487    2575 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881493    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881497    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881501    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881506    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881511    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881514    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881517    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881520    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881524    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881527    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881530    2575 flags.go:64] FLAG: --cgroup-root=""
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881533    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881536    2575 flags.go:64] FLAG: --client-ca-file=""
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881539    2575 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881542    2575 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881546    2575 flags.go:64] FLAG: --cluster-domain=""
Nov 04 02:15:15.885840 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881549    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881552    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881555    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881559    2575 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881563    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881569    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881572    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881575    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881579    2575 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881582    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881585    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881588    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881591    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881596    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881599    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881604    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881607    2575 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881610    2575 flags.go:64] FLAG: --enable-server="true"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881613    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881618    2575 flags.go:64] FLAG: --event-burst="100"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881622    2575 flags.go:64] FLAG: --event-qps="50"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881625    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881628    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881632    2575 flags.go:64] FLAG: --eviction-hard=""
Nov 04 02:15:15.886382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881637    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881640    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881643    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881647    2575 flags.go:64] FLAG: --eviction-soft=""
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881650    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881668    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881671    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881674    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881677    2575 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881681    2575 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881683    2575 flags.go:64] FLAG: --feature-gates=""
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881688    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881691    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881696    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881700    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881703    2575 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881706    2575 flags.go:64] FLAG: --help="false"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881708    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881712    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881715    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881718    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881721    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881724    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 02:15:15.887046 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881729    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881732    2575 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881734    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881737    2575 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881740    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881743    2575 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881746    2575 flags.go:64] FLAG: --kube-reserved=""
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881749    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881752    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881755    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881758    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881761    2575 flags.go:64] FLAG: --lock-file=""
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881764    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881767    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881770    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881776    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881779    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881782    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881785    2575 flags.go:64] FLAG: --logging-format="text"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881788    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881791    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881794    2575 flags.go:64] FLAG: --manifest-url=""
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881799    2575 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881804    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881808    2575 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 02:15:15.887737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881811    2575 flags.go:64] FLAG: --max-pods="110"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881814    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881817    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881820    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881823    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881826    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881829    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881833    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881841    2575 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881844    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881847    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881850    2575 flags.go:64] FLAG: --pod-cidr=""
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881853    2575 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881856    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881859    2575 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881862    2575 flags.go:64] FLAG: --port="10250"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881865    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881868    2575 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0c293338267259061"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881872    2575 flags.go:64] FLAG: --qos-reserved=""
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881875    2575 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881878    2575 flags.go:64] FLAG: --register-node="true"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881881    2575 flags.go:64] FLAG: --register-with-taints=""
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881885    2575 flags.go:64] FLAG: --registry-burst="10"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881887    2575 flags.go:64] FLAG: --registry-qps="5"
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881890    2575 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881893    2575 flags.go:64] FLAG: --reserved-memory=""
Nov 04 02:15:15.888352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881898    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881901    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881904    2575 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881909    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881912    2575 flags.go:64] FLAG: --runonce="false"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881915    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881918    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881921    2575 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881924    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881927    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881930    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881934    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881937    2575 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881941    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881944    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881947    2575 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881950    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881953    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881956    2575 flags.go:64] FLAG: --system-cgroups=""
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881959    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881965    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881968    2575 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881971    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881975    2575 flags.go:64] FLAG: --tls-min-version=""
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881978    2575 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 02:15:15.889000 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881981    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881984    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881986    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881989    2575 flags.go:64] FLAG: --v="2"
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881994    2575 flags.go:64] FLAG: --version="false"
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.881999    2575 flags.go:64] FLAG: --vmodule=""
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.882003    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.882006    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882153    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882156    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882161    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882164    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882169    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882173    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882177    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882180    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882182    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882185    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882188    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882190    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882195    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:15.889597 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882198    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882200    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882203    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882206    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882209    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882211    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882214    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882217    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882219    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882222    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882225    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882227    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882230    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882233    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882235    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882238    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882241    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882243    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882245    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882248    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:15.890131 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882251    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882255    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882258    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882261    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882264    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882266    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882269    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882271    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882274    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882277    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882280    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882285    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882287    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882290    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882292    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882295    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882298    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882300    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882303    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:15.890622 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882306    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882308    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882311    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882314    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882316    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882319    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882321    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882324    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882326    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882329    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882331    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882334    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882336    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882339    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882343    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882345    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882348    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882351    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882355    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882358    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:15.891171 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882362    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882365    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882367    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882370    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882375    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882379    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882382    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882384    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882387    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882390    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882392    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882395    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882398    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882400    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882403    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882405    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882408    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882411    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882413    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882415    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:15.891691 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882418    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882420    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882423    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882426    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882428    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882431    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882435    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882438    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882441    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882443    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882446    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882449    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882451    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882454    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.882483    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:15:15.892188 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882524    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882529    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882533    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882537    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882541    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882543    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882546    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882549    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882552    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882554    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882557    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882560    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882562    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882565    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882568    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882571    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882573    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882576    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882579    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:15.892547 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882582    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882585    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882587    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882589    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882593    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882595    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882598    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882600    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882603    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882606    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882609    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882612    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882614    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882617    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882619    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882622    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882625    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882628    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882630    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882632    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:15.893014 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882635    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882638    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882640    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882642    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882645    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882647    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882650    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882666    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882669    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882672    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882676    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882679    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882681    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882684    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882686    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882689    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882691    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882694    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882696    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882699    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:15.893486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882701    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882704    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882707    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882710    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882713    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882715    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882718    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882721    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882723    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882726    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882728    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882731    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882733    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882736    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882739    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882742    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882744    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882747    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882749    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:15.893978 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882752    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882755    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882757    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882760    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882762    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882765    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882767    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882770    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882772    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882775    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882779    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882782    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882785    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882788    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882791    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882794    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882797    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882800    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882802    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:15.894422 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882805    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882808    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882810    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882813    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882815    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882818    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882820    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882823    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.882826    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.890688    2575 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.890710    2575 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.891433    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.891441    2575 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891511    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891518    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891522    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891525    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891528    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891531    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891533    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:15.895060 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891536    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891539    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891541    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891544    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891546    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891549    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891552    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891554    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891557    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891560    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891564    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891567    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891569    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891572    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891574    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891577    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891580    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891582    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891585    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:15.895851 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891588    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891590    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891593    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891597    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891600    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891602    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891605    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891608    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891610    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891613    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891616    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891619    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891621    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891624    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891626    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891631    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891634    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891638    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891641    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:15.896344 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891644    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891647    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891650    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891670    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891675    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891677    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891680    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891683    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891686    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891689    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891691    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891694    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891697    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891700    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891703    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891706    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891710    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891713    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891716    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891719    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:15.896894 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891721    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891724    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891727    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891730    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891733    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891735    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891738    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891740    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891743    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891746    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891748    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891751    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891753    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891756    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891758    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891762    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891765    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891768    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891770    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891773    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:15.897363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891775    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891778    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891781    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891783    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891786    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891789    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891793    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891797    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891800    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891803    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891806    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891809    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891811    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891814    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891816    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891819    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891822    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891824    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891827    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:15.897880 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891830    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.891832    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.891869    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892019    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892025    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892028    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892031    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892035    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892039    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892042    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892044    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892047    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892050    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892053    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892056    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:15.898325 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892058    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892068    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892073    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892075    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892078    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892081    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892084    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892087    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892090    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892093    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892095    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892098    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892100    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892103    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892105    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892108    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892112    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892115    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892118    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:15.898705 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892121    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892124    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892126    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892129    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892132    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892134    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892137    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892139    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892142    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892144    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892148    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892150    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892153    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892157    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892159    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892162    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892165    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892167    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892170    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892172    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:15.899165 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892175    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892178    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892181    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892183    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892186    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892188    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892191    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892194    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892197    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892199    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892202    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892205    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892207    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892210    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892212    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892215    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892217    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892219    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892222    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892224    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:15.899632 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892227    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892229    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892232    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892235    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892238    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892241    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892243    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892246    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892249    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892251    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892254    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892256    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892259    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892262    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892264    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892267    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892269    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892272    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892274    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892277    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:15.900122 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892280    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892282    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892285    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892287    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892290    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892293    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892295    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892298    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892300    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892303    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892305    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892308    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892310    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892313    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892315    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.892339    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:15:15.900604 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892396    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892402    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892406    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892409    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892413    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892416    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892418    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892421    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892424    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892427    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892429    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892432    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892434    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892437    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892440    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892443    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892445    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892448    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892450    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:15.901068 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892453    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892456    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892458    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892461    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892465    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892467    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892470    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892473    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892475    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892478    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892481    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892486    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892489    2575 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892491    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892494    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892497    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892499    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892502    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892504    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892507    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:15.901521 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892514    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892516    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892519    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892522    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892524    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892527    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892529    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892532    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892535    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892537    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892540    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892543    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892545    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892548    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892551    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892554    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892556    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892559    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892562    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892564    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:15.902002 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892567    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892569    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892572    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892575    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892577    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892580    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892583    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892586    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892589    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892591    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892594    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892597    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892600    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892602    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892605    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892607    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892610    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892612    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892615    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:15.902471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892618    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892620    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892622    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892625    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892628    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892632    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892636    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892639    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892642    2575 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892645    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892647    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892651    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892670    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892676    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892679    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892681    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892684    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892686    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892689    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:15.902938 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892692    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892694    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892698    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892701    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892703    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892706    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892709    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892711    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:15.892714    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.892775    2575 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.896148    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.897249    2575 server.go:1014] "Starting client certificate rotation"
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.897360    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.897398    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.899488    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:15:15.903390 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.900756    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:15:15.913327 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.913302    2575 log.go:25] "Validated CRI v1 runtime API"
Nov 04 02:15:15.916472 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.916454    2575 log.go:25] "Validated CRI v1 image API"
Nov 04 02:15:15.917355 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.917332    2575 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 02:15:15.921968 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.921944    2575 fs.go:135] Filesystem UUIDs: map[250cade7-5844-46e2-95f5-471dabc7ff87:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 accfd9f5-2ec4-4b7c-bea0-27e782bb0475:/dev/nvme0n1p3]
Nov 04 02:15:15.922020 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.921968    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 04 02:15:15.927370 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.927246    2575 manager.go:217] Machine: {Timestamp:2026-11-04 02:15:15.925763066 +0000 UTC m=+0.320585556 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096594 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec287f4e8e7ac9872f575ce459e8b86a SystemUUID:ec287f4e-8e7a-c987-2f57-5ce459e8b86a BootID:6640e8cb-9ab2-467a-9f28-b2e327f19af4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:ca:3c:0d:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:ca:3c:0d:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:c8:94:f7:b6:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 02:15:15.927370 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.927368    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 02:15:15.927474 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.927462    2575 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 02:15:15.930251 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.930217    2575 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 02:15:15.930408 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.930253    2575 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-190.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 02:15:15.930449 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.930411    2575 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 02:15:15.930449 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.930418    2575 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 02:15:15.930449 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.930435    2575 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:15:15.930528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.930449    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:15:15.931648 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.931636    2575 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 02:15:15.936162 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.936147    2575 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 02:15:15.936314 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.936305    2575 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 02:15:15.937139 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.937128    2575 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 02:15:15.937170 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.937144    2575 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 02:15:15.937170 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.937156    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 02:15:15.937170 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.937168    2575 kubelet.go:405] "Adding apiserver pod source"
Nov 04 02:15:15.937270 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.937177    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 02:15:15.937696 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.937679    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:15:15.942612 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.942533    2575 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 02:15:15.950364 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.950339    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:15:15.951316 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.951300    2575 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 02:15:15.951352 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.951334    2575 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 02:15:15.951530 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.951520    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 02:15:15.951560 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.951536    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 02:15:15.951560 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.951543    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 02:15:15.951560 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.951549    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 02:15:15.951560 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.951554    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 02:15:15.951560 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.951560    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 02:15:15.952205 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.952196    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 02:15:15.952205 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.952206    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 02:15:15.952264 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.952213    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 02:15:15.952264 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.952220    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 02:15:15.952264 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.952230    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 02:15:15.952264 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.952238    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 02:15:15.952264 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.952262    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 02:15:15.952518 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.952268    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 02:15:15.956377 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.956360    2575 server.go:1263] "Started kubelet"
Nov 04 02:15:15.956470 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.956437    2575 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 02:15:15.956547 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.956489    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 02:15:15.956624 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.956577    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 02:15:15.957277 ip-10-0-136-190 systemd[1]: Started Kubernetes Kubelet.
Nov 04 02:15:15.958322 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.958228    2575 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 02:15:15.959227 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.959213    2575 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 02:15:15.963626 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:15.963604    2575 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 04 02:15:15.965377 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.965358    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 02:15:15.965907 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.965887    2575 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 02:15:15.966132 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:15.966108    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-190.us-west-2.compute.internal\" not found"
Nov 04 02:15:15.966729 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.966710    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 02:15:15.966729 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.966716    2575 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 02:15:15.966865 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.966738    2575 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 02:15:15.966935 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.966924    2575 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 02:15:15.966935 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.966935    2575 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 02:15:15.967071 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.967044    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 02:15:15.967102 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.967075    2575 factory.go:55] Registering systemd factory
Nov 04 02:15:15.967102 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.967097    2575 factory.go:223] Registration of the systemd container factory successfully
Nov 04 02:15:15.967334 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.967323    2575 factory.go:153] Registering CRI-O factory
Nov 04 02:15:15.967378 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.967337    2575 factory.go:223] Registration of the crio container factory successfully
Nov 04 02:15:15.967378 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.967353    2575 factory.go:103] Registering Raw factory
Nov 04 02:15:15.967378 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.967376    2575 manager.go:1199] Started watching for new ooms in manager
Nov 04 02:15:15.968511 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.968498    2575 manager.go:319] Starting recovery of all containers
Nov 04 02:15:15.981501 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.981477    2575 manager.go:324] Recovery completed
Nov 04 02:15:15.986991 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.986849    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:15.988809 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.988786    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:15.988906 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.988825    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:15.988906 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.988836    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:15.989399 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.989382    2575 cpu_manager.go:226] "Starting" policy="none"
Nov 04 02:15:15.989399 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.989394    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:15.989500 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.989394    2575 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 02:15:15.989500 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.989468    2575 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 02:15:15.990332 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.990314    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:15.990393 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.990351    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:15.990393 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.990367    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:15.991638 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.991623    2575 policy_none.go:50] "Start"
Nov 04 02:15:15.991638 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.991640    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 02:15:15.991745 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.991651    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 02:15:15.993633 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:15.993621    2575 policy_none.go:44] "Start"
Nov 04 02:15:16.053776 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.037334    2575 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 02:15:16.053776 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.043018    2575 manager.go:341] "Starting Device Plugin manager"
Nov 04 02:15:16.053776 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:16.043058    2575 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 02:15:16.053776 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.043068    2575 server.go:87] "Starting device plugin registration server"
Nov 04 02:15:16.053776 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.043385    2575 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 02:15:16.053776 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.043397    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 02:15:16.053776 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.043580    2575 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 02:15:16.053776 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.043719    2575 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 02:15:16.053776 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.043728    2575 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 02:15:16.053776 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:16.044149    2575 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 02:15:16.053776 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:16.044205    2575 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-190.us-west-2.compute.internal\" not found"
Nov 04 02:15:16.056142 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.054062    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 02:15:16.056142 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.055406    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 02:15:16.056142 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.055428    2575 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 02:15:16.056142 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.055448    2575 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 02:15:16.056142 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:16.055484    2575 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 04 02:15:16.094750 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.094715    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-190.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 04 02:15:16.094750 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:16.094720    2575 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-190.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 04 02:15:16.095920 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:16.094718    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-190.us-west-2.compute.internal.18e4b5ddd468a064  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-190.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-190.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 02:15:15.9563265 +0000 UTC m=+0.351148989,LastTimestamp:2026-11-04 02:15:15.9563265 +0000 UTC m=+0.351148989,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-190.us-west-2.compute.internal,}"
Nov 04 02:15:16.143691 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.143606    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:16.144468 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.144449    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:16.144552 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.144481    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:16.144552 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.144495    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:16.144552 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.144522    2575 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.155822 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.155779    2575 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"]
Nov 04 02:15:16.155977 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.155861    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:16.156839 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.156820    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:16.156950 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.156856    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:16.156950 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.156870    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:16.159115 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.159098    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:16.159288 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.159271    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.159377 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.159311    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:16.159977 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.159959    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:16.160059 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.159990    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:16.160059 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.160000    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:16.160059 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.159960    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:16.160059 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.160052    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:16.160191 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.160073    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:16.160935 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.160917    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 02:15:16.161007 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.160959    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f2vxl"
Nov 04 02:15:16.162219 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.162200    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.162286 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.162241    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:16.163104 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.163087    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:16.163193 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.163122    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:16.163193 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.163139    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:16.191603 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:16.191580    2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-190.us-west-2.compute.internal\" not found" node="ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.194410 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:16.194388    2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-190.us-west-2.compute.internal\" not found" node="ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.260057 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.260021    2575 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:16.267720 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.267694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.267813 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.267751    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.267813 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.267788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c60ccd19b86040261adde19f6117c493-config\") pod \"kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"c60ccd19b86040261adde19f6117c493\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.308832 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.308804    2575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:16.359623 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.359589    2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:16.360098 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.360070    2575 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.360222 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:16.360104    2575 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-190.us-west-2.compute.internal\": node \"ip-10-0-136-190.us-west-2.compute.internal\" not found"
Nov 04 02:15:16.360894 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.360876    2575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:16.366367 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.366343    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.368140 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.368120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.368222 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.368150    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.368222 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.368161    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.368222 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.368169    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c60ccd19b86040261adde19f6117c493-config\") pod \"kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"c60ccd19b86040261adde19f6117c493\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.368343 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.368215    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.368343 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.368317    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c60ccd19b86040261adde19f6117c493-config\") pod \"kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"c60ccd19b86040261adde19f6117c493\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.479683 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.479582    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:15:16.480509 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.480492    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.496776 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.496743    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.498896 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.498876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:15:16.539672 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.539636    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:15:16.897727 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.897601    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 04 02:15:16.898479 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.897788    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 02:15:16.898479 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.897831    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 02:15:16.898479 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.897833    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 02:15:16.898479 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:16.897915    2575 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a002968538e68413697f26034184b0ae-7fcf7513c18704a7.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-136-190.us-west-2.compute.internal.18e4b5ddd658bf59\": read tcp 10.0.136.190:35786->16.58.110.229:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-136-190.us-west-2.compute.internal.18e4b5ddd658bf59  default   4820 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-190.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-190.us-west-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-190.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 02:15:15 +0000 UTC,LastTimestamp:2026-11-04 02:15:16.144499217 +0000 UTC m=+0.539321705,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-190.us-west-2.compute.internal,}"
Nov 04 02:15:16.937750 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.937713    2575 apiserver.go:52] "Watching apiserver"
Nov 04 02:15:16.966181 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:16.966143    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 04 02:15:17.165947 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.165851    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 02:10:16 +0000 UTC" deadline="2028-04-17 02:38:11.652470025 +0000 UTC"
Nov 04 02:15:17.165947 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.165891    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12720h22m54.4865821s"
Nov 04 02:15:17.218029 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.217997    2575 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 02:15:17.218405 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.218383    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-xshqm","openshift-network-operator/iptables-alerter-lwtfq","openshift-ovn-kubernetes/ovnkube-node-dgm27","kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx","openshift-dns/node-resolver-2bcnd","openshift-image-registry/node-ca-dtg7p","kube-system/global-pull-secret-syncer-jzwmx","kube-system/konnectivity-agent-6npmv","openshift-multus/multus-additional-cni-plugins-v6s7g","openshift-network-diagnostics/network-check-target-7bvrs","openshift-cluster-node-tuning-operator/tuned-jv78s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal","openshift-multus/multus-8rx5r"]
Nov 04 02:15:17.221038 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.221017    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.223244 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.223224    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.225377 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.225361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.227595 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.227577    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:15:17.229802 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.229780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:15:17.231961 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.231937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:17.234226 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.234210    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.236411 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.236390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:15:17.238706 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.238691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:17.238777 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.238762    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:17.240933 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.240912    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:17.241014 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.240994    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:17.243111 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.243093    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:17.243162 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.243145    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:17.245482 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.245465    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.267989 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.267959    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 02:15:17.271458 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b9b855-1e9b-47f9-b775-304910b95667-tmp-dir\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:15:17.271540 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271468    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.271540 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-script-lib\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.271602 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-system-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.271602 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-kubelet-config\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:17.271679 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htvgh\" (UniqueName: \"kubernetes.io/projected/d8b9b855-1e9b-47f9-b775-304910b95667-kube-api-access-htvgh\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:15:17.271679 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271671    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-cnibin\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.271748 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.271748 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-cnibin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.271806 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271764    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-socket-dir-parent\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.271806 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271790    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d9a67bf-5458-4857-acd0-473c00297677-serviceca\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:15:17.271867 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.271899 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt847\" (UniqueName: \"kubernetes.io/projected/122326d1-cd64-4662-8234-9ce0718e5c32-kube-api-access-lt847\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.271930 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-agent-certs\") pod \"konnectivity-agent-6npmv\" (UID: \"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10\") " pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:17.271979 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-conf\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.272013 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.271997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-lib-modules\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.272048 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272015    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-dbus\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:17.272089 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8vtj\" (UniqueName: \"kubernetes.io/projected/482a1092-091d-415e-bbbf-c2e41a770ba0-kube-api-access-k8vtj\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.272120 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-konnectivity-ca\") pod \"konnectivity-agent-6npmv\" (UID: \"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10\") " pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:17.272120 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-kubernetes\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.272179 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272134    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.272179 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272160    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr9bf\" (UniqueName: \"kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf\") pod \"network-check-target-7bvrs\" (UID: \"e8f75c8e-a241-4641-814e-f233535d9b7e\") " pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:17.272235 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272184    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovn-node-metrics-cert\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.272235 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-kubelet\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.272235 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-multus-certs\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.272320 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d9a67bf-5458-4857-acd0-473c00297677-host\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:15:17.272320 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-socket-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.272373 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272333    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-multus\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.272373 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272361    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-host\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.272431 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-bin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.272461 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272433    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-conf-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.272491 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272461    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4xd5\" (UniqueName: \"kubernetes.io/projected/82713f3a-e89e-4116-8160-03fbc4122635-kube-api-access-l4xd5\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:15:17.272491 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.272955 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-run\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.272955 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272803    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-tmp\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.272955 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272857    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-k8s-cni-cncf-io\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.272955 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.272892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-ovn\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-systemd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-etc-kubernetes\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273375    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s5jr\" (UniqueName: \"kubernetes.io/projected/3d9a67bf-5458-4857-acd0-473c00297677-kube-api-access-5s5jr\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-modprobe-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcwlx\" (UniqueName: \"kubernetes.io/projected/a5d0efd2-3946-4144-8971-b4867230e8ec-kube-api-access-rcwlx\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgk46\" (UniqueName: \"kubernetes.io/projected/36162c63-49e7-4782-8ea9-55db430a4c73-kube-api-access-bgk46\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-cni-binary-copy\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-systemd-units\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-slash\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-etc-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-log-socket\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-config\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q82m4\" (UniqueName: \"kubernetes.io/projected/9a21ec19-27ea-4fd8-bbeb-154ef1063833-kube-api-access-q82m4\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.274817 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-kubelet\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-netns\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-netd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273926    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-env-overrides\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-daemon-config\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.273979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8b9b855-1e9b-47f9-b775-304910b95667-hosts-file\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82713f3a-e89e-4116-8160-03fbc4122635-host-slash\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-binary-copy\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274068    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274138    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-etc-tuned\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-sys-fs\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-var-lib-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-bin\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274388    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-sys\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-var-lib-kubelet\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.275528 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-device-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-netns\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274501    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-hostroot\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274535    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274566    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-system-cni-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfm6n\" (UniqueName: \"kubernetes.io/projected/159902bd-5489-46b3-8368-55551a6b9b68-kube-api-access-sfm6n\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-registration-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-node-log\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82713f3a-e89e-4116-8160-03fbc4122635-iptables-alerter-script\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysconfig\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-systemd\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.274887    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.275496    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.275496    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.275549    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.275603    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.275604    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 02:15:17.276241 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.275719    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zjj5c\""
Nov 04 02:15:17.277174 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.277154    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 02:15:17.277280 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.277240    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-275xk\""
Nov 04 02:15:17.279211 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.279192    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zrn9f\""
Nov 04 02:15:17.279306 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.279234    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:17.279306 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.279267    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 02:15:17.283393 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.283376    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 02:15:17.283696 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.283680    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-px2wd\""
Nov 04 02:15:17.283804 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.283744    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 02:15:17.283866 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.283804    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6q9ld\""
Nov 04 02:15:17.283866 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.283856    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 02:15:17.283935 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.283858    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 02:15:17.283935 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.283897    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 02:15:17.285912 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.285894    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-n8x9d\""
Nov 04 02:15:17.372427 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.372394    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 02:15:17.372599 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.372472    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lz6sx"
Nov 04 02:15:17.375537 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-env-overrides\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.375598 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-daemon-config\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.375598 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8b9b855-1e9b-47f9-b775-304910b95667-hosts-file\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:15:17.375598 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82713f3a-e89e-4116-8160-03fbc4122635-host-slash\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:15:17.375751 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-binary-copy\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.375751 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.375751 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375673    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-etc-tuned\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.375751 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375677    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8b9b855-1e9b-47f9-b775-304910b95667-hosts-file\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:15:17.375751 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375677    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82713f3a-e89e-4116-8160-03fbc4122635-host-slash\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-sys-fs\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375799    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-var-lib-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-bin\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375860    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-sys-fs\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375879    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-var-lib-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-sys\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375915    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375938    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-sys\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-var-lib-kubelet\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375962    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-bin\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375968    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-var-lib-kubelet\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.375995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375970    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-device-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.375975    2575 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376020    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-device-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376026    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-netns\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-netns\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-hostroot\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376085    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-hostroot\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376098    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-system-cni-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376120    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-system-cni-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.376176    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376214    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfm6n\" (UniqueName: \"kubernetes.io/projected/159902bd-5489-46b3-8368-55551a6b9b68-kube-api-access-sfm6n\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376215    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-daemon-config\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.376248    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs podName:36162c63-49e7-4782-8ea9-55db430a4c73 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:17.876225017 +0000 UTC m=+2.271047510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs") pod "network-metrics-daemon-xshqm" (UID: "36162c63-49e7-4782-8ea9-55db430a4c73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376267    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376276    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-registration-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.376650 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376303    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376266    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-binary-copy\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-node-log\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376332    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-registration-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376351    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82713f3a-e89e-4116-8160-03fbc4122635-iptables-alerter-script\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376400    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysconfig\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376425    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-systemd\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376447    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysconfig\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376401    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-node-log\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376452    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376478    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-systemd\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b9b855-1e9b-47f9-b775-304910b95667-tmp-dir\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.376516    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-script-lib\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376544    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.376553    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret podName:dcca8570-7261-499b-938a-10097ca652b0 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:17.87654024 +0000 UTC m=+2.271362735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret") pod "global-pull-secret-syncer-jzwmx" (UID: "dcca8570-7261-499b-938a-10097ca652b0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:17.377272 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-system-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-kubelet-config\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htvgh\" (UniqueName: \"kubernetes.io/projected/d8b9b855-1e9b-47f9-b775-304910b95667-kube-api-access-htvgh\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376619    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-system-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376647    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-kubelet-config\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-cnibin\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376729    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376733    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-cnibin\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376728    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b9b855-1e9b-47f9-b775-304910b95667-tmp-dir\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-cnibin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-socket-dir-parent\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376840    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376845    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-cnibin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376845    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d9a67bf-5458-4857-acd0-473c00297677-serviceca\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376881    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-socket-dir-parent\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376916    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt847\" (UniqueName: \"kubernetes.io/projected/122326d1-cd64-4662-8234-9ce0718e5c32-kube-api-access-lt847\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-agent-certs\") pod \"konnectivity-agent-6npmv\" (UID: \"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10\") " pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:17.378033 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.376994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-conf\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377138    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-lib-modules\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377167    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-conf\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-dbus\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377218    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d9a67bf-5458-4857-acd0-473c00297677-serviceca\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8vtj\" (UniqueName: \"kubernetes.io/projected/482a1092-091d-415e-bbbf-c2e41a770ba0-kube-api-access-k8vtj\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377276    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-konnectivity-ca\") pod \"konnectivity-agent-6npmv\" (UID: \"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10\") " pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377287    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-dbus\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377300    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-lib-modules\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377348    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-kubernetes\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-kubernetes\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377379    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr9bf\" (UniqueName: \"kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf\") pod \"network-check-target-7bvrs\" (UID: \"e8f75c8e-a241-4641-814e-f233535d9b7e\") " pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovn-node-metrics-cert\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377495    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-kubelet\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.379052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377575    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-kubelet\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-multus-certs\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d9a67bf-5458-4857-acd0-473c00297677-host\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-socket-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377695    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-multus-certs\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-multus\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377716    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d9a67bf-5458-4857-acd0-473c00297677-host\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377728    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-host\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-bin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377778    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-socket-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377790    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-host\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-conf-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377776    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-multus\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377814    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-conf-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4xd5\" (UniqueName: \"kubernetes.io/projected/82713f3a-e89e-4116-8160-03fbc4122635-kube-api-access-l4xd5\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377823    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-bin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377838    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-run\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.379851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-tmp\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377941    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-k8s-cni-cncf-io\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377960    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.377998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-ovn\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378000    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-run\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378022    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-systemd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378036    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-ovn\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378022    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-k8s-cni-cncf-io\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378064    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-etc-kubernetes\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378049    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-etc-kubernetes\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s5jr\" (UniqueName: \"kubernetes.io/projected/3d9a67bf-5458-4857-acd0-473c00297677-kube-api-access-5s5jr\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378118    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378064    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-systemd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-modprobe-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378181    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcwlx\" (UniqueName: \"kubernetes.io/projected/a5d0efd2-3946-4144-8971-b4867230e8ec-kube-api-access-rcwlx\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378218    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgk46\" (UniqueName: \"kubernetes.io/projected/36162c63-49e7-4782-8ea9-55db430a4c73-kube-api-access-bgk46\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-cni-binary-copy\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.380630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378267    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-systemd-units\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-slash\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378300    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-modprobe-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-etc-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-log-socket\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378397    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-systemd-units\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378441    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-slash\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378468    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-etc-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-config\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378524    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-log-socket\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q82m4\" (UniqueName: \"kubernetes.io/projected/9a21ec19-27ea-4fd8-bbeb-154ef1063833-kube-api-access-q82m4\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378570    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-kubelet\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-netns\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378680    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-netns\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378690    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-kubelet\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-netd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.381799 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378802    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-netd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.378946    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-cni-binary-copy\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.379630    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-etc-tuned\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380044    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380238    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380255    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380335    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380371    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380387    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380425    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380338    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380450    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380474    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380427    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380490    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 02:15:17.382384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.380703    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-tmp\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.387186 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.387161    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-env-overrides\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.387242 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.387227    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82713f3a-e89e-4116-8160-03fbc4122635-iptables-alerter-script\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:15:17.388563 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.388542    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-konnectivity-ca\") pod \"konnectivity-agent-6npmv\" (UID: \"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10\") " pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:17.394090 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.394063    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovn-node-metrics-cert\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.394212 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.394181    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-config\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.394258 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.394224    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-agent-certs\") pod \"konnectivity-agent-6npmv\" (UID: \"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10\") " pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:17.413827 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.413790    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m589d\""
Nov 04 02:15:17.413827 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.413786    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2f9b\""
Nov 04 02:15:17.414010 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.413786    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 02:15:17.414010 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.413862    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wpmk6\""
Nov 04 02:15:17.414010 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.413938    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 02:15:17.417190 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.417142    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-script-lib\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.448244 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.448209    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htvgh\" (UniqueName: \"kubernetes.io/projected/d8b9b855-1e9b-47f9-b775-304910b95667-kube-api-access-htvgh\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:15:17.448421 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.448205    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfm6n\" (UniqueName: \"kubernetes.io/projected/159902bd-5489-46b3-8368-55551a6b9b68-kube-api-access-sfm6n\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.449568 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.449538    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcwlx\" (UniqueName: \"kubernetes.io/projected/a5d0efd2-3946-4144-8971-b4867230e8ec-kube-api-access-rcwlx\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.449720 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.449690    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt847\" (UniqueName: \"kubernetes.io/projected/122326d1-cd64-4662-8234-9ce0718e5c32-kube-api-access-lt847\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.449798 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.449753    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q82m4\" (UniqueName: \"kubernetes.io/projected/9a21ec19-27ea-4fd8-bbeb-154ef1063833-kube-api-access-q82m4\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.449849 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.449796    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4xd5\" (UniqueName: \"kubernetes.io/projected/82713f3a-e89e-4116-8160-03fbc4122635-kube-api-access-l4xd5\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:15:17.450177 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.450161    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8vtj\" (UniqueName: \"kubernetes.io/projected/482a1092-091d-415e-bbbf-c2e41a770ba0-kube-api-access-k8vtj\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.450421 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.450404    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgk46\" (UniqueName: \"kubernetes.io/projected/36162c63-49e7-4782-8ea9-55db430a4c73-kube-api-access-bgk46\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:17.451772 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.451754    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:17.451850 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.451774    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:17.451850 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.451784    2575 projected.go:196] Error preparing data for projected volume kube-api-access-hr9bf for pod openshift-network-diagnostics/network-check-target-7bvrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:17.451850 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.451843    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf podName:e8f75c8e-a241-4641-814e-f233535d9b7e nodeName:}" failed. No retries permitted until 2026-11-04 02:15:17.951826087 +0000 UTC m=+2.346648579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hr9bf" (UniqueName: "kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf") pod "network-check-target-7bvrs" (UID: "e8f75c8e-a241-4641-814e-f233535d9b7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:17.454874 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.454855    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s5jr\" (UniqueName: \"kubernetes.io/projected/3d9a67bf-5458-4857-acd0-473c00297677-kube-api-access-5s5jr\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:15:17.568851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.568803    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:15:17.584487 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.584446    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:15:17.590258 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.590231    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8rx5r"
Nov 04 02:15:17.597007 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.596977    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:15:17.608887 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.608857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:15:17.630865 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.630830    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:15:17.637789 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.637759    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:17.652749 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.652715    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:15:17.669716 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.669623    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:17.750841 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:17.750802    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60ccd19b86040261adde19f6117c493.slice/crio-8be675cfc5c7976e27448961b34650ed3996396c1e42c29a5c6e3caad6330760 WatchSource:0}: Error finding container 8be675cfc5c7976e27448961b34650ed3996396c1e42c29a5c6e3caad6330760: Status 404 returned error can't find the container with id 8be675cfc5c7976e27448961b34650ed3996396c1e42c29a5c6e3caad6330760
Nov 04 02:15:17.751390 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:17.751371    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25537345b15c5579bee86c1fcfc147e8.slice/crio-3122977277aef15f40acbc1029ef457e89697ed1a4221e12227dc7f4b6247903 WatchSource:0}: Error finding container 3122977277aef15f40acbc1029ef457e89697ed1a4221e12227dc7f4b6247903: Status 404 returned error can't find the container with id 3122977277aef15f40acbc1029ef457e89697ed1a4221e12227dc7f4b6247903
Nov 04 02:15:17.759464 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.759443    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:15:17.765152 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.765133    2575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:17.883097 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.883055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:17.883097 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.883100    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:17.883337 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.883223    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:17.883337 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.883225    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:17.883337 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.883286    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret podName:dcca8570-7261-499b-938a-10097ca652b0 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:18.883268047 +0000 UTC m=+3.278090524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret") pod "global-pull-secret-syncer-jzwmx" (UID: "dcca8570-7261-499b-938a-10097ca652b0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:17.883337 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.883302    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs podName:36162c63-49e7-4782-8ea9-55db430a4c73 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:18.883294544 +0000 UTC m=+3.278117022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs") pod "network-metrics-daemon-xshqm" (UID: "36162c63-49e7-4782-8ea9-55db430a4c73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:17.984181 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:17.984076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr9bf\" (UniqueName: \"kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf\") pod \"network-check-target-7bvrs\" (UID: \"e8f75c8e-a241-4641-814e-f233535d9b7e\") " pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:17.984812 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.984214    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:17.984812 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.984231    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:17.984812 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.984240    2575 projected.go:196] Error preparing data for projected volume kube-api-access-hr9bf for pod openshift-network-diagnostics/network-check-target-7bvrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:17.984812 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:17.984298    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf podName:e8f75c8e-a241-4641-814e-f233535d9b7e nodeName:}" failed. No retries permitted until 2026-11-04 02:15:18.984279383 +0000 UTC m=+3.379101876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hr9bf" (UniqueName: "kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf") pod "network-check-target-7bvrs" (UID: "e8f75c8e-a241-4641-814e-f233535d9b7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:18.057755 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:18.057715    2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:18.061225 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:18.061159    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal" event={"ID":"25537345b15c5579bee86c1fcfc147e8","Type":"ContainerStarted","Data":"3122977277aef15f40acbc1029ef457e89697ed1a4221e12227dc7f4b6247903"}
Nov 04 02:15:18.062246 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:18.062220    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal" event={"ID":"c60ccd19b86040261adde19f6117c493","Type":"ContainerStarted","Data":"8be675cfc5c7976e27448961b34650ed3996396c1e42c29a5c6e3caad6330760"}
Nov 04 02:15:18.146987 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:18.146955    2575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:18.375688 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:18.375533    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:10:17 +0000 UTC" deadline="2028-04-28 01:13:17.059576997 +0000 UTC"
Nov 04 02:15:18.375688 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:18.375596    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12982h57m58.683984272s"
Nov 04 02:15:18.502813 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:18.502778    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122326d1_cd64_4662_8234_9ce0718e5c32.slice/crio-888fc91086fc7a42aff91473260801783cc9cfaa6c814c433d43b6700f5eb6d0 WatchSource:0}: Error finding container 888fc91086fc7a42aff91473260801783cc9cfaa6c814c433d43b6700f5eb6d0: Status 404 returned error can't find the container with id 888fc91086fc7a42aff91473260801783cc9cfaa6c814c433d43b6700f5eb6d0
Nov 04 02:15:18.588710 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:18.588657    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d9a67bf_5458_4857_acd0_473c00297677.slice/crio-e95a0490abfeb4e0afdaf1ccdd3e14f044e97094f528f44c9b90c1fc2afef23e WatchSource:0}: Error finding container e95a0490abfeb4e0afdaf1ccdd3e14f044e97094f528f44c9b90c1fc2afef23e: Status 404 returned error can't find the container with id e95a0490abfeb4e0afdaf1ccdd3e14f044e97094f528f44c9b90c1fc2afef23e
Nov 04 02:15:18.592971 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:18.592943    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d0efd2_3946_4144_8971_b4867230e8ec.slice/crio-74ff51aa0184c5cf97a32737eedbd7ab430588c0724f8ed9d442ad2fa6938293 WatchSource:0}: Error finding container 74ff51aa0184c5cf97a32737eedbd7ab430588c0724f8ed9d442ad2fa6938293: Status 404 returned error can't find the container with id 74ff51aa0184c5cf97a32737eedbd7ab430588c0724f8ed9d442ad2fa6938293
Nov 04 02:15:18.593714 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:18.593687    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482a1092_091d_415e_bbbf_c2e41a770ba0.slice/crio-d688c2c342d0e1635c2bd69b7d21827e28fa561b82f0c3e123c45713cd7927c9 WatchSource:0}: Error finding container d688c2c342d0e1635c2bd69b7d21827e28fa561b82f0c3e123c45713cd7927c9: Status 404 returned error can't find the container with id d688c2c342d0e1635c2bd69b7d21827e28fa561b82f0c3e123c45713cd7927c9
Nov 04 02:15:18.631427 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:18.631342    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a21ec19_27ea_4fd8_bbeb_154ef1063833.slice/crio-f7f709f4c834e44180c3589fd22a9121ed87617588cf190685400026021a2691 WatchSource:0}: Error finding container f7f709f4c834e44180c3589fd22a9121ed87617588cf190685400026021a2691: Status 404 returned error can't find the container with id f7f709f4c834e44180c3589fd22a9121ed87617588cf190685400026021a2691
Nov 04 02:15:18.664139 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:18.664108    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159902bd_5489_46b3_8368_55551a6b9b68.slice/crio-799a450f693280c7b80d64d475f184e145d4e745163c8e71a53c75469ecea349 WatchSource:0}: Error finding container 799a450f693280c7b80d64d475f184e145d4e745163c8e71a53c75469ecea349: Status 404 returned error can't find the container with id 799a450f693280c7b80d64d475f184e145d4e745163c8e71a53c75469ecea349
Nov 04 02:15:18.664682 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:18.664642    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b9b855_1e9b_47f9_b775_304910b95667.slice/crio-e8c329d87ab072825d4b8b205d1a0d9674886fdcf8d30fadc706c8b162cf852b WatchSource:0}: Error finding container e8c329d87ab072825d4b8b205d1a0d9674886fdcf8d30fadc706c8b162cf852b: Status 404 returned error can't find the container with id e8c329d87ab072825d4b8b205d1a0d9674886fdcf8d30fadc706c8b162cf852b
Nov 04 02:15:18.692471 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:18.692440    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82713f3a_e89e_4116_8160_03fbc4122635.slice/crio-c21d4e603efcf7726e2d37f5c50b950dc585a74bc9bdd50e28ec3b9db15784fb WatchSource:0}: Error finding container c21d4e603efcf7726e2d37f5c50b950dc585a74bc9bdd50e28ec3b9db15784fb: Status 404 returned error can't find the container with id c21d4e603efcf7726e2d37f5c50b950dc585a74bc9bdd50e28ec3b9db15784fb
Nov 04 02:15:18.714553 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:18.714526    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4753b15c_2b1c_4ecc_a5d3_1d6a17d35d10.slice/crio-5f948d58e0d10c60aa871eda4631d8f4c81c915e3185f84fd661f6870d479ec1 WatchSource:0}: Error finding container 5f948d58e0d10c60aa871eda4631d8f4c81c915e3185f84fd661f6870d479ec1: Status 404 returned error can't find the container with id 5f948d58e0d10c60aa871eda4631d8f4c81c915e3185f84fd661f6870d479ec1
Nov 04 02:15:18.892144 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:18.892060    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:18.892144 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:18.892105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:18.892339 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:18.892229    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:18.892339 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:18.892229    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:18.892339 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:18.892302    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret podName:dcca8570-7261-499b-938a-10097ca652b0 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:20.892283037 +0000 UTC m=+5.287105514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret") pod "global-pull-secret-syncer-jzwmx" (UID: "dcca8570-7261-499b-938a-10097ca652b0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:18.892339 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:18.892320    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs podName:36162c63-49e7-4782-8ea9-55db430a4c73 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:20.892312344 +0000 UTC m=+5.287134822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs") pod "network-metrics-daemon-xshqm" (UID: "36162c63-49e7-4782-8ea9-55db430a4c73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:18.992866 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:18.992832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr9bf\" (UniqueName: \"kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf\") pod \"network-check-target-7bvrs\" (UID: \"e8f75c8e-a241-4641-814e-f233535d9b7e\") " pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:18.993488 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:18.993032    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:18.993488 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:18.993059    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:18.993488 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:18.993074    2575 projected.go:196] Error preparing data for projected volume kube-api-access-hr9bf for pod openshift-network-diagnostics/network-check-target-7bvrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:18.993488 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:18.993148    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf podName:e8f75c8e-a241-4641-814e-f233535d9b7e nodeName:}" failed. No retries permitted until 2026-11-04 02:15:20.99312694 +0000 UTC m=+5.387949431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hr9bf" (UniqueName: "kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf") pod "network-check-target-7bvrs" (UID: "e8f75c8e-a241-4641-814e-f233535d9b7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:19.056137 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.056080    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:19.056325 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.056088    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:19.056325 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:19.056239    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:19.056412 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:19.056320    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:19.056412 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.056105    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:19.056500 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:19.056420    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:19.066058 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.066011    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6npmv" event={"ID":"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10","Type":"ContainerStarted","Data":"5f948d58e0d10c60aa871eda4631d8f4c81c915e3185f84fd661f6870d479ec1"}
Nov 04 02:15:19.067623 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.067587    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27" event={"ID":"9a21ec19-27ea-4fd8-bbeb-154ef1063833","Type":"ContainerStarted","Data":"f7f709f4c834e44180c3589fd22a9121ed87617588cf190685400026021a2691"}
Nov 04 02:15:19.069111 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.069077    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx" event={"ID":"a5d0efd2-3946-4144-8971-b4867230e8ec","Type":"ContainerStarted","Data":"74ff51aa0184c5cf97a32737eedbd7ab430588c0724f8ed9d442ad2fa6938293"}
Nov 04 02:15:19.070446 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.070413    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lwtfq" event={"ID":"82713f3a-e89e-4116-8160-03fbc4122635","Type":"ContainerStarted","Data":"c21d4e603efcf7726e2d37f5c50b950dc585a74bc9bdd50e28ec3b9db15784fb"}
Nov 04 02:15:19.071590 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.071567    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2bcnd" event={"ID":"d8b9b855-1e9b-47f9-b775-304910b95667","Type":"ContainerStarted","Data":"e8c329d87ab072825d4b8b205d1a0d9674886fdcf8d30fadc706c8b162cf852b"}
Nov 04 02:15:19.072990 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.072959    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jv78s" event={"ID":"159902bd-5489-46b3-8368-55551a6b9b68","Type":"ContainerStarted","Data":"799a450f693280c7b80d64d475f184e145d4e745163c8e71a53c75469ecea349"}
Nov 04 02:15:19.074487 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.074464    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8rx5r" event={"ID":"482a1092-091d-415e-bbbf-c2e41a770ba0","Type":"ContainerStarted","Data":"d688c2c342d0e1635c2bd69b7d21827e28fa561b82f0c3e123c45713cd7927c9"}
Nov 04 02:15:19.075854 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.075823    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dtg7p" event={"ID":"3d9a67bf-5458-4857-acd0-473c00297677","Type":"ContainerStarted","Data":"e95a0490abfeb4e0afdaf1ccdd3e14f044e97094f528f44c9b90c1fc2afef23e"}
Nov 04 02:15:19.077387 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.077361    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6s7g" event={"ID":"122326d1-cd64-4662-8234-9ce0718e5c32","Type":"ContainerStarted","Data":"888fc91086fc7a42aff91473260801783cc9cfaa6c814c433d43b6700f5eb6d0"}
Nov 04 02:15:19.376865 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.376745    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:10:17 +0000 UTC" deadline="2028-07-13 01:01:06.073907106 +0000 UTC"
Nov 04 02:15:19.376865 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:19.376811    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14806h45m46.697100744s"
Nov 04 02:15:20.918245 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:20.917939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:20.918796 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:20.918292    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:20.918796 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:20.918079    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:20.918796 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:20.918445    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:20.918796 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:20.918449    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs podName:36162c63-49e7-4782-8ea9-55db430a4c73 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:24.918422701 +0000 UTC m=+9.313245193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs") pod "network-metrics-daemon-xshqm" (UID: "36162c63-49e7-4782-8ea9-55db430a4c73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:20.918796 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:20.918520    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret podName:dcca8570-7261-499b-938a-10097ca652b0 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:24.918502449 +0000 UTC m=+9.313324933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret") pod "global-pull-secret-syncer-jzwmx" (UID: "dcca8570-7261-499b-938a-10097ca652b0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:21.021760 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:21.019158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr9bf\" (UniqueName: \"kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf\") pod \"network-check-target-7bvrs\" (UID: \"e8f75c8e-a241-4641-814e-f233535d9b7e\") " pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:21.021760 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:21.019363    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:21.021760 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:21.019391    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:21.021760 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:21.019407    2575 projected.go:196] Error preparing data for projected volume kube-api-access-hr9bf for pod openshift-network-diagnostics/network-check-target-7bvrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:21.021760 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:21.019471    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf podName:e8f75c8e-a241-4641-814e-f233535d9b7e nodeName:}" failed. No retries permitted until 2026-11-04 02:15:25.01945129 +0000 UTC m=+9.414273783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hr9bf" (UniqueName: "kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf") pod "network-check-target-7bvrs" (UID: "e8f75c8e-a241-4641-814e-f233535d9b7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:21.056551 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:21.056109    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:21.056551 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:21.056266    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:21.056551 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:21.056327    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:21.056551 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:21.056402    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:21.056551 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:21.056447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:21.056551 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:21.056518    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:22.123951 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:22.122939    2575 generic.go:356] "Generic (PLEG): container finished" podID="25537345b15c5579bee86c1fcfc147e8" containerID="116e825a71af679267a68e8429842ed134c2f755e66467e02d192ac5569984f6" exitCode=0
Nov 04 02:15:22.123951 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:22.122999    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal" event={"ID":"25537345b15c5579bee86c1fcfc147e8","Type":"ContainerDied","Data":"116e825a71af679267a68e8429842ed134c2f755e66467e02d192ac5569984f6"}
Nov 04 02:15:23.056903 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:23.056807    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:23.057093 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:23.056968    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:23.057093 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:23.057065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:23.057223 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:23.057167    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:23.057283 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:23.057237    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:23.057336 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:23.057318    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:23.133286 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:23.132487    2575 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="876060ab2c3937657f92be55806e03090a468122c4ec2d6dc2fbae5e7f687ff3" exitCode=0
Nov 04 02:15:23.133286 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:23.132888    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6s7g" event={"ID":"122326d1-cd64-4662-8234-9ce0718e5c32","Type":"ContainerDied","Data":"876060ab2c3937657f92be55806e03090a468122c4ec2d6dc2fbae5e7f687ff3"}
Nov 04 02:15:23.140468 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:23.140428    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal" event={"ID":"25537345b15c5579bee86c1fcfc147e8","Type":"ContainerStarted","Data":"f75ef79f8da9a540f33262d3e04d0de155f6b8881f081197cc710dfdc3fc93b6"}
Nov 04 02:15:23.144508 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:23.144458    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal" event={"ID":"c60ccd19b86040261adde19f6117c493","Type":"ContainerStarted","Data":"279288ab9b24fed8bd85ff10c4aacdb2570a9fa13c843fbecaed6215a5313d93"}
Nov 04 02:15:23.646466 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:23.646389    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal" podStartSLOduration=7.646368144 podStartE2EDuration="7.646368144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:23.514179394 +0000 UTC m=+7.909001952" watchObservedRunningTime="2026-11-04 02:15:23.646368144 +0000 UTC m=+8.041190647"
Nov 04 02:15:24.954900 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:24.954428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:24.954900 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:24.954558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:24.954900 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:24.954725    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:24.954900 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:24.954787    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs podName:36162c63-49e7-4782-8ea9-55db430a4c73 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:32.954766452 +0000 UTC m=+17.349589004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs") pod "network-metrics-daemon-xshqm" (UID: "36162c63-49e7-4782-8ea9-55db430a4c73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:24.954900 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:24.954844    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:24.954900 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:24.954874    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret podName:dcca8570-7261-499b-938a-10097ca652b0 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:32.954867411 +0000 UTC m=+17.349689887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret") pod "global-pull-secret-syncer-jzwmx" (UID: "dcca8570-7261-499b-938a-10097ca652b0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:25.055206 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:25.054892    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr9bf\" (UniqueName: \"kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf\") pod \"network-check-target-7bvrs\" (UID: \"e8f75c8e-a241-4641-814e-f233535d9b7e\") " pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:25.055206 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:25.055060    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:25.055206 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:25.055082    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:25.055206 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:25.055095    2575 projected.go:196] Error preparing data for projected volume kube-api-access-hr9bf for pod openshift-network-diagnostics/network-check-target-7bvrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:25.055206 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:25.055161    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf podName:e8f75c8e-a241-4641-814e-f233535d9b7e nodeName:}" failed. No retries permitted until 2026-11-04 02:15:33.055140815 +0000 UTC m=+17.449963308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hr9bf" (UniqueName: "kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf") pod "network-check-target-7bvrs" (UID: "e8f75c8e-a241-4641-814e-f233535d9b7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:25.056178 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:25.055827    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:25.056178 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:25.055929    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:25.056178 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:25.055995    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:25.056178 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:25.056057    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:25.056178 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:25.056103    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:25.056178 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:25.056146    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:25.156406 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:25.156321    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dtg7p" event={"ID":"3d9a67bf-5458-4857-acd0-473c00297677","Type":"ContainerStarted","Data":"0a4536b6de28bc411ea8bc45ed97ac06855893f9a45162dd4b1f8ecd401123e8"}
Nov 04 02:15:25.159611 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:25.159578    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6npmv" event={"ID":"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10","Type":"ContainerStarted","Data":"2c375750bc3815fc5bcc6a7e2a96a7b9b4936aa490a619db463b234b445c7934"}
Nov 04 02:15:25.276205 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:25.276141    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal" podStartSLOduration=8.276122794 podStartE2EDuration="8.276122794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:23.647451396 +0000 UTC m=+8.042273896" watchObservedRunningTime="2026-11-04 02:15:25.276122794 +0000 UTC m=+9.670945293"
Nov 04 02:15:25.276495 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:25.276459    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dtg7p" podStartSLOduration=3.212845742 podStartE2EDuration="9.276445705s" totalImagesPullingTime="6.063599963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:25.275772042 +0000 UTC m=+9.670594540" watchObservedRunningTime="2026-11-04 02:15:25.276445705 +0000 UTC m=+9.671268204"
Nov 04 02:15:26.166227 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:26.165875    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx" event={"ID":"a5d0efd2-3946-4144-8971-b4867230e8ec","Type":"ContainerStarted","Data":"a30151e6dee651aca2b929164d936a5106e625646fcc90a1eca8f823e4f06412"}
Nov 04 02:15:27.056630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:27.056591    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:27.056852 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:27.056753    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:27.056932 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:27.056858    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:27.056990 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:27.056942    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:27.057042 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:27.057001    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:27.057093 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:27.057067    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:27.354611 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:27.354562    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:27.355276 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:27.355251    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:27.475483 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:27.475432    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6npmv" podStartSLOduration=6.229393441 podStartE2EDuration="11.475416809s" totalImagesPullingTime="5.246023368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:25.396008408 +0000 UTC m=+9.790830909" watchObservedRunningTime="2026-11-04 02:15:27.475416809 +0000 UTC m=+11.870239308"
Nov 04 02:15:28.115445 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:28.115281    2575 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 02:15:28.179496 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:28.178914    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2bcnd" event={"ID":"d8b9b855-1e9b-47f9-b775-304910b95667","Type":"ContainerStarted","Data":"3e925239a7cda098d0dce802553c170f7d7c08d2904de870bb0bdd2138d4cf08"}
Nov 04 02:15:28.181202 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:28.181132    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8rx5r" event={"ID":"482a1092-091d-415e-bbbf-c2e41a770ba0","Type":"ContainerStarted","Data":"1994c1897b9e8714ad76f290acd7d70d61d50fb3f88aac31487cbf3db59cbbac"}
Nov 04 02:15:28.183580 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:28.183520    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx" event={"ID":"a5d0efd2-3946-4144-8971-b4867230e8ec","Type":"ContainerStarted","Data":"54d14dd4e211398033509d64f7282d52bb74880e67833c4e507fa68ef1c160fc"}
Nov 04 02:15:28.183826 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:28.183774    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:28.184585 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:28.184565    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:15:28.298182 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:28.298130    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-2bcnd" podStartSLOduration=3.305812961 podStartE2EDuration="12.298108984s" totalImagesPullingTime="8.992296023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:28.297751008 +0000 UTC m=+12.692573508" watchObservedRunningTime="2026-11-04 02:15:28.298108984 +0000 UTC m=+12.692931483"
Nov 04 02:15:28.420067 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:28.420000    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-8rx5r" podStartSLOduration=3.808795284 podStartE2EDuration="12.419979262s" totalImagesPullingTime="8.611183978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:28.419448684 +0000 UTC m=+12.814271181" watchObservedRunningTime="2026-11-04 02:15:28.419979262 +0000 UTC m=+12.814801761"
Nov 04 02:15:29.053629 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:29.053496    2575 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T02:15:28.115442024Z","UUID":"1d4f8a1e-717b-4932-989c-831d16f43be2","Handler":null,"Name":"","Endpoint":""}
Nov 04 02:15:29.055327 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:29.055284    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 02:15:29.055327 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:29.055321    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 02:15:29.055926 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:29.055814    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:29.055926 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:29.055833    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:29.056145 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:29.055950    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:29.056269 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:29.055818    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:29.058976 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:29.058944    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:29.059642 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:29.059602    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:29.188782 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:29.188689    2575 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="59c785b6f338c33face59566a6b64b41f57febc9807ab05ab3ca84c784e8333d" exitCode=0
Nov 04 02:15:29.188782 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:29.188760    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6s7g" event={"ID":"122326d1-cd64-4662-8234-9ce0718e5c32","Type":"ContainerDied","Data":"59c785b6f338c33face59566a6b64b41f57febc9807ab05ab3ca84c784e8333d"}
Nov 04 02:15:30.193147 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:30.193059    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jv78s" event={"ID":"159902bd-5489-46b3-8368-55551a6b9b68","Type":"ContainerStarted","Data":"32ea61467fe3f9cf22d3f0dfd393d05e964095497136d5f02b851c81878457a0"}
Nov 04 02:15:30.195509 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:30.195474    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx" event={"ID":"a5d0efd2-3946-4144-8971-b4867230e8ec","Type":"ContainerStarted","Data":"d3cd18193642f79f667bd98719e5d6f24a4085bab28fc083383a18c3b5e3bff6"}
Nov 04 02:15:30.197290 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:30.197260    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lwtfq" event={"ID":"82713f3a-e89e-4116-8160-03fbc4122635","Type":"ContainerStarted","Data":"d6edeec15fd8d74f0256d20ba0e0386c496e41bc13f571a7ae3960cd3d9959c6"}
Nov 04 02:15:30.433958 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:30.433902    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jv78s" podStartSLOduration=3.268569661 podStartE2EDuration="14.433886015s" totalImagesPullingTime="11.165316354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:30.315294638 +0000 UTC m=+14.710117137" watchObservedRunningTime="2026-11-04 02:15:30.433886015 +0000 UTC m=+14.828708503"
Nov 04 02:15:30.434191 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:30.434164    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lwtfq" podStartSLOduration=4.243668574 podStartE2EDuration="13.434158675s" totalImagesPullingTime="9.190490101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:30.433977775 +0000 UTC m=+14.828800272" watchObservedRunningTime="2026-11-04 02:15:30.434158675 +0000 UTC m=+14.828981215"
Nov 04 02:15:30.555513 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:30.555408    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx" podStartSLOduration=2.50308019 podStartE2EDuration="13.555390681s" totalImagesPullingTime="11.052310491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:30.555209374 +0000 UTC m=+14.950031872" watchObservedRunningTime="2026-11-04 02:15:30.555390681 +0000 UTC m=+14.950213227"
Nov 04 02:15:31.055885 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:31.055852    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:31.056088 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:31.055974    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:31.056088 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:31.055849    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:31.056179 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:31.056090    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:31.056179 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:31.056154    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:31.056266 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:31.056226    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:31.207448 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:31.207253    2575 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="110c8ee12620ba9afa52804c71d7828a1619825fab9a7cb6d5984b828dc1c53a" exitCode=0
Nov 04 02:15:31.208504 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:31.208260    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6s7g" event={"ID":"122326d1-cd64-4662-8234-9ce0718e5c32","Type":"ContainerDied","Data":"110c8ee12620ba9afa52804c71d7828a1619825fab9a7cb6d5984b828dc1c53a"}
Nov 04 02:15:33.015920 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:33.015640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:33.016468 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:33.015953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:33.016468 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:33.015789    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:33.016468 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:33.016067    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs podName:36162c63-49e7-4782-8ea9-55db430a4c73 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:49.016047583 +0000 UTC m=+33.410870071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs") pod "network-metrics-daemon-xshqm" (UID: "36162c63-49e7-4782-8ea9-55db430a4c73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:33.016468 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:33.016110    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:33.016468 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:33.016156    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret podName:dcca8570-7261-499b-938a-10097ca652b0 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:49.016140886 +0000 UTC m=+33.410963361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret") pod "global-pull-secret-syncer-jzwmx" (UID: "dcca8570-7261-499b-938a-10097ca652b0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:33.056714 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:33.056570    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:33.056714 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:33.056594    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:33.056714 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:33.056599    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:33.056940 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:33.056731    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:33.056940 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:33.056845    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:33.056940 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:33.056916    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:33.117027 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:33.116985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr9bf\" (UniqueName: \"kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf\") pod \"network-check-target-7bvrs\" (UID: \"e8f75c8e-a241-4641-814e-f233535d9b7e\") " pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:33.117220 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:33.117167    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:33.117220 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:33.117193    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:33.117220 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:33.117209    2575 projected.go:196] Error preparing data for projected volume kube-api-access-hr9bf for pod openshift-network-diagnostics/network-check-target-7bvrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:33.117376 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:33.117272    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf podName:e8f75c8e-a241-4641-814e-f233535d9b7e nodeName:}" failed. No retries permitted until 2026-11-04 02:15:49.117252674 +0000 UTC m=+33.512075153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hr9bf" (UniqueName: "kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf") pod "network-check-target-7bvrs" (UID: "e8f75c8e-a241-4641-814e-f233535d9b7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:33.215745 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:33.215706    2575 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="8c792fa516fccc568161d35bb57d80b6a38dbd6c355b8ed0bbabf14f3becff60" exitCode=0
Nov 04 02:15:33.215921 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:33.215764    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6s7g" event={"ID":"122326d1-cd64-4662-8234-9ce0718e5c32","Type":"ContainerDied","Data":"8c792fa516fccc568161d35bb57d80b6a38dbd6c355b8ed0bbabf14f3becff60"}
Nov 04 02:15:35.056809 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:35.056534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:35.057235 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:35.056623    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:35.057235 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:35.056847    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:35.057235 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:35.056637    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:35.057235 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:35.056942    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:35.057235 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:35.057005    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:35.223795 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:35.223765    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:15:35.224180 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:35.224152    2575 generic.go:356] "Generic (PLEG): container finished" podID="9a21ec19-27ea-4fd8-bbeb-154ef1063833" containerID="d1df727e6e503aa527389e3be87515c699885ec26f62950052ea2afcf50c501d" exitCode=1
Nov 04 02:15:35.224295 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:35.224218    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27" event={"ID":"9a21ec19-27ea-4fd8-bbeb-154ef1063833","Type":"ContainerStarted","Data":"2d453af6b8614fecff680ab8bc834876767ff55042cee82e4bddfb205da4a569"}
Nov 04 02:15:35.224351 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:35.224334    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27" event={"ID":"9a21ec19-27ea-4fd8-bbeb-154ef1063833","Type":"ContainerStarted","Data":"beb53c661e14f640b581e8597df93bc3be94cc721ae6bb5d9e2cbc417fd27ce1"}
Nov 04 02:15:35.224406 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:35.224385    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27" event={"ID":"9a21ec19-27ea-4fd8-bbeb-154ef1063833","Type":"ContainerStarted","Data":"e4805204e5abe87425c846abd88eceaa6292e7d5509d302c67265731e906b9b9"}
Nov 04 02:15:35.224454 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:35.224431    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27" event={"ID":"9a21ec19-27ea-4fd8-bbeb-154ef1063833","Type":"ContainerStarted","Data":"4491fd46e82a693b0745c0516f0d96b8164f52d39d5e23ae7fbbbe2481ba96e0"}
Nov 04 02:15:35.224490 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:35.224477    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27" event={"ID":"9a21ec19-27ea-4fd8-bbeb-154ef1063833","Type":"ContainerDied","Data":"d1df727e6e503aa527389e3be87515c699885ec26f62950052ea2afcf50c501d"}
Nov 04 02:15:35.224540 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:35.224527    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27" event={"ID":"9a21ec19-27ea-4fd8-bbeb-154ef1063833","Type":"ContainerStarted","Data":"1a515fe30e4a2bf187b2a4d36714f6ec54f2f27759c71506398a92f8525f5011"}
Nov 04 02:15:36.232267 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:36.232232    2575 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="5bd0253d82bb2c7990a144f5d34b50c8900961e1b0e03f7f81ef3f06320d906e" exitCode=0
Nov 04 02:15:36.232756 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:36.232295    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6s7g" event={"ID":"122326d1-cd64-4662-8234-9ce0718e5c32","Type":"ContainerDied","Data":"5bd0253d82bb2c7990a144f5d34b50c8900961e1b0e03f7f81ef3f06320d906e"}
Nov 04 02:15:37.056026 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:37.055989    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:37.056204 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:37.055989    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:37.056204 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:37.056100    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:37.056204 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:37.056180    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:37.056204 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:37.055997    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:37.056359 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:37.056244    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:37.237623 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:37.237529    2575 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="2073d18bb6600f922a6fba879dd586d313121afd04ee38fe460518b3444031c4" exitCode=0
Nov 04 02:15:37.237623 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:37.237618    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6s7g" event={"ID":"122326d1-cd64-4662-8234-9ce0718e5c32","Type":"ContainerDied","Data":"2073d18bb6600f922a6fba879dd586d313121afd04ee38fe460518b3444031c4"}
Nov 04 02:15:37.240921 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:37.240904    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:15:37.241308 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:37.241272    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27" event={"ID":"9a21ec19-27ea-4fd8-bbeb-154ef1063833","Type":"ContainerStarted","Data":"3e92a48110ffe4bff7363595460bead62bd12881ab31f4cf64525239f93f2bfd"}
Nov 04 02:15:38.059159 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:38.059122    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:38.059360 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:38.059245    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:38.246329 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:38.246293    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v6s7g" event={"ID":"122326d1-cd64-4662-8234-9ce0718e5c32","Type":"ContainerStarted","Data":"63ed9f06c28003f76a26dee99d4ebd3b331d49a697646bf2cd47255ecc77c717"}
Nov 04 02:15:39.056076 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:39.056039    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:39.056271 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:39.056092    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:39.056271 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:39.056199    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:39.056364 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:39.056318    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:39.252040 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:39.251812    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:15:39.252537 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:39.252439    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27" event={"ID":"9a21ec19-27ea-4fd8-bbeb-154ef1063833","Type":"ContainerStarted","Data":"21e00016f311823eb5c66a8ee2539b715295f65e89e95498b2dc3c54a41c0411"}
Nov 04 02:15:39.252949 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:39.252928    2575 scope.go:122] "RemoveContainer" containerID="d1df727e6e503aa527389e3be87515c699885ec26f62950052ea2afcf50c501d"
Nov 04 02:15:39.539993 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:39.539863    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v6s7g" podStartSLOduration=8.820883569 podStartE2EDuration="23.539846342s" totalImagesPullingTime="14.718962773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:38.373712963 +0000 UTC m=+22.768535464" watchObservedRunningTime="2026-11-04 02:15:39.539846342 +0000 UTC m=+23.934668834"
Nov 04 02:15:40.059261 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:40.059232    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:40.059421 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:40.059335    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:40.259191 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:40.259158    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:15:40.259619 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:40.259561    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27" event={"ID":"9a21ec19-27ea-4fd8-bbeb-154ef1063833","Type":"ContainerStarted","Data":"81fb911e8b26db482823dc4bae6e395b5b9f9a4f4c71280ceaed2b7a59626240"}
Nov 04 02:15:40.259737 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:40.259715    2575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 02:15:40.259982 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:40.259962    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:40.260093 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:40.260035    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:40.284193 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:40.284165    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:40.284496 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:40.284478    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:40.515758 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:40.515634    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27" podStartSLOduration=7.89353143 podStartE2EDuration="23.51561917s" totalImagesPullingTime="15.62208774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:40.489335802 +0000 UTC m=+24.884158301" watchObservedRunningTime="2026-11-04 02:15:40.51561917 +0000 UTC m=+24.910441669"
Nov 04 02:15:41.055776 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:41.055741    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:41.055776 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:41.055765    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:41.056006 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:41.055876    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:41.056050 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:41.056003    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:41.261836 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:41.261809    2575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 02:15:41.843731 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:41.843697    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jzwmx"]
Nov 04 02:15:41.843914 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:41.843803    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:41.843914 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:41.843895    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:41.846962 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:41.846931    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7bvrs"]
Nov 04 02:15:41.847114 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:41.847049    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:41.847157 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:41.847134    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:41.847787 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:41.847763    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xshqm"]
Nov 04 02:15:41.847889 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:41.847874    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:41.848024 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:41.847994    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:42.263996 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:42.263909    2575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 02:15:43.056056 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:43.056027    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:43.056221 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:43.056131    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:43.056221 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:43.056180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:43.056306 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:43.056268    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:43.126736 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:43.126702    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:15:44.056571 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:44.056534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:44.057026 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:44.056671    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:45.056636 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:45.056596    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:45.056636 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:45.056623    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:45.057085 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:45.056749    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:45.057085 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:45.056870    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:46.056968 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:46.056936    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:46.057400 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:46.057054    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:47.056184 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:47.056141    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:47.056392 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:47.056141    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:47.056392 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:47.056268    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xshqm" podUID="36162c63-49e7-4782-8ea9-55db430a4c73"
Nov 04 02:15:47.056392 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:47.056363    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jzwmx" podUID="dcca8570-7261-499b-938a-10097ca652b0"
Nov 04 02:15:48.056692 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.056483    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:48.057090 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.056779    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bvrs" podUID="e8f75c8e-a241-4641-814e-f233535d9b7e"
Nov 04 02:15:48.378092 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.378066    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeReady"
Nov 04 02:15:48.378271 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.378204    2575 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 04 02:15:48.504908 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.504874    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-6dk89"]
Nov 04 02:15:48.520883 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.520844    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-6dk89"
Nov 04 02:15:48.553032 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.552990    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bxplw"]
Nov 04 02:15:48.568676 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.568623    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-4sqvd"]
Nov 04 02:15:48.568842 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.568747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-bxplw"
Nov 04 02:15:48.579006 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.578984    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b8f6d865c-c8tlq"]
Nov 04 02:15:48.579125 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.579096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-4sqvd"
Nov 04 02:15:48.592978 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.592949    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-ts54b"]
Nov 04 02:15:48.593148 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.593096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.606976 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.606942    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Nov 04 02:15:48.606976 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.606975    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Nov 04 02:15:48.609306 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.609271    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"]
Nov 04 02:15:48.609451 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.609411    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.623593 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.623563    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"]
Nov 04 02:15:48.623797 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.623708    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:15:48.631287 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.631199    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxbr9\" (UniqueName: \"kubernetes.io/projected/735db15d-9069-4b87-ab87-7ed88d365bdb-kube-api-access-bxbr9\") pod \"kas-connection-checker-685895c7c9-6dk89\" (UID: \"735db15d-9069-4b87-ab87-7ed88d365bdb\") " pod="kube-system/kas-connection-checker-685895c7c9-6dk89"
Nov 04 02:15:48.631639 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.631359    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb95c\" (UniqueName: \"kubernetes.io/projected/be37687a-5d12-4543-83eb-61961531f81f-kube-api-access-pb95c\") pod \"kas-connection-checker-685895c7c9-bxplw\" (UID: \"be37687a-5d12-4543-83eb-61961531f81f\") " pod="kube-system/kas-connection-checker-685895c7c9-bxplw"
Nov 04 02:15:48.637609 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.637582    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"]
Nov 04 02:15:48.637769 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.637750    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:48.650428 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.650397    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Nov 04 02:15:48.650428 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.650422    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Nov 04 02:15:48.655941 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.655911    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Nov 04 02:15:48.657797 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.657760    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78"]
Nov 04 02:15:48.657943 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.657910    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.665372 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.665349    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Nov 04 02:15:48.676987 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.676948    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Nov 04 02:15:48.677161 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.677024    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 04 02:15:48.677161 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.677024    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 04 02:15:48.677161 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.677113    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 02:15:48.677161 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.677142    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 02:15:48.677477 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.677459    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 04 02:15:48.679868 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.679843    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"]
Nov 04 02:15:48.680010 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.679992    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78"
Nov 04 02:15:48.695607 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.695566    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"]
Nov 04 02:15:48.695886 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.695721    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:15:48.714382 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.711221    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 04 02:15:48.730282 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.730247    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-748544dd76-rmtdh"]
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.731079    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732262    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42s9q\" (UniqueName: \"kubernetes.io/projected/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-kube-api-access-42s9q\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69dc840b-bd18-41ad-a213-f0d2c1252fca-serving-cert\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aece3088-8729-43a1-8533-7bdd145d2fdd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732456    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsdwr\" (UniqueName: \"kubernetes.io/projected/aece3088-8729-43a1-8533-7bdd145d2fdd-kube-api-access-vsdwr\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4gp6\" (UniqueName: \"kubernetes.io/projected/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-kube-api-access-c4gp6\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-config\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb95c\" (UniqueName: \"kubernetes.io/projected/be37687a-5d12-4543-83eb-61961531f81f-kube-api-access-pb95c\") pod \"kas-connection-checker-685895c7c9-bxplw\" (UID: \"be37687a-5d12-4543-83eb-61961531f81f\") " pod="kube-system/kas-connection-checker-685895c7c9-bxplw"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5435f585-4325-42b2-8992-988af472d105-serving-cert\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxbr9\" (UniqueName: \"kubernetes.io/projected/735db15d-9069-4b87-ab87-7ed88d365bdb-kube-api-access-bxbr9\") pod \"kas-connection-checker-685895c7c9-6dk89\" (UID: \"735db15d-9069-4b87-ab87-7ed88d365bdb\") " pod="kube-system/kas-connection-checker-685895c7c9-6dk89"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732722    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-tmp\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732751    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w48f\" (UniqueName: \"kubernetes.io/projected/5435f585-4325-42b2-8992-988af472d105-kube-api-access-2w48f\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.732803    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.733288    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czjth\" (UniqueName: \"kubernetes.io/projected/69dc840b-bd18-41ad-a213-f0d2c1252fca-kube-api-access-czjth\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.737310 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.733457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgs6g\" (UniqueName: \"kubernetes.io/projected/1486093b-695f-4ba3-8737-385bfe779147-kube-api-access-sgs6g\") pod \"kas-connection-checker-685895c7c9-4sqvd\" (UID: \"1486093b-695f-4ba3-8737-385bfe779147\") " pod="kube-system/kas-connection-checker-685895c7c9-4sqvd"
Nov 04 02:15:48.738057 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.733502    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.738057 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.733542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-snapshots\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.738057 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.733599    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-service-ca-bundle\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.738057 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.733632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-serving-cert\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:15:48.738057 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.733668    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-config\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:15:48.738057 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.733771    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-default-certificate\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.738057 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.733803    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.738057 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.733862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-stats-auth\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.738057 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.733892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.738057 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.734019    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-trusted-ca\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.750277 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.750252    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Nov 04 02:15:48.750417 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.750279    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Nov 04 02:15:48.750417 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.750305    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Nov 04 02:15:48.750417 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.750335    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Nov 04 02:15:48.752748 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.752729    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bcfd7b985-mn847"]
Nov 04 02:15:48.752853 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.752839    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.774778 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.774740    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq"]
Nov 04 02:15:48.774977 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.774870    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.777183 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777155    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Nov 04 02:15:48.777330 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777157    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Nov 04 02:15:48.777330 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777235    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:48.777330 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777317    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:48.777330 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777326    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Nov 04 02:15:48.777538 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777348    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Nov 04 02:15:48.777538 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777370    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Nov 04 02:15:48.777538 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777382    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:48.777538 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777381    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 02:15:48.777538 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777318    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:48.777538 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777475    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Nov 04 02:15:48.777538 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777488    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Nov 04 02:15:48.777538 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.777528    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 02:15:48.778115 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.778088    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Nov 04 02:15:48.778762 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.778744    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Nov 04 02:15:48.790851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.790817    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Nov 04 02:15:48.790851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.790817    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-q8p76\""
Nov 04 02:15:48.791052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.790885    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Nov 04 02:15:48.797834 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.797804    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"]
Nov 04 02:15:48.798027 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.798003    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq"
Nov 04 02:15:48.801852 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.801828    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxbr9\" (UniqueName: \"kubernetes.io/projected/735db15d-9069-4b87-ab87-7ed88d365bdb-kube-api-access-bxbr9\") pod \"kas-connection-checker-685895c7c9-6dk89\" (UID: \"735db15d-9069-4b87-ab87-7ed88d365bdb\") " pod="kube-system/kas-connection-checker-685895c7c9-6dk89"
Nov 04 02:15:48.801975 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.801829    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb95c\" (UniqueName: \"kubernetes.io/projected/be37687a-5d12-4543-83eb-61961531f81f-kube-api-access-pb95c\") pod \"kas-connection-checker-685895c7c9-bxplw\" (UID: \"be37687a-5d12-4543-83eb-61961531f81f\") " pod="kube-system/kas-connection-checker-685895c7c9-bxplw"
Nov 04 02:15:48.821141 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.821105    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b6zs7"]
Nov 04 02:15:48.821277 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.821244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:48.835048 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsdwr\" (UniqueName: \"kubernetes.io/projected/aece3088-8729-43a1-8533-7bdd145d2fdd-kube-api-access-vsdwr\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:48.835190 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:15:48.835190 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40222b3d-3cdb-4da6-8bfa-3764919a09a4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:15:48.835190 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:15:48.835299 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835249    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npks9\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-kube-api-access-npks9\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.835332 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835297    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvxlk\" (UniqueName: \"kubernetes.io/projected/40222b3d-3cdb-4da6-8bfa-3764919a09a4-kube-api-access-zvxlk\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:15:48.835396 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.835447 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-tmp\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.835447 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w48f\" (UniqueName: \"kubernetes.io/projected/5435f585-4325-42b2-8992-988af472d105-kube-api-access-2w48f\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.835524 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:48.835571 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835541    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjth\" (UniqueName: \"kubernetes.io/projected/69dc840b-bd18-41ad-a213-f0d2c1252fca-kube-api-access-czjth\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.835571 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.835564    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 04 02:15:48.835645 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835587    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-bound-sa-token\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.835645 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.835625    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls podName:aece3088-8729-43a1-8533-7bdd145d2fdd nodeName:}" failed. No retries permitted until 2026-11-04 02:15:49.335605083 +0000 UTC m=+33.730427565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-vckzn" (UID: "aece3088-8729-43a1-8533-7bdd145d2fdd") : secret "cluster-monitoring-operator-tls" not found
Nov 04 02:15:48.835800 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-snapshots\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.835800 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-service-ca-bundle\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.835800 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-config\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:15:48.835951 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835803    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-default-certificate\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.835951 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.835951 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-trusted-ca\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.835951 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835885    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-tmp\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.835951 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdmnh\" (UniqueName: \"kubernetes.io/projected/c80a9883-2db8-4389-aba0-813ecf38be30-kube-api-access-zdmnh\") pod \"volume-data-source-validator-58c9f5f46d-clp78\" (UID: \"c80a9883-2db8-4389-aba0-813ecf38be30\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78"
Nov 04 02:15:48.835951 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.836229 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.835980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.836229 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.836007    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 02:15:48.836229 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836030    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-image-registry-private-configuration\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.836229 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836056    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e96b7798-598c-4934-a2a1-40cb966e98c4-ca-trust-extracted\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.836229 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.836067    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:49.336051069 +0000 UTC m=+33.730873561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : secret "router-metrics-certs-default" not found
Nov 04 02:15:48.836229 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-trusted-ca\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.836229 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836176    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4gp6\" (UniqueName: \"kubernetes.io/projected/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-kube-api-access-c4gp6\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:15:48.836572 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836234    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-installation-pull-secrets\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.836572 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836355    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-snapshots\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.836572 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-config\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.836572 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836407    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-service-ca-bundle\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.836572 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836433    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-config\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:15:48.836572 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpxxh\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-kube-api-access-vpxxh\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.836572 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836528    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5435f585-4325-42b2-8992-988af472d105-serving-cert\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.836572 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836560    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-bound-sa-token\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.836899 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836592    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgs6g\" (UniqueName: \"kubernetes.io/projected/1486093b-695f-4ba3-8737-385bfe779147-kube-api-access-sgs6g\") pod \"kas-connection-checker-685895c7c9-4sqvd\" (UID: \"1486093b-695f-4ba3-8737-385bfe779147\") " pod="kube-system/kas-connection-checker-685895c7c9-4sqvd"
Nov 04 02:15:48.836899 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.836899 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836709    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.836899 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40222b3d-3cdb-4da6-8bfa-3764919a09a4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:15:48.836899 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.836828    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:49.336812702 +0000 UTC m=+33.731635202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : configmap references non-existent config key: service-ca.crt
Nov 04 02:15:48.836899 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-serving-cert\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:15:48.837160 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-image-registry-private-configuration\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.837160 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-trusted-ca\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.837160 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.836958    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-stats-auth\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.837160 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.837008    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42s9q\" (UniqueName: \"kubernetes.io/projected/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-kube-api-access-42s9q\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.837160 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.837032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69dc840b-bd18-41ad-a213-f0d2c1252fca-serving-cert\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.837160 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.837041    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-config\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.837160 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.837081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/470117a5-ef70-4fbe-a60d-68fb047e3e53-ca-trust-extracted\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.837160 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.837107    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-certificates\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.837160 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.837141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aece3088-8729-43a1-8533-7bdd145d2fdd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:48.837784 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.837170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-certificates\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.837784 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.837196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-installation-pull-secrets\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.838109 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.838084    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-trusted-ca\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.838380 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.838353    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aece3088-8729-43a1-8533-7bdd145d2fdd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:48.839155 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.839130    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-default-certificate\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.839406 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.839376    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-serving-cert\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:15:48.839649 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.839629    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-stats-auth\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.839727 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.839649    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69dc840b-bd18-41ad-a213-f0d2c1252fca-serving-cert\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.839788 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.839773    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5435f585-4325-42b2-8992-988af472d105-serving-cert\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.840699 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.840644    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-6dk89"
Nov 04 02:15:48.843174 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.843152    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-4sqvd"]
Nov 04 02:15:48.843251 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.843196    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-6dk89"]
Nov 04 02:15:48.843251 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.843220    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bxplw"]
Nov 04 02:15:48.843251 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.843243    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-clnj4"]
Nov 04 02:15:48.843412 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.843323    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:48.850687 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.850648    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 04 02:15:48.850781 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.850745    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 04 02:15:48.850972 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.850954    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 04 02:15:48.851019 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.851005    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rhnhd\""
Nov 04 02:15:48.867866 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.867832    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"]
Nov 04 02:15:48.868001 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.867881    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"]
Nov 04 02:15:48.868001 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.867907    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b8f6d865c-c8tlq"]
Nov 04 02:15:48.868001 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.867921    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-ts54b"]
Nov 04 02:15:48.868001 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.867937    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78"]
Nov 04 02:15:48.868001 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.867950    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq"]
Nov 04 02:15:48.868001 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.867964    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"]
Nov 04 02:15:48.868001 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.867975    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:15:48.868552 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.867984    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clnj4"]
Nov 04 02:15:48.868552 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.868110    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-748544dd76-rmtdh"]
Nov 04 02:15:48.868552 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.868134    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"]
Nov 04 02:15:48.868552 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.868157    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"]
Nov 04 02:15:48.868552 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.868176    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bcfd7b985-mn847"]
Nov 04 02:15:48.868552 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.868197    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"]
Nov 04 02:15:48.868552 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.868224    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b6zs7"]
Nov 04 02:15:48.877175 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.877156    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 02:15:48.877874 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.877498    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:48.877874 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.877589    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Nov 04 02:15:48.877874 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.877591    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 02:15:48.877874 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.877648    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Nov 04 02:15:48.878387 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.878365    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 04 02:15:48.887718 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.887638    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-bxplw"
Nov 04 02:15:48.899562 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.899526    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czjth\" (UniqueName: \"kubernetes.io/projected/69dc840b-bd18-41ad-a213-f0d2c1252fca-kube-api-access-czjth\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:48.899995 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.899967    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsdwr\" (UniqueName: \"kubernetes.io/projected/aece3088-8729-43a1-8533-7bdd145d2fdd-kube-api-access-vsdwr\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:48.900213 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.900194    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w48f\" (UniqueName: \"kubernetes.io/projected/5435f585-4325-42b2-8992-988af472d105-kube-api-access-2w48f\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.905105 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.905082    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4gp6\" (UniqueName: \"kubernetes.io/projected/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-kube-api-access-c4gp6\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:15:48.905359 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.905340    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgs6g\" (UniqueName: \"kubernetes.io/projected/1486093b-695f-4ba3-8737-385bfe779147-kube-api-access-sgs6g\") pod \"kas-connection-checker-685895c7c9-4sqvd\" (UID: \"1486093b-695f-4ba3-8737-385bfe779147\") " pod="kube-system/kas-connection-checker-685895c7c9-4sqvd"
Nov 04 02:15:48.906573 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.906551    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42s9q\" (UniqueName: \"kubernetes.io/projected/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-kube-api-access-42s9q\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:48.934778 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.934749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:15:48.938550 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40222b3d-3cdb-4da6-8bfa-3764919a09a4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:15:48.938693 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938583    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:48.938693 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-image-registry-private-configuration\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.938693 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938670    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/470117a5-ef70-4fbe-a60d-68fb047e3e53-ca-trust-extracted\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.938917 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-certificates\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.938917 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-cert\") pod \"ingress-canary-clnj4\" (UID: \"5ab36405-af90-4b38-9ede-4ffad5c1ad8f\") " pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:15:48.938917 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-certificates\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.938917 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-installation-pull-secrets\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.938917 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:15:48.938917 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40222b3d-3cdb-4da6-8bfa-3764919a09a4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:15:48.938917 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938911    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxsps\" (UniqueName: \"kubernetes.io/projected/ba210879-af81-4f17-9948-16a94100f39b-kube-api-access-zxsps\") pod \"network-check-source-6f78d59f99-hl8hq\" (UID: \"ba210879-af81-4f17-9948-16a94100f39b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq"
Nov 04 02:15:48.939238 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938941    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:15:48.939238 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npks9\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-kube-api-access-npks9\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.939238 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939000    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/470117a5-ef70-4fbe-a60d-68fb047e3e53-ca-trust-extracted\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.939238 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.938994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvxlk\" (UniqueName: \"kubernetes.io/projected/40222b3d-3cdb-4da6-8bfa-3764919a09a4-kube-api-access-zvxlk\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:15:48.939238 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcgwg\" (UniqueName: \"kubernetes.io/projected/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-kube-api-access-pcgwg\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:48.939238 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.939238 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-bound-sa-token\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-tmp-dir\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939281    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-trusted-ca\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdmnh\" (UniqueName: \"kubernetes.io/projected/c80a9883-2db8-4389-aba0-813ecf38be30-kube-api-access-zdmnh\") pod \"volume-data-source-validator-58c9f5f46d-clp78\" (UID: \"c80a9883-2db8-4389-aba0-813ecf38be30\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8hjr\" (UniqueName: \"kubernetes.io/projected/dc3025c2-fdcb-4557-b5af-0433a3f89fef-kube-api-access-q8hjr\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-image-registry-private-configuration\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e96b7798-598c-4934-a2a1-40cb966e98c4-ca-trust-extracted\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-trusted-ca\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939496    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-certificates\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939496    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-certificates\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.939554 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.939550    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-installation-pull-secrets\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.940361 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.940339    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-trusted-ca\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.940453 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.940406    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 04 02:15:48.940503 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.940472    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert podName:e0514b3f-cb7b-475a-9338-8a9ae26f8fb9 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:49.440454584 +0000 UTC m=+33.835277060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8ztwg" (UID: "e0514b3f-cb7b-475a-9338-8a9ae26f8fb9") : secret "networking-console-plugin-cert" not found
Nov 04 02:15:48.940503 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.940483    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-trusted-ca\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.940604 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.940514    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40222b3d-3cdb-4da6-8bfa-3764919a09a4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:15:48.940809 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.940790    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:15:48.940994 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.940810    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748544dd76-rmtdh: secret "image-registry-tls" not found
Nov 04 02:15:48.940994 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.940828    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e96b7798-598c-4934-a2a1-40cb966e98c4-ca-trust-extracted\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.940994 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.940986    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls podName:470117a5-ef70-4fbe-a60d-68fb047e3e53 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:49.440967557 +0000 UTC m=+33.835790048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls") pod "image-registry-748544dd76-rmtdh" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53") : secret "image-registry-tls" not found
Nov 04 02:15:48.941207 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.941187    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:15:48.941253 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.941235    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:15:48.941253 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.941248    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcfd7b985-mn847: secret "image-registry-tls" not found
Nov 04 02:15:48.941327 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:48.941286    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls podName:e96b7798-598c-4934-a2a1-40cb966e98c4 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:49.441273466 +0000 UTC m=+33.836095956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls") pod "image-registry-6bcfd7b985-mn847" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4") : secret "image-registry-tls" not found
Nov 04 02:15:48.941380 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.941361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpxxh\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-kube-api-access-vpxxh\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.941712 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.941585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-bound-sa-token\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.941712 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.941602    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-installation-pull-secrets\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.941712 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.941625    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-config-volume\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:48.941712 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.941643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:48.941970 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.941743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xvrt\" (UniqueName: \"kubernetes.io/projected/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-kube-api-access-6xvrt\") pod \"ingress-canary-clnj4\" (UID: \"5ab36405-af90-4b38-9ede-4ffad5c1ad8f\") " pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:15:48.943154 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.943132    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-image-registry-private-configuration\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.943693 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.943306    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40222b3d-3cdb-4da6-8bfa-3764919a09a4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:15:48.943693 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.943624    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-installation-pull-secrets\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:48.944119 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.944088    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-image-registry-private-configuration\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:48.950896 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.950868    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 02:15:48.950896 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.950896    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Nov 04 02:15:48.951045 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.950954    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-v7b9k\""
Nov 04 02:15:48.951045 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.950965    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 02:15:48.951045 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.951005    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n2j4c\""
Nov 04 02:15:48.959006 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.958848    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:15:48.978722 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.977817    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 02:15:48.978722 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.978610    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 02:15:48.979144 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:48.979115    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 02:15:49.003752 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.003726    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npks9\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-kube-api-access-npks9\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:49.005418 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.005389    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvxlk\" (UniqueName: \"kubernetes.io/projected/40222b3d-3cdb-4da6-8bfa-3764919a09a4-kube-api-access-zvxlk\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:15:49.006460 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.006411    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:49.012369 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.012319    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdmnh\" (UniqueName: \"kubernetes.io/projected/c80a9883-2db8-4389-aba0-813ecf38be30-kube-api-access-zdmnh\") pod \"volume-data-source-validator-58c9f5f46d-clp78\" (UID: \"c80a9883-2db8-4389-aba0-813ecf38be30\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78"
Nov 04 02:15:49.012465 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.012369    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-bound-sa-token\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:49.013413 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.013386    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-bound-sa-token\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:49.017187 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.017166    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpxxh\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-kube-api-access-vpxxh\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:49.031010 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.030803    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78"
Nov 04 02:15:49.044564 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.043472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-cert\") pod \"ingress-canary-clnj4\" (UID: \"5ab36405-af90-4b38-9ede-4ffad5c1ad8f\") " pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:15:49.044564 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.043521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxsps\" (UniqueName: \"kubernetes.io/projected/ba210879-af81-4f17-9948-16a94100f39b-kube-api-access-zxsps\") pod \"network-check-source-6f78d59f99-hl8hq\" (UID: \"ba210879-af81-4f17-9948-16a94100f39b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq"
Nov 04 02:15:49.044564 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.043567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgwg\" (UniqueName: \"kubernetes.io/projected/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-kube-api-access-pcgwg\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:49.044564 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.043638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-tmp-dir\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:49.044766 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.044730    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-tmp-dir\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.044934    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.044961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8hjr\" (UniqueName: \"kubernetes.io/projected/dc3025c2-fdcb-4557-b5af-0433a3f89fef-kube-api-access-q8hjr\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.044995    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.045016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.045033    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.045100    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls podName:dc3025c2-fdcb-4557-b5af-0433a3f89fef nodeName:}" failed. No retries permitted until 2026-11-04 02:15:49.545079623 +0000 UTC m=+33.939902119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-hx9zj" (UID: "dc3025c2-fdcb-4557-b5af-0433a3f89fef") : secret "samples-operator-tls" not found
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.045038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-config-volume\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.045141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.045187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xvrt\" (UniqueName: \"kubernetes.io/projected/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-kube-api-access-6xvrt\") pod \"ingress-canary-clnj4\" (UID: \"5ab36405-af90-4b38-9ede-4ffad5c1ad8f\") " pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.045233    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.045422    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-config-volume\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.045688    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.045724    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs podName:36162c63-49e7-4782-8ea9-55db430a4c73 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:21.045713585 +0000 UTC m=+65.440536074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs") pod "network-metrics-daemon-xshqm" (UID: "36162c63-49e7-4782-8ea9-55db430a4c73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.045766    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.045786    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret podName:dcca8570-7261-499b-938a-10097ca652b0 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:21.04578005 +0000 UTC m=+65.440602527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret") pod "global-pull-secret-syncer-jzwmx" (UID: "dcca8570-7261-499b-938a-10097ca652b0") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:49.045950 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.045820    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 02:15:49.046538 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.045838    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls podName:ab58cc26-ed1e-4d73-b63a-9ca5b327d18a nodeName:}" failed. No retries permitted until 2026-11-04 02:15:49.545832513 +0000 UTC m=+33.940654989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls") pod "dns-default-b6zs7" (UID: "ab58cc26-ed1e-4d73-b63a-9ca5b327d18a") : secret "dns-default-metrics-tls" not found
Nov 04 02:15:49.046538 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.045914    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:49.050114 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.048821    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-cert\") pod \"ingress-canary-clnj4\" (UID: \"5ab36405-af90-4b38-9ede-4ffad5c1ad8f\") " pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:15:49.053212 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.053005    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:15:49.059973 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.059939    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:15:49.060394 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.059953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:15:49.107204 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.107160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:15:49.109135 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.108688    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxsps\" (UniqueName: \"kubernetes.io/projected/ba210879-af81-4f17-9948-16a94100f39b-kube-api-access-zxsps\") pod \"network-check-source-6f78d59f99-hl8hq\" (UID: \"ba210879-af81-4f17-9948-16a94100f39b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq"
Nov 04 02:15:49.112390 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.112360    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8hjr\" (UniqueName: \"kubernetes.io/projected/dc3025c2-fdcb-4557-b5af-0433a3f89fef-kube-api-access-q8hjr\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:49.112645 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.112625    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xvrt\" (UniqueName: \"kubernetes.io/projected/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-kube-api-access-6xvrt\") pod \"ingress-canary-clnj4\" (UID: \"5ab36405-af90-4b38-9ede-4ffad5c1ad8f\") " pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:15:49.113891 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.113872    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcgwg\" (UniqueName: \"kubernetes.io/projected/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-kube-api-access-pcgwg\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:49.117898 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.117631    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k925t\""
Nov 04 02:15:49.117898 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.117802    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 02:15:49.117898 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.117863    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-nw2cx\""
Nov 04 02:15:49.117898 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.117869    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 02:15:49.145778 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.145711    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq"
Nov 04 02:15:49.146034 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.146015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr9bf\" (UniqueName: \"kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf\") pod \"network-check-target-7bvrs\" (UID: \"e8f75c8e-a241-4641-814e-f233535d9b7e\") " pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:49.148565 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.148540    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr9bf\" (UniqueName: \"kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf\") pod \"network-check-target-7bvrs\" (UID: \"e8f75c8e-a241-4641-814e-f233535d9b7e\") " pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:49.202390 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.202359    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-4sqvd"
Nov 04 02:15:49.208532 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.208505    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:15:49.278252 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.277557    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-6dk89"]
Nov 04 02:15:49.284010 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.280871    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bxplw"]
Nov 04 02:15:49.291415 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:49.291273    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe37687a_5d12_4543_83eb_61961531f81f.slice/crio-a4e7f05fa0e72d52dffc77b414fba839bce82f20ee554fe6ea29a69a84be077d WatchSource:0}: Error finding container a4e7f05fa0e72d52dffc77b414fba839bce82f20ee554fe6ea29a69a84be077d: Status 404 returned error can't find the container with id a4e7f05fa0e72d52dffc77b414fba839bce82f20ee554fe6ea29a69a84be077d
Nov 04 02:15:49.325846 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:49.325811    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5435f585_4325_42b2_8992_988af472d105.slice/crio-70d7fcbc726be444c444e9994a171c17e8ce8a0878a113a72c1c3c11404e7959 WatchSource:0}: Error finding container 70d7fcbc726be444c444e9994a171c17e8ce8a0878a113a72c1c3c11404e7959: Status 404 returned error can't find the container with id 70d7fcbc726be444c444e9994a171c17e8ce8a0878a113a72c1c3c11404e7959
Nov 04 02:15:49.327320 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.327239    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-ts54b"]
Nov 04 02:15:49.338246 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.338220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:15:49.348623 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.348240    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:49.348623 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.348310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:49.348623 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.348388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:49.348623 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.348421    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 04 02:15:49.348623 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.348492    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls podName:aece3088-8729-43a1-8533-7bdd145d2fdd nodeName:}" failed. No retries permitted until 2026-11-04 02:15:50.348471922 +0000 UTC m=+34.743294412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-vckzn" (UID: "aece3088-8729-43a1-8533-7bdd145d2fdd") : secret "cluster-monitoring-operator-tls" not found
Nov 04 02:15:49.348623 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.348511    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:50.348502016 +0000 UTC m=+34.743324492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : configmap references non-existent config key: service-ca.crt
Nov 04 02:15:49.348623 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.348554    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 02:15:49.348623 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.348595    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:50.34858479 +0000 UTC m=+34.743407267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : secret "router-metrics-certs-default" not found
Nov 04 02:15:49.375959 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.375923    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"]
Nov 04 02:15:49.381762 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:49.381735    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f3aa40_09ba_47db_b65b_ed4db9045c1f.slice/crio-3c79da8c2694dcbeaa5f2c20a78050cfaf217303165e1bc7c51adce0bc056061 WatchSource:0}: Error finding container 3c79da8c2694dcbeaa5f2c20a78050cfaf217303165e1bc7c51adce0bc056061: Status 404 returned error can't find the container with id 3c79da8c2694dcbeaa5f2c20a78050cfaf217303165e1bc7c51adce0bc056061
Nov 04 02:15:49.418816 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:49.418790    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80a9883_2db8_4389_aba0_813ecf38be30.slice/crio-ef80eef695c679633b66e0907d584ec1a4f132eadb565a5a5df4b4e3e6ab2ce3 WatchSource:0}: Error finding container ef80eef695c679633b66e0907d584ec1a4f132eadb565a5a5df4b4e3e6ab2ce3: Status 404 returned error can't find the container with id ef80eef695c679633b66e0907d584ec1a4f132eadb565a5a5df4b4e3e6ab2ce3
Nov 04 02:15:49.422648 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.421891    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78"]
Nov 04 02:15:49.423362 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:49.423337    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69dc840b_bd18_41ad_a213_f0d2c1252fca.slice/crio-f836d7cad3ba9279d3edf5782ea51af37ee79e7d4e527fe50e0a21298a547237 WatchSource:0}: Error finding container f836d7cad3ba9279d3edf5782ea51af37ee79e7d4e527fe50e0a21298a547237: Status 404 returned error can't find the container with id f836d7cad3ba9279d3edf5782ea51af37ee79e7d4e527fe50e0a21298a547237
Nov 04 02:15:49.424256 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.424233    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"]
Nov 04 02:15:49.449512 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.449481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:49.449643 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:49.449516    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40222b3d_3cdb_4da6_8bfa_3764919a09a4.slice/crio-68a62d211c055303d6576b87c77e6ea65b50e01063e4674498876a815f5a5339 WatchSource:0}: Error finding container 68a62d211c055303d6576b87c77e6ea65b50e01063e4674498876a815f5a5339: Status 404 returned error can't find the container with id 68a62d211c055303d6576b87c77e6ea65b50e01063e4674498876a815f5a5339
Nov 04 02:15:49.449643 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.449606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:15:49.449643 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.449634    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:49.449643 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.449638    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:15:49.449832 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.449680    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748544dd76-rmtdh: secret "image-registry-tls" not found
Nov 04 02:15:49.449832 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.449746    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls podName:470117a5-ef70-4fbe-a60d-68fb047e3e53 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:50.449723878 +0000 UTC m=+34.844546377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls") pod "image-registry-748544dd76-rmtdh" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53") : secret "image-registry-tls" not found
Nov 04 02:15:49.449832 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.449754    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 04 02:15:49.449832 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.449757    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:15:49.449832 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.449775    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcfd7b985-mn847: secret "image-registry-tls" not found
Nov 04 02:15:49.449832 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.449814    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls podName:e96b7798-598c-4934-a2a1-40cb966e98c4 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:50.449798858 +0000 UTC m=+34.844621350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls") pod "image-registry-6bcfd7b985-mn847" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4") : secret "image-registry-tls" not found
Nov 04 02:15:49.449832 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.449828    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert podName:e0514b3f-cb7b-475a-9338-8a9ae26f8fb9 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:50.449822355 +0000 UTC m=+34.844644831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8ztwg" (UID: "e0514b3f-cb7b-475a-9338-8a9ae26f8fb9") : secret "networking-console-plugin-cert" not found
Nov 04 02:15:49.451607 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.451563    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"]
Nov 04 02:15:49.514674 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.514627    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq"]
Nov 04 02:15:49.550566 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.550520    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:49.550811 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.550715    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 02:15:49.550811 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.550719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:49.550940 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.550786    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls podName:ab58cc26-ed1e-4d73-b63a-9ca5b327d18a nodeName:}" failed. No retries permitted until 2026-11-04 02:15:50.550769563 +0000 UTC m=+34.945592067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls") pod "dns-default-b6zs7" (UID: "ab58cc26-ed1e-4d73-b63a-9ca5b327d18a") : secret "dns-default-metrics-tls" not found
Nov 04 02:15:49.550940 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.550822    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 02:15:49.550940 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:49.550878    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls podName:dc3025c2-fdcb-4557-b5af-0433a3f89fef nodeName:}" failed. No retries permitted until 2026-11-04 02:15:50.550863038 +0000 UTC m=+34.945685528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-hx9zj" (UID: "dc3025c2-fdcb-4557-b5af-0433a3f89fef") : secret "samples-operator-tls" not found
Nov 04 02:15:49.579523 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:49.579490    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1486093b_695f_4ba3_8737_385bfe779147.slice/crio-42296015d7c9d4f29db28b10eb503019be6d047af6f5042571735f9d9c7d5841 WatchSource:0}: Error finding container 42296015d7c9d4f29db28b10eb503019be6d047af6f5042571735f9d9c7d5841: Status 404 returned error can't find the container with id 42296015d7c9d4f29db28b10eb503019be6d047af6f5042571735f9d9c7d5841
Nov 04 02:15:49.581182 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.581155    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-4sqvd"]
Nov 04 02:15:49.585315 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:49.585287    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab36405_af90_4b38_9ede_4ffad5c1ad8f.slice/crio-9053cdd424a54a3e6487f460068aa12189ea1f18ff2a1b8df144bc8b3fde7012 WatchSource:0}: Error finding container 9053cdd424a54a3e6487f460068aa12189ea1f18ff2a1b8df144bc8b3fde7012: Status 404 returned error can't find the container with id 9053cdd424a54a3e6487f460068aa12189ea1f18ff2a1b8df144bc8b3fde7012
Nov 04 02:15:49.590397 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:49.590273    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clnj4"]
Nov 04 02:15:50.055940 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.055853    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:50.110734 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.110693    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gsgrb\""
Nov 04 02:15:50.114635 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.114610    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:50.285390 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.285355    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clnj4" event={"ID":"5ab36405-af90-4b38-9ede-4ffad5c1ad8f","Type":"ContainerStarted","Data":"9053cdd424a54a3e6487f460068aa12189ea1f18ff2a1b8df144bc8b3fde7012"}
Nov 04 02:15:50.286748 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.286716    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-ts54b" event={"ID":"5435f585-4325-42b2-8992-988af472d105","Type":"ContainerStarted","Data":"70d7fcbc726be444c444e9994a171c17e8ce8a0878a113a72c1c3c11404e7959"}
Nov 04 02:15:50.288192 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.288157    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-4sqvd" event={"ID":"1486093b-695f-4ba3-8737-385bfe779147","Type":"ContainerStarted","Data":"4864fd1af57ccc6c03a469d9722040771337992de2e8ec28c6db56be60da299d"}
Nov 04 02:15:50.288327 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.288197    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-4sqvd" event={"ID":"1486093b-695f-4ba3-8737-385bfe779147","Type":"ContainerStarted","Data":"42296015d7c9d4f29db28b10eb503019be6d047af6f5042571735f9d9c7d5841"}
Nov 04 02:15:50.289386 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.289364    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln" event={"ID":"40222b3d-3cdb-4da6-8bfa-3764919a09a4","Type":"ContainerStarted","Data":"68a62d211c055303d6576b87c77e6ea65b50e01063e4674498876a815f5a5339"}
Nov 04 02:15:50.290437 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.290418    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5" event={"ID":"69dc840b-bd18-41ad-a213-f0d2c1252fca","Type":"ContainerStarted","Data":"f836d7cad3ba9279d3edf5782ea51af37ee79e7d4e527fe50e0a21298a547237"}
Nov 04 02:15:50.291422 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.291394    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6" event={"ID":"b4f3aa40-09ba-47db-b65b-ed4db9045c1f","Type":"ContainerStarted","Data":"3c79da8c2694dcbeaa5f2c20a78050cfaf217303165e1bc7c51adce0bc056061"}
Nov 04 02:15:50.292531 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.292510    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq" event={"ID":"ba210879-af81-4f17-9948-16a94100f39b","Type":"ContainerStarted","Data":"bc2af2ccbc4ba7e925f11d10e1f3e77248e478747e9d34983f8ba74028d75054"}
Nov 04 02:15:50.293688 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.293649    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78" event={"ID":"c80a9883-2db8-4389-aba0-813ecf38be30","Type":"ContainerStarted","Data":"ef80eef695c679633b66e0907d584ec1a4f132eadb565a5a5df4b4e3e6ab2ce3"}
Nov 04 02:15:50.294942 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.294923    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-bxplw" event={"ID":"be37687a-5d12-4543-83eb-61961531f81f","Type":"ContainerStarted","Data":"f2e2d1f64fb8b3ea65f01d6702f9d8fec684b226ffb83e60ada5dc01da4bd7fe"}
Nov 04 02:15:50.295017 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.294957    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-bxplw" event={"ID":"be37687a-5d12-4543-83eb-61961531f81f","Type":"ContainerStarted","Data":"a4e7f05fa0e72d52dffc77b414fba839bce82f20ee554fe6ea29a69a84be077d"}
Nov 04 02:15:50.296359 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.296314    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-6dk89" event={"ID":"735db15d-9069-4b87-ab87-7ed88d365bdb","Type":"ContainerStarted","Data":"20c6105f75159b760aafcfe771bfe049317a477c4a557a9b578770eed6244851"}
Nov 04 02:15:50.296433 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.296371    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-6dk89" event={"ID":"735db15d-9069-4b87-ab87-7ed88d365bdb","Type":"ContainerStarted","Data":"392ef34ae96c7880f5b6b35520dda8cb020c00220c74faf3a06c3dd17ad32d4f"}
Nov 04 02:15:50.358288 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.358201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:50.358288 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.358246    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:50.358524 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.358309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:50.358524 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.358348    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 04 02:15:50.358524 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.358417    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls podName:aece3088-8729-43a1-8533-7bdd145d2fdd nodeName:}" failed. No retries permitted until 2026-11-04 02:15:52.358401556 +0000 UTC m=+36.753224032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-vckzn" (UID: "aece3088-8729-43a1-8533-7bdd145d2fdd") : secret "cluster-monitoring-operator-tls" not found
Nov 04 02:15:50.358524 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.358420    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 02:15:50.358524 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.358431    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:52.35842531 +0000 UTC m=+36.753247786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : configmap references non-existent config key: service-ca.crt
Nov 04 02:15:50.358524 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.358491    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:52.358470666 +0000 UTC m=+36.753293146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : secret "router-metrics-certs-default" not found
Nov 04 02:15:50.459706 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.459644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:15:50.459892 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.459751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:50.459892 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.459805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:50.459892 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.459818    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 04 02:15:50.459892 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.459886    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert podName:e0514b3f-cb7b-475a-9338-8a9ae26f8fb9 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:52.459870382 +0000 UTC m=+36.854692858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8ztwg" (UID: "e0514b3f-cb7b-475a-9338-8a9ae26f8fb9") : secret "networking-console-plugin-cert" not found
Nov 04 02:15:50.459892 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.459887    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:15:50.460131 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.459908    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcfd7b985-mn847: secret "image-registry-tls" not found
Nov 04 02:15:50.460131 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.459955    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls podName:e96b7798-598c-4934-a2a1-40cb966e98c4 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:52.459940211 +0000 UTC m=+36.854762706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls") pod "image-registry-6bcfd7b985-mn847" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4") : secret "image-registry-tls" not found
Nov 04 02:15:50.460131 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.459973    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:15:50.460131 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.459986    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748544dd76-rmtdh: secret "image-registry-tls" not found
Nov 04 02:15:50.460131 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.460012    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls podName:470117a5-ef70-4fbe-a60d-68fb047e3e53 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:52.460003651 +0000 UTC m=+36.854826169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls") pod "image-registry-748544dd76-rmtdh" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53") : secret "image-registry-tls" not found
Nov 04 02:15:50.489363 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:50.489336    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f75c8e_a241_4641_814e_f233535d9b7e.slice/crio-3dfc0c86dd8b7ff4bf1e75e1fb35e0591b40e91f95e89d029e976eb56e9e43f1 WatchSource:0}: Error finding container 3dfc0c86dd8b7ff4bf1e75e1fb35e0591b40e91f95e89d029e976eb56e9e43f1: Status 404 returned error can't find the container with id 3dfc0c86dd8b7ff4bf1e75e1fb35e0591b40e91f95e89d029e976eb56e9e43f1
Nov 04 02:15:50.491248 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.491212    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7bvrs"]
Nov 04 02:15:50.561012 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.560979    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:50.561210 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.561045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:50.561210 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.561163    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 02:15:50.561210 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.561181    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 02:15:50.561354 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.561244    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls podName:dc3025c2-fdcb-4557-b5af-0433a3f89fef nodeName:}" failed. No retries permitted until 2026-11-04 02:15:52.56122162 +0000 UTC m=+36.956044096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-hx9zj" (UID: "dc3025c2-fdcb-4557-b5af-0433a3f89fef") : secret "samples-operator-tls" not found
Nov 04 02:15:50.561354 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:50.561275    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls podName:ab58cc26-ed1e-4d73-b63a-9ca5b327d18a nodeName:}" failed. No retries permitted until 2026-11-04 02:15:52.561263464 +0000 UTC m=+36.956085953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls") pod "dns-default-b6zs7" (UID: "ab58cc26-ed1e-4d73-b63a-9ca5b327d18a") : secret "dns-default-metrics-tls" not found
Nov 04 02:15:50.848751 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.847134    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-6dk89" podStartSLOduration=430.847114869 podStartE2EDuration="7m10.847114869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:50.846541843 +0000 UTC m=+35.241364343" watchObservedRunningTime="2026-11-04 02:15:50.847114869 +0000 UTC m=+35.241937367"
Nov 04 02:15:50.848957 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.848824    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-bxplw" podStartSLOduration=430.848812256 podStartE2EDuration="7m10.848812256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:50.727841708 +0000 UTC m=+35.122664206" watchObservedRunningTime="2026-11-04 02:15:50.848812256 +0000 UTC m=+35.243634755"
Nov 04 02:15:50.969006 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:50.968928    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-4sqvd" podStartSLOduration=430.968889358 podStartE2EDuration="7m10.968889358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:50.968240963 +0000 UTC m=+35.363063460" watchObservedRunningTime="2026-11-04 02:15:50.968889358 +0000 UTC m=+35.363711858"
Nov 04 02:15:51.309012 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:51.308976    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7bvrs" event={"ID":"e8f75c8e-a241-4641-814e-f233535d9b7e","Type":"ContainerStarted","Data":"3dfc0c86dd8b7ff4bf1e75e1fb35e0591b40e91f95e89d029e976eb56e9e43f1"}
Nov 04 02:15:52.323729 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:52.323688    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78" event={"ID":"c80a9883-2db8-4389-aba0-813ecf38be30","Type":"ContainerStarted","Data":"cbb35c6651913ff36c3bc7131a16ff878c76680a5f1f4b7d8979f357fd8a7a8d"}
Nov 04 02:15:52.381518 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:52.381473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:52.381800 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:52.381602    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:52.381800 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:52.381719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:52.381935 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.381883    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 04 02:15:52.381987 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.381947    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls podName:aece3088-8729-43a1-8533-7bdd145d2fdd nodeName:}" failed. No retries permitted until 2026-11-04 02:15:56.381929004 +0000 UTC m=+40.776751487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-vckzn" (UID: "aece3088-8729-43a1-8533-7bdd145d2fdd") : secret "cluster-monitoring-operator-tls" not found
Nov 04 02:15:52.382056 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.382007    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 02:15:52.382056 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.382042    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:56.38203193 +0000 UTC m=+40.776854407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : secret "router-metrics-certs-default" not found
Nov 04 02:15:52.382170 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.382106    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:56.382096474 +0000 UTC m=+40.776918952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : configmap references non-existent config key: service-ca.crt
Nov 04 02:15:52.482803 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:52.482764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:52.483048 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:52.482872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:52.483048 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:52.482997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:15:52.483182 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.483139    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 04 02:15:52.483237 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.483204    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert podName:e0514b3f-cb7b-475a-9338-8a9ae26f8fb9 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:56.483185579 +0000 UTC m=+40.878008077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8ztwg" (UID: "e0514b3f-cb7b-475a-9338-8a9ae26f8fb9") : secret "networking-console-plugin-cert" not found
Nov 04 02:15:52.483296 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.483275    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:15:52.483296 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.483287    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcfd7b985-mn847: secret "image-registry-tls" not found
Nov 04 02:15:52.483396 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.483319    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls podName:e96b7798-598c-4934-a2a1-40cb966e98c4 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:56.483307861 +0000 UTC m=+40.878130340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls") pod "image-registry-6bcfd7b985-mn847" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4") : secret "image-registry-tls" not found
Nov 04 02:15:52.483396 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.483378    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:15:52.483396 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.483387    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748544dd76-rmtdh: secret "image-registry-tls" not found
Nov 04 02:15:52.483618 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.483410    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls podName:470117a5-ef70-4fbe-a60d-68fb047e3e53 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:56.483401952 +0000 UTC m=+40.878224428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls") pod "image-registry-748544dd76-rmtdh" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53") : secret "image-registry-tls" not found
Nov 04 02:15:52.584130 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:52.584085    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:52.584325 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:52.584201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:52.584533 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.584476    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 02:15:52.584644 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.584545    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls podName:ab58cc26-ed1e-4d73-b63a-9ca5b327d18a nodeName:}" failed. No retries permitted until 2026-11-04 02:15:56.584525945 +0000 UTC m=+40.979348425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls") pod "dns-default-b6zs7" (UID: "ab58cc26-ed1e-4d73-b63a-9ca5b327d18a") : secret "dns-default-metrics-tls" not found
Nov 04 02:15:52.584644 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.584612    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 02:15:52.584644 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:52.584645    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls podName:dc3025c2-fdcb-4557-b5af-0433a3f89fef nodeName:}" failed. No retries permitted until 2026-11-04 02:15:56.584634681 +0000 UTC m=+40.979457171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-hx9zj" (UID: "dc3025c2-fdcb-4557-b5af-0433a3f89fef") : secret "samples-operator-tls" not found
Nov 04 02:15:53.620601 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:53.620547    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:15:53.805851 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:53.805804    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:15:56.344025 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.343926    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clnj4" event={"ID":"5ab36405-af90-4b38-9ede-4ffad5c1ad8f","Type":"ContainerStarted","Data":"17ae34bb3b0f27f21b7f9101b5415d05df59abd3f92cb039caaeb7718d84b41c"}
Nov 04 02:15:56.347739 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.347169    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-ts54b" event={"ID":"5435f585-4325-42b2-8992-988af472d105","Type":"ContainerStarted","Data":"68372c858053362db44207e29274a4f4f9d5af474742d8d1f2efb464155859ea"}
Nov 04 02:15:56.350366 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.349632    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln" event={"ID":"40222b3d-3cdb-4da6-8bfa-3764919a09a4","Type":"ContainerStarted","Data":"356fc6a816c23618518eca49acdcb514f6bdbd435d5de6e52a5a29b41193ab37"}
Nov 04 02:15:56.353439 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.352572    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/0.log"
Nov 04 02:15:56.353439 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.352612    2575 generic.go:356] "Generic (PLEG): container finished" podID="69dc840b-bd18-41ad-a213-f0d2c1252fca" containerID="3840c6d133593d4e204480d4a9e1856397b9a71a4c25bc475b23f310a0a53c51" exitCode=255
Nov 04 02:15:56.353439 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.352712    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5" event={"ID":"69dc840b-bd18-41ad-a213-f0d2c1252fca","Type":"ContainerDied","Data":"3840c6d133593d4e204480d4a9e1856397b9a71a4c25bc475b23f310a0a53c51"}
Nov 04 02:15:56.353439 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.353018    2575 scope.go:122] "RemoveContainer" containerID="3840c6d133593d4e204480d4a9e1856397b9a71a4c25bc475b23f310a0a53c51"
Nov 04 02:15:56.360934 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.360901    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6" event={"ID":"b4f3aa40-09ba-47db-b65b-ed4db9045c1f","Type":"ContainerStarted","Data":"33a3f0ae869898ebd52c780b29843e8fd9ce5b700cf0f191420b4e9066b974fc"}
Nov 04 02:15:56.428430 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.428391    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:15:56.428430 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.428438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:56.428684 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.428553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:15:56.428684 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.428571    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 04 02:15:56.428684 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.428617    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 02:15:56.428684 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.428679    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls podName:aece3088-8729-43a1-8533-7bdd145d2fdd nodeName:}" failed. No retries permitted until 2026-11-04 02:16:04.428632222 +0000 UTC m=+48.823454721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-vckzn" (UID: "aece3088-8729-43a1-8533-7bdd145d2fdd") : secret "cluster-monitoring-operator-tls" not found
Nov 04 02:15:56.428923 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.428699    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:04.42868942 +0000 UTC m=+48.823511896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : secret "router-metrics-certs-default" not found
Nov 04 02:15:56.428923 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.428731    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:04.428713732 +0000 UTC m=+48.823536235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : configmap references non-existent config key: service-ca.crt
Nov 04 02:15:56.442159 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.442091    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:15:56.467542 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.467444    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78" podStartSLOduration=404.779972621 podStartE2EDuration="6m47.46742282s" totalImagesPullingTime="2.687450199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:53.453182493 +0000 UTC m=+37.848004992" watchObservedRunningTime="2026-11-04 02:15:56.46742282 +0000 UTC m=+40.862245316"
Nov 04 02:15:56.468403 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.468354    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-clnj4" podStartSLOduration=2.08233509 podStartE2EDuration="8.468342591s" totalImagesPullingTime="6.386007501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:56.465040089 +0000 UTC m=+40.859862587" watchObservedRunningTime="2026-11-04 02:15:56.468342591 +0000 UTC m=+40.863165090"
Nov 04 02:15:56.529551 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.529512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:15:56.529842 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.529825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:15:56.529893 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.529883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:15:56.530449 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.530430    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 04 02:15:56.530513 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.530499    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert podName:e0514b3f-cb7b-475a-9338-8a9ae26f8fb9 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:04.530480735 +0000 UTC m=+48.925303229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8ztwg" (UID: "e0514b3f-cb7b-475a-9338-8a9ae26f8fb9") : secret "networking-console-plugin-cert" not found
Nov 04 02:15:56.530623 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.530604    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:15:56.530671 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.530630    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748544dd76-rmtdh: secret "image-registry-tls" not found
Nov 04 02:15:56.530711 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.530696    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls podName:470117a5-ef70-4fbe-a60d-68fb047e3e53 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:04.530678912 +0000 UTC m=+48.925501478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls") pod "image-registry-748544dd76-rmtdh" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53") : secret "image-registry-tls" not found
Nov 04 02:15:56.530975 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.530953    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:15:56.531037 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.530979    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcfd7b985-mn847: secret "image-registry-tls" not found
Nov 04 02:15:56.531088 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.531040    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls podName:e96b7798-598c-4934-a2a1-40cb966e98c4 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:04.531018962 +0000 UTC m=+48.925841460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls") pod "image-registry-6bcfd7b985-mn847" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4") : secret "image-registry-tls" not found
Nov 04 02:15:56.588722 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.588643    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-ts54b" podStartSLOduration=400.967361918 podStartE2EDuration="6m47.588628353s" totalImagesPullingTime="6.621266435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:56.587227455 +0000 UTC m=+40.982049949" watchObservedRunningTime="2026-11-04 02:15:56.588628353 +0000 UTC m=+40.983450850"
Nov 04 02:15:56.631022 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.630717    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:15:56.631022 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.630851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:15:56.631348 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.631328    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 02:15:56.631463 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.631389    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls podName:dc3025c2-fdcb-4557-b5af-0433a3f89fef nodeName:}" failed. No retries permitted until 2026-11-04 02:16:04.631376202 +0000 UTC m=+49.026198678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-hx9zj" (UID: "dc3025c2-fdcb-4557-b5af-0433a3f89fef") : secret "samples-operator-tls" not found
Nov 04 02:15:56.631463 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.631439    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 02:15:56.631463 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:56.631461    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls podName:ab58cc26-ed1e-4d73-b63a-9ca5b327d18a nodeName:}" failed. No retries permitted until 2026-11-04 02:16:04.631454527 +0000 UTC m=+49.026277015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls") pod "dns-default-b6zs7" (UID: "ab58cc26-ed1e-4d73-b63a-9ca5b327d18a") : secret "dns-default-metrics-tls" not found
Nov 04 02:15:56.831196 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.829651    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln" podStartSLOduration=401.328665777 podStartE2EDuration="6m47.829633226s" totalImagesPullingTime="6.500967449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:56.828794476 +0000 UTC m=+41.223616977" watchObservedRunningTime="2026-11-04 02:15:56.829633226 +0000 UTC m=+41.224455729"
Nov 04 02:15:56.831196 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:56.830217    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6" podStartSLOduration=401.261875827 podStartE2EDuration="6m47.830206896s" totalImagesPullingTime="6.568331069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:56.70855003 +0000 UTC m=+41.103372528" watchObservedRunningTime="2026-11-04 02:15:56.830206896 +0000 UTC m=+41.225029402"
Nov 04 02:15:57.366383 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.366359    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/1.log"
Nov 04 02:15:57.366879 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.366861    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/0.log"
Nov 04 02:15:57.366948 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.366906    2575 generic.go:356] "Generic (PLEG): container finished" podID="69dc840b-bd18-41ad-a213-f0d2c1252fca" containerID="de71fe55be1a8969c1a5bc6c88b5071821e43285222fe2bd11f9e51959dd65df" exitCode=255
Nov 04 02:15:57.367023 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.366998    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5" event={"ID":"69dc840b-bd18-41ad-a213-f0d2c1252fca","Type":"ContainerDied","Data":"de71fe55be1a8969c1a5bc6c88b5071821e43285222fe2bd11f9e51959dd65df"}
Nov 04 02:15:57.367088 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.367075    2575 scope.go:122] "RemoveContainer" containerID="3840c6d133593d4e204480d4a9e1856397b9a71a4c25bc475b23f310a0a53c51"
Nov 04 02:15:57.367580 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.367558    2575 scope.go:122] "RemoveContainer" containerID="de71fe55be1a8969c1a5bc6c88b5071821e43285222fe2bd11f9e51959dd65df"
Nov 04 02:15:57.367850 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:57.367827    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-sxrh5_openshift-console-operator(69dc840b-bd18-41ad-a213-f0d2c1252fca)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5" podUID="69dc840b-bd18-41ad-a213-f0d2c1252fca"
Nov 04 02:15:57.369368 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.369343    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq" event={"ID":"ba210879-af81-4f17-9948-16a94100f39b","Type":"ContainerStarted","Data":"5c095bf15a7430559a76848b5d7d57f2473b84cc5ee0aaf0ac7bc6100842c05f"}
Nov 04 02:15:57.371814 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.371787    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7bvrs" event={"ID":"e8f75c8e-a241-4641-814e-f233535d9b7e","Type":"ContainerStarted","Data":"dda0c271a04def8dd53c6802a8b8e6f2f68499e4dc361a242df1c807d0bf01b9"}
Nov 04 02:15:57.372014 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.371995    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:15:57.590774 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.590739    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:15:57.618788 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.618642    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7bvrs" podStartSLOduration=33.996003905 podStartE2EDuration="40.618626716s" totalImagesPullingTime="6.622622811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:57.618185918 +0000 UTC m=+42.013008416" watchObservedRunningTime="2026-11-04 02:15:57.618626716 +0000 UTC m=+42.013449215"
Nov 04 02:15:57.741305 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.741252    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq" podStartSLOduration=398.905638822 podStartE2EDuration="6m45.741236583s" totalImagesPullingTime="6.835597761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:57.740632257 +0000 UTC m=+42.135454754" watchObservedRunningTime="2026-11-04 02:15:57.741236583 +0000 UTC m=+42.136059094"
Nov 04 02:15:57.787590 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.787548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:15:57.822335 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.822302    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb"]
Nov 04 02:15:57.824971 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.824953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb"
Nov 04 02:15:57.880905 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.880813    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:57.880905 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.880813    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 04 02:15:57.880905 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.880855    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b2fnf\""
Nov 04 02:15:57.887323 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.887293    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb"]
Nov 04 02:15:57.907078 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.907046    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v29px"]
Nov 04 02:15:57.909115 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.909098    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:57.945082 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.945051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krnh6\" (UniqueName: \"kubernetes.io/projected/dac01f36-2182-40fb-9599-dbbac45a4b76-kube-api-access-krnh6\") pod \"migrator-66df5d496b-qsddb\" (UID: \"dac01f36-2182-40fb-9599-dbbac45a4b76\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb"
Nov 04 02:15:57.972248 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.972209    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v29px"]
Nov 04 02:15:57.979645 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.979618    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 02:15:57.979934 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.979912    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 02:15:57.980068 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.980036    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pszzf\""
Nov 04 02:15:57.994863 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:57.994831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:15:58.045999 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.045962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krnh6\" (UniqueName: \"kubernetes.io/projected/dac01f36-2182-40fb-9599-dbbac45a4b76-kube-api-access-krnh6\") pod \"migrator-66df5d496b-qsddb\" (UID: \"dac01f36-2182-40fb-9599-dbbac45a4b76\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb"
Nov 04 02:15:58.046201 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.046016    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e64633a6-4199-4a1e-ac6e-b610f6a9f034-data-volume\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.046201 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.046045    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.046201 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.046100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e64633a6-4199-4a1e-ac6e-b610f6a9f034-crio-socket\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.046201 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.046159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.046386 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.046206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92wnq\" (UniqueName: \"kubernetes.io/projected/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-api-access-92wnq\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.109440 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.109405    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krnh6\" (UniqueName: \"kubernetes.io/projected/dac01f36-2182-40fb-9599-dbbac45a4b76-kube-api-access-krnh6\") pod \"migrator-66df5d496b-qsddb\" (UID: \"dac01f36-2182-40fb-9599-dbbac45a4b76\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb"
Nov 04 02:15:58.136520 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.136436    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb"
Nov 04 02:15:58.147244 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.147208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e64633a6-4199-4a1e-ac6e-b610f6a9f034-data-volume\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.147384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.147255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.147384 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.147320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e64633a6-4199-4a1e-ac6e-b610f6a9f034-crio-socket\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.147496 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.147395    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e64633a6-4199-4a1e-ac6e-b610f6a9f034-crio-socket\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.147496 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:58.147397    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 02:15:58.147496 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.147425    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.147496 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:58.147479    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm podName:e64633a6-4199-4a1e-ac6e-b610f6a9f034 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:58.647460272 +0000 UTC m=+43.042282765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v29px" (UID: "e64633a6-4199-4a1e-ac6e-b610f6a9f034") : configmap "kube-rbac-proxy" not found
Nov 04 02:15:58.147754 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.147511    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92wnq\" (UniqueName: \"kubernetes.io/projected/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-api-access-92wnq\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.147754 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:58.147531    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:58.147754 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.147563    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e64633a6-4199-4a1e-ac6e-b610f6a9f034-data-volume\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.147754 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:58.147689    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls podName:e64633a6-4199-4a1e-ac6e-b610f6a9f034 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:58.647672139 +0000 UTC m=+43.042494630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v29px" (UID: "e64633a6-4199-4a1e-ac6e-b610f6a9f034") : secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:58.175673 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.175625    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:15:58.212413 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.212269    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92wnq\" (UniqueName: \"kubernetes.io/projected/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-api-access-92wnq\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.376774 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.376748    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/1.log"
Nov 04 02:15:58.377246 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.377231    2575 scope.go:122] "RemoveContainer" containerID="de71fe55be1a8969c1a5bc6c88b5071821e43285222fe2bd11f9e51959dd65df"
Nov 04 02:15:58.377376 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:58.377358    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-sxrh5_openshift-console-operator(69dc840b-bd18-41ad-a213-f0d2c1252fca)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5" podUID="69dc840b-bd18-41ad-a213-f0d2c1252fca"
Nov 04 02:15:58.506639 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:15:58.506602    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac01f36_2182_40fb_9599_dbbac45a4b76.slice/crio-208ed61f954784b970a31efd3c31258026f2988ae25b24009fc6fc49a0c04890 WatchSource:0}: Error finding container 208ed61f954784b970a31efd3c31258026f2988ae25b24009fc6fc49a0c04890: Status 404 returned error can't find the container with id 208ed61f954784b970a31efd3c31258026f2988ae25b24009fc6fc49a0c04890
Nov 04 02:15:58.508318 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.508269    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb"]
Nov 04 02:15:58.652185 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.652137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.652375 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:58.652282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:58.652375 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:58.652292    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:58.652441 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:58.652375    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 02:15:58.652441 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:58.652385    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls podName:e64633a6-4199-4a1e-ac6e-b610f6a9f034 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:59.652366332 +0000 UTC m=+44.047188807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v29px" (UID: "e64633a6-4199-4a1e-ac6e-b610f6a9f034") : secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:58.652441 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:58.652415    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm podName:e64633a6-4199-4a1e-ac6e-b610f6a9f034 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:59.652403856 +0000 UTC m=+44.047226354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v29px" (UID: "e64633a6-4199-4a1e-ac6e-b610f6a9f034") : configmap "kube-rbac-proxy" not found
Nov 04 02:15:59.007941 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:59.007904    2575 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:59.008129 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:59.007965    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:15:59.011573 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:59.011543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:15:59.184309 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:59.184274    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:15:59.381804 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:59.381769    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb" event={"ID":"dac01f36-2182-40fb-9599-dbbac45a4b76","Type":"ContainerStarted","Data":"208ed61f954784b970a31efd3c31258026f2988ae25b24009fc6fc49a0c04890"}
Nov 04 02:15:59.382195 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:59.382044    2575 scope.go:122] "RemoveContainer" containerID="de71fe55be1a8969c1a5bc6c88b5071821e43285222fe2bd11f9e51959dd65df"
Nov 04 02:15:59.382243 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:59.382227    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-sxrh5_openshift-console-operator(69dc840b-bd18-41ad-a213-f0d2c1252fca)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5" podUID="69dc840b-bd18-41ad-a213-f0d2c1252fca"
Nov 04 02:15:59.664195 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:59.664098    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:59.664195 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:15:59.664178    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:15:59.664390 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:59.664336    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:59.664434 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:59.664397    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls podName:e64633a6-4199-4a1e-ac6e-b610f6a9f034 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:01.664380317 +0000 UTC m=+46.059202800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v29px" (UID: "e64633a6-4199-4a1e-ac6e-b610f6a9f034") : secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:59.664584 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:59.664555    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 02:15:59.664708 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:15:59.664625    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm podName:e64633a6-4199-4a1e-ac6e-b610f6a9f034 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:01.664606933 +0000 UTC m=+46.059429412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v29px" (UID: "e64633a6-4199-4a1e-ac6e-b610f6a9f034") : configmap "kube-rbac-proxy" not found
Nov 04 02:16:00.132396 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:00.132351    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:00.318763 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:00.318728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:00.386418 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:00.386340    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb" event={"ID":"dac01f36-2182-40fb-9599-dbbac45a4b76","Type":"ContainerStarted","Data":"bbf686b71907323d6023a16f8c073061ed97094e096085bea4d908cd009c6acd"}
Nov 04 02:16:00.506719 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:00.506643    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb" podStartSLOduration=1.846646309 podStartE2EDuration="3.506627235s" totalImagesPullingTime="1.659980926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:00.505392452 +0000 UTC m=+44.900214950" watchObservedRunningTime="2026-11-04 02:16:00.506627235 +0000 UTC m=+44.901449768"
Nov 04 02:16:01.682635 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:01.682592    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:01.683174 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:01.682698    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:01.683174 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:01.682876    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 02:16:01.683174 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:01.682946    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls podName:e64633a6-4199-4a1e-ac6e-b610f6a9f034 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:05.682927956 +0000 UTC m=+50.077750446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v29px" (UID: "e64633a6-4199-4a1e-ac6e-b610f6a9f034") : secret "insights-runtime-extractor-tls" not found
Nov 04 02:16:01.683341 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:01.683273    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:01.825985 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:01.825949    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:02.018173 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:02.018087    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:02.804637 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:02.804606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:04.505670 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:04.505630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:04.506108 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:04.505772    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:04.506108 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.505779    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Nov 04 02:16:04.506108 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.505836    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:20.505822854 +0000 UTC m=+64.900645330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : secret "router-metrics-certs-default" not found
Nov 04 02:16:04.506108 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:04.505887    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:16:04.506108 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.505908    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle podName:2e4e9c2c-7e7b-45d1-8e50-d850011dea19 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:20.505891952 +0000 UTC m=+64.900714446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle") pod "router-default-6b8f6d865c-c8tlq" (UID: "2e4e9c2c-7e7b-45d1-8e50-d850011dea19") : configmap references non-existent config key: service-ca.crt
Nov 04 02:16:04.506108 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.505932    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Nov 04 02:16:04.506108 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.505960    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls podName:aece3088-8729-43a1-8533-7bdd145d2fdd nodeName:}" failed. No retries permitted until 2026-11-04 02:16:20.505953022 +0000 UTC m=+64.900775498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-vckzn" (UID: "aece3088-8729-43a1-8533-7bdd145d2fdd") : secret "cluster-monitoring-operator-tls" not found
Nov 04 02:16:04.607227 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:04.607185    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:16:04.607227 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:04.607234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:04.607451 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:04.607296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:16:04.607451 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.607348    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Nov 04 02:16:04.607451 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.607413    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert podName:e0514b3f-cb7b-475a-9338-8a9ae26f8fb9 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:20.607399129 +0000 UTC m=+65.002221605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8ztwg" (UID: "e0514b3f-cb7b-475a-9338-8a9ae26f8fb9") : secret "networking-console-plugin-cert" not found
Nov 04 02:16:04.607451 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.607433    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:16:04.607451 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.607436    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Nov 04 02:16:04.607451 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.607450    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcfd7b985-mn847: secret "image-registry-tls" not found
Nov 04 02:16:04.607451 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.607453    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-748544dd76-rmtdh: secret "image-registry-tls" not found
Nov 04 02:16:04.607675 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.607505    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls podName:470117a5-ef70-4fbe-a60d-68fb047e3e53 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:20.607490374 +0000 UTC m=+65.002312865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls") pod "image-registry-748544dd76-rmtdh" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53") : secret "image-registry-tls" not found
Nov 04 02:16:04.607675 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.607520    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls podName:e96b7798-598c-4934-a2a1-40cb966e98c4 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:20.60751397 +0000 UTC m=+65.002336447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls") pod "image-registry-6bcfd7b985-mn847" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4") : secret "image-registry-tls" not found
Nov 04 02:16:04.708283 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:04.708239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:16:04.708445 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:04.708324    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:04.708445 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.708418    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Nov 04 02:16:04.708532 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.708445    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 02:16:04.708532 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.708486    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls podName:ab58cc26-ed1e-4d73-b63a-9ca5b327d18a nodeName:}" failed. No retries permitted until 2026-11-04 02:16:20.708473757 +0000 UTC m=+65.103296233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls") pod "dns-default-b6zs7" (UID: "ab58cc26-ed1e-4d73-b63a-9ca5b327d18a") : secret "dns-default-metrics-tls" not found
Nov 04 02:16:04.708532 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:04.708499    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls podName:dc3025c2-fdcb-4557-b5af-0433a3f89fef nodeName:}" failed. No retries permitted until 2026-11-04 02:16:20.708493025 +0000 UTC m=+65.103315501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-hx9zj" (UID: "dc3025c2-fdcb-4557-b5af-0433a3f89fef") : secret "samples-operator-tls" not found
Nov 04 02:16:05.641770 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:05.641733    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:05.718366 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:05.718322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:05.718559 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:05.718467    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 02:16:05.718559 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:05.718528    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls podName:e64633a6-4199-4a1e-ac6e-b610f6a9f034 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:13.718512885 +0000 UTC m=+58.113335361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v29px" (UID: "e64633a6-4199-4a1e-ac6e-b610f6a9f034") : secret "insights-runtime-extractor-tls" not found
Nov 04 02:16:06.303722 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:06.303691    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:06.522068 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:06.522035    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:06.853700 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:06.853641    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:07.050447 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:07.050409    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:07.251415 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:07.251364    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:07.488864 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:07.488826    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:08.290269 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:08.290235    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:08.292591 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:08.292574    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2bcnd_d8b9b855-1e9b-47f9-b775-304910b95667/dns-node-resolver/0.log"
Nov 04 02:16:08.678162 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:08.678122    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:08.883414 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:08.883380    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:09.056191 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:09.056113    2575 scope.go:122] "RemoveContainer" containerID="de71fe55be1a8969c1a5bc6c88b5071821e43285222fe2bd11f9e51959dd65df"
Nov 04 02:16:09.096911 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:09.096881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:09.289261 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:09.289222    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:09.416016 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:09.415987    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:16:09.416458 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:09.416381    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/1.log"
Nov 04 02:16:09.416458 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:09.416411    2575 generic.go:356] "Generic (PLEG): container finished" podID="69dc840b-bd18-41ad-a213-f0d2c1252fca" containerID="13ba0fe808be3ff5a62c2adef6ef7e7808dddb1dfa39617e18e053a05623032b" exitCode=255
Nov 04 02:16:09.416458 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:09.416445    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5" event={"ID":"69dc840b-bd18-41ad-a213-f0d2c1252fca","Type":"ContainerDied","Data":"13ba0fe808be3ff5a62c2adef6ef7e7808dddb1dfa39617e18e053a05623032b"}
Nov 04 02:16:09.416608 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:09.416491    2575 scope.go:122] "RemoveContainer" containerID="de71fe55be1a8969c1a5bc6c88b5071821e43285222fe2bd11f9e51959dd65df"
Nov 04 02:16:09.416958 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:09.416935    2575 scope.go:122] "RemoveContainer" containerID="13ba0fe808be3ff5a62c2adef6ef7e7808dddb1dfa39617e18e053a05623032b"
Nov 04 02:16:09.417176 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:09.417151    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-sxrh5_openshift-console-operator(69dc840b-bd18-41ad-a213-f0d2c1252fca)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5" podUID="69dc840b-bd18-41ad-a213-f0d2c1252fca"
Nov 04 02:16:09.543045 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:09.543010    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:09.694035 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:09.693958    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dtg7p_3d9a67bf-5458-4857-acd0-473c00297677/node-ca/0.log"
Nov 04 02:16:10.093996 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:10.093924    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-clnj4_5ab36405-af90-4b38-9ede-4ffad5c1ad8f/serve-healthcheck-canary/0.log"
Nov 04 02:16:10.300498 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:10.300447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:10.421409 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:10.421380    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:16:10.487895 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:10.487864    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:10.675917 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:10.675833    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:10.693825 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:10.693794    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-qsddb_dac01f36-2182-40fb-9599-dbbac45a4b76/migrator/0.log"
Nov 04 02:16:10.881752 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:10.881722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:10.895105 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:10.895075    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-p8dln_40222b3d-3cdb-4da6-8bfa-3764919a09a4/kube-storage-version-migrator-operator/0.log"
Nov 04 02:16:11.069218 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:11.069137    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:11.239395 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:11.239352    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:11.421080 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:11.421046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:11.602417 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:11.602385    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:12.487540 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:12.487509    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:12.690231 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:12.690186    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:12.886151 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:12.886105    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:13.078800 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:13.078761    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:13.278025 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:13.277951    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:13.295190 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:13.295164    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:13.793630 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:13.793590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:13.796173 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:13.796146    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:13.821225 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:13.821187    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:14.193148 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:14.193114    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v29px"]
Nov 04 02:16:14.217722 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:16:14.217691    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64633a6_4199_4a1e_ac6e_b610f6a9f034.slice/crio-736c48084a78ef54b820309336aae9998dc6eebffda46853dd3c65dac5fe9032 WatchSource:0}: Error finding container 736c48084a78ef54b820309336aae9998dc6eebffda46853dd3c65dac5fe9032: Status 404 returned error can't find the container with id 736c48084a78ef54b820309336aae9998dc6eebffda46853dd3c65dac5fe9032
Nov 04 02:16:14.435555 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:14.435519    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v29px" event={"ID":"e64633a6-4199-4a1e-ac6e-b610f6a9f034","Type":"ContainerStarted","Data":"8690a18a7e4f3b1de7fc3506d1774ecb8be63f183342a7636c31a9d947d4b4af"}
Nov 04 02:16:14.435752 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:14.435601    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v29px" event={"ID":"e64633a6-4199-4a1e-ac6e-b610f6a9f034","Type":"ContainerStarted","Data":"736c48084a78ef54b820309336aae9998dc6eebffda46853dd3c65dac5fe9032"}
Nov 04 02:16:14.484879 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:14.484793    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:14.687958 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:14.687919    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:14.892806 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:14.892777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:15.085684 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:15.085626    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:15.288404 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:15.288325    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:16.086936 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:16.086883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:16.284824 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:16.284777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:16.447494 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:16.447408    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v29px" event={"ID":"e64633a6-4199-4a1e-ac6e-b610f6a9f034","Type":"ContainerStarted","Data":"338a14bfe37ec6bc666852654e569cb46dace641ada3a5c718d326402bb77452"}
Nov 04 02:16:16.497744 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:16.497634    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:16.831778 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:16.831607    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:17.007469 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:17.007435    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:18.456213 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:18.456172    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v29px" event={"ID":"e64633a6-4199-4a1e-ac6e-b610f6a9f034","Type":"ContainerStarted","Data":"07c59abdd501429cce85cbd08a056f2a630ecfd23cc68c474653b79094fba6c8"}
Nov 04 02:16:18.579468 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:18.579418    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v29px" podStartSLOduration=18.40308779 podStartE2EDuration="21.579402772s" totalImagesPullingTime="3.176314982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:18.577997257 +0000 UTC m=+62.972819755" watchObservedRunningTime="2026-11-04 02:16:18.579402772 +0000 UTC m=+62.974225269"
Nov 04 02:16:19.007761 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:19.007719    2575 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:19.007982 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:19.007782    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:19.008180 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:19.008160    2575 scope.go:122] "RemoveContainer" containerID="13ba0fe808be3ff5a62c2adef6ef7e7808dddb1dfa39617e18e053a05623032b"
Nov 04 02:16:19.008400 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:19.008378    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-sxrh5_openshift-console-operator(69dc840b-bd18-41ad-a213-f0d2c1252fca)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5" podUID="69dc840b-bd18-41ad-a213-f0d2c1252fca"
Nov 04 02:16:20.415609 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.415562    2575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-748544dd76-rmtdh"]
Nov 04 02:16:20.416109 ip-10-0-136-190 kubenswrapper[2575]: E1104 02:16:20.415835    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-748544dd76-rmtdh" podUID="470117a5-ef70-4fbe-a60d-68fb047e3e53"
Nov 04 02:16:20.462417 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.462385    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:16:20.469922 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.469890    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:16:20.559822 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.559789    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-kube-api-access-npks9\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-kube-api-access-npks9\") pod \"470117a5-ef70-4fbe-a60d-68fb047e3e53\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") "
Nov 04 02:16:20.559822 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.559823    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-trusted-ca\") pod \"470117a5-ef70-4fbe-a60d-68fb047e3e53\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") "
Nov 04 02:16:20.560052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.559849    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/470117a5-ef70-4fbe-a60d-68fb047e3e53-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/470117a5-ef70-4fbe-a60d-68fb047e3e53-ca-trust-extracted\") pod \"470117a5-ef70-4fbe-a60d-68fb047e3e53\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") "
Nov 04 02:16:20.560052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.559897    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-bound-sa-token\") pod \"470117a5-ef70-4fbe-a60d-68fb047e3e53\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") "
Nov 04 02:16:20.560052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.559950    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-certificates\") pod \"470117a5-ef70-4fbe-a60d-68fb047e3e53\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") "
Nov 04 02:16:20.560052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.559992    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-installation-pull-secrets\") pod \"470117a5-ef70-4fbe-a60d-68fb047e3e53\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") "
Nov 04 02:16:20.560052 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.560047    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-image-registry-private-configuration\") pod \"470117a5-ef70-4fbe-a60d-68fb047e3e53\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") "
Nov 04 02:16:20.560294 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.560162    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:16:20.560294 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.560215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:20.560294 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.560254    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470117a5-ef70-4fbe-a60d-68fb047e3e53-ca-trust-extracted" pod "470117a5-ef70-4fbe-a60d-68fb047e3e53" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:16:20.560457 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.560326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:20.560457 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.560343    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-trusted-ca" pod "470117a5-ef70-4fbe-a60d-68fb047e3e53" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:16:20.560457 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.560348    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-certificates" pod "470117a5-ef70-4fbe-a60d-68fb047e3e53" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:16:20.560591 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.560486    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-trusted-ca\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:20.560591 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.560512    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/470117a5-ef70-4fbe-a60d-68fb047e3e53-ca-trust-extracted\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:20.561042 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.560527    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-certificates\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:20.561214 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.561101    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:20.562631 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.562579    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-image-registry-private-configuration" pod "470117a5-ef70-4fbe-a60d-68fb047e3e53" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:16:20.562893 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.562870    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-installation-pull-secrets" pod "470117a5-ef70-4fbe-a60d-68fb047e3e53" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:16:20.562953 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.562885    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-kube-api-access-npks9" pod "470117a5-ef70-4fbe-a60d-68fb047e3e53" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53"). InnerVolumeSpecName "kube-api-access-npks9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:16:20.563102 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.563084    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-bound-sa-token" pod "470117a5-ef70-4fbe-a60d-68fb047e3e53" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:16:20.563420 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.563399    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:20.563483 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.563403    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:16:20.661687 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.661639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:16:20.661899 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.661787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:16:20.661899 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.661825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:20.661899 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.661871    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-bound-sa-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:20.661899 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.661887    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-installation-pull-secrets\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:20.662100 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.661905    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/470117a5-ef70-4fbe-a60d-68fb047e3e53-image-registry-private-configuration\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:20.662100 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.661919    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npks9\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-kube-api-access-npks9\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:20.662261 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.662241    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:20.664425 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.664401    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:20.664541 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.664401    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:16:20.664541 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.664401    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\") pod \"image-registry-748544dd76-rmtdh\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") " pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:16:20.716067 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.715973    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:20.762766 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.762730    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\") pod \"470117a5-ef70-4fbe-a60d-68fb047e3e53\" (UID: \"470117a5-ef70-4fbe-a60d-68fb047e3e53\") "
Nov 04 02:16:20.762941 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.762871    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:16:20.762941 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.762930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:20.764992 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.764956    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls" pod "470117a5-ef70-4fbe-a60d-68fb047e3e53" (UID: "470117a5-ef70-4fbe-a60d-68fb047e3e53"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:16:20.765512 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.765487    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:20.765647 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.765627    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:16:20.781015 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.780981    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:16:20.857109 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.857079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:20.864353 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.864305    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/470117a5-ef70-4fbe-a60d-68fb047e3e53-registry-tls\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:20.928440 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.928403    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-q8p76\""
Nov 04 02:16:20.935645 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.935616    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:16:20.975116 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.975037    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rhnhd\""
Nov 04 02:16:20.982358 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.982328    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:20.985539 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:20.985511    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:16:21.047812 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.047783    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:21.066434 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.066399    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:16:21.066618 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.066439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:16:21.097196 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.097161    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n2j4c\""
Nov 04 02:16:21.104294 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.104263    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:21.120161 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.120133    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 02:16:21.120161 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.120159    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 02:16:21.129913 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.129878    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:16:21.130059 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.129929    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:16:21.141089 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.141058    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b8f6d865c-c8tlq"]
Nov 04 02:16:21.172299 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:16:21.172261    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4e9c2c_7e7b_45d1_8e50_d850011dea19.slice/crio-d9e569328a4b5f28704661331bf7696ddd0de8213b3f0f98e79cfe9068406054 WatchSource:0}: Error finding container d9e569328a4b5f28704661331bf7696ddd0de8213b3f0f98e79cfe9068406054: Status 404 returned error can't find the container with id d9e569328a4b5f28704661331bf7696ddd0de8213b3f0f98e79cfe9068406054
Nov 04 02:16:21.185050 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:16:21.185020    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaece3088_8729_43a1_8533_7bdd145d2fdd.slice/crio-faa2f0dfd388b04df8db06de154633182babe84a2cf95ad6361c7427fc4c2b66 WatchSource:0}: Error finding container faa2f0dfd388b04df8db06de154633182babe84a2cf95ad6361c7427fc4c2b66: Status 404 returned error can't find the container with id faa2f0dfd388b04df8db06de154633182babe84a2cf95ad6361c7427fc4c2b66
Nov 04 02:16:21.187876 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.187808    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"]
Nov 04 02:16:21.233139 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.233067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:21.240780 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.240749    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k925t\""
Nov 04 02:16:21.247208 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.247184    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-nw2cx\""
Nov 04 02:16:21.248164 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.248144    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:16:21.254669 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.254632    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:16:21.306711 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.305888    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"]
Nov 04 02:16:21.306711 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:16:21.306440    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0514b3f_cb7b_475a_9338_8a9ae26f8fb9.slice/crio-8a21bbb332496e1da45c4f9a66ac40996c6c4d0a5f52fc68c6d3262c5cd83e21 WatchSource:0}: Error finding container 8a21bbb332496e1da45c4f9a66ac40996c6c4d0a5f52fc68c6d3262c5cd83e21: Status 404 returned error can't find the container with id 8a21bbb332496e1da45c4f9a66ac40996c6c4d0a5f52fc68c6d3262c5cd83e21
Nov 04 02:16:21.366956 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.366924    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"]
Nov 04 02:16:21.368713 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:16:21.368685    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96b7798_598c_4934_a2a1_40cb966e98c4.slice/crio-c4e591d4062df69fffaad9b40568bf2c34efa0082d4c616ea1c662787781af1a WatchSource:0}: Error finding container c4e591d4062df69fffaad9b40568bf2c34efa0082d4c616ea1c662787781af1a: Status 404 returned error can't find the container with id c4e591d4062df69fffaad9b40568bf2c34efa0082d4c616ea1c662787781af1a
Nov 04 02:16:21.369864 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.369842    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bcfd7b985-mn847"]
Nov 04 02:16:21.467240 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.467202    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj" event={"ID":"dc3025c2-fdcb-4557-b5af-0433a3f89fef","Type":"ContainerStarted","Data":"50a80cb8c071698aaf3f06639e7ce835aa743946b02b5749b247b5b72a408fcf"}
Nov 04 02:16:21.468983 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.468956    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847" event={"ID":"e96b7798-598c-4934-a2a1-40cb966e98c4","Type":"ContainerStarted","Data":"c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124"}
Nov 04 02:16:21.469128 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.469003    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847" event={"ID":"e96b7798-598c-4934-a2a1-40cb966e98c4","Type":"ContainerStarted","Data":"c4e591d4062df69fffaad9b40568bf2c34efa0082d4c616ea1c662787781af1a"}
Nov 04 02:16:21.469128 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.469074    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:21.470216 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.470194    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn" event={"ID":"aece3088-8729-43a1-8533-7bdd145d2fdd","Type":"ContainerStarted","Data":"faa2f0dfd388b04df8db06de154633182babe84a2cf95ad6361c7427fc4c2b66"}
Nov 04 02:16:21.471532 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.471506    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg" event={"ID":"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9","Type":"ContainerStarted","Data":"8a21bbb332496e1da45c4f9a66ac40996c6c4d0a5f52fc68c6d3262c5cd83e21"}
Nov 04 02:16:21.473257 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.473232    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq" event={"ID":"2e4e9c2c-7e7b-45d1-8e50-d850011dea19","Type":"ContainerStarted","Data":"69040677c752a891d047d9b86e13191dbcfee4bed72102b0984ffde6ff9f267a"}
Nov 04 02:16:21.473324 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.473270    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-748544dd76-rmtdh"
Nov 04 02:16:21.473364 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.473272    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq" event={"ID":"2e4e9c2c-7e7b-45d1-8e50-d850011dea19","Type":"ContainerStarted","Data":"d9e569328a4b5f28704661331bf7696ddd0de8213b3f0f98e79cfe9068406054"}
Nov 04 02:16:21.475682 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:16:21.475638    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab58cc26_ed1e_4d73_b63a_9ca5b327d18a.slice/crio-80c802d79b7174501f3ca233891e822bc03bf31dcc89ee63c3b3fa16cf19f4d1 WatchSource:0}: Error finding container 80c802d79b7174501f3ca233891e822bc03bf31dcc89ee63c3b3fa16cf19f4d1: Status 404 returned error can't find the container with id 80c802d79b7174501f3ca233891e822bc03bf31dcc89ee63c3b3fa16cf19f4d1
Nov 04 02:16:21.477646 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.477625    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b6zs7"]
Nov 04 02:16:21.595129 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.595078    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847" podStartSLOduration=55.595063162 podStartE2EDuration="55.595063162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:21.594739592 +0000 UTC m=+65.989562086" watchObservedRunningTime="2026-11-04 02:16:21.595063162 +0000 UTC m=+65.989885660"
Nov 04 02:16:21.622486 ip-10-0-136-190 kubenswrapper[2575]: W1104 02:16:21.622448    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36162c63_49e7_4782_8ea9_55db430a4c73.slice/crio-a30ef3e27e679c19ae50bdb28929f627437e7e9cfd2c3e88c5e9a558bb087ab8 WatchSource:0}: Error finding container a30ef3e27e679c19ae50bdb28929f627437e7e9cfd2c3e88c5e9a558bb087ab8: Status 404 returned error can't find the container with id a30ef3e27e679c19ae50bdb28929f627437e7e9cfd2c3e88c5e9a558bb087ab8
Nov 04 02:16:21.625103 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.625071    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xshqm"]
Nov 04 02:16:21.627899 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.627850    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jzwmx"]
Nov 04 02:16:21.717081 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.717029    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:21.720253 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.720190    2575 patch_prober.go:29] interesting pod/router-default-6b8f6d865c-c8tlq container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld
Nov 04 02:16:21.720253 ip-10-0-136-190 kubenswrapper[2575]: [+]has-synced ok
Nov 04 02:16:21.720253 ip-10-0-136-190 kubenswrapper[2575]: [+]process-running ok
Nov 04 02:16:21.720253 ip-10-0-136-190 kubenswrapper[2575]: healthz check failed
Nov 04 02:16:21.720836 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.720266    2575 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq" podUID="2e4e9c2c-7e7b-45d1-8e50-d850011dea19" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Nov 04 02:16:21.721075 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.721034    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq" podStartSLOduration=432.721019369 podStartE2EDuration="7m12.721019369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:09:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:21.719231246 +0000 UTC m=+66.114053800" watchObservedRunningTime="2026-11-04 02:16:21.721019369 +0000 UTC m=+66.115841894"
Nov 04 02:16:21.908874 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.908834    2575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-748544dd76-rmtdh"]
Nov 04 02:16:21.918364 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:21.918323    2575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-748544dd76-rmtdh"]
Nov 04 02:16:22.060863 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:22.060832    2575 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="470117a5-ef70-4fbe-a60d-68fb047e3e53" path="/var/lib/kubelet/pods/470117a5-ef70-4fbe-a60d-68fb047e3e53/volumes"
Nov 04 02:16:22.480743 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:22.480692    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xshqm" event={"ID":"36162c63-49e7-4782-8ea9-55db430a4c73","Type":"ContainerStarted","Data":"a30ef3e27e679c19ae50bdb28929f627437e7e9cfd2c3e88c5e9a558bb087ab8"}
Nov 04 02:16:22.482291 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:22.482261    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jzwmx" event={"ID":"dcca8570-7261-499b-938a-10097ca652b0","Type":"ContainerStarted","Data":"db65703a2d35615b65e2666f80d107fd5e0f2ac4803c527f5525dacc37a6c288"}
Nov 04 02:16:22.483757 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:22.483725    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6zs7" event={"ID":"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a","Type":"ContainerStarted","Data":"80c802d79b7174501f3ca233891e822bc03bf31dcc89ee63c3b3fa16cf19f4d1"}
Nov 04 02:16:22.718561 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:22.718526    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:23.490860 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:23.490823    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:23.492160 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:23.492133    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:24.498277 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:24.497680    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg" event={"ID":"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9","Type":"ContainerStarted","Data":"5e862ddc37439800b024ab00fa5f8a58db1d4c9ac48be74a4a8a8e414c574249"}
Nov 04 02:16:24.502291 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:24.502198    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xshqm" event={"ID":"36162c63-49e7-4782-8ea9-55db430a4c73","Type":"ContainerStarted","Data":"e176e3852e7f06af95447d2c1b47cff16cfedf31703b02a76e0d03bbf445b10f"}
Nov 04 02:16:24.502291 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:24.502253    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xshqm" event={"ID":"36162c63-49e7-4782-8ea9-55db430a4c73","Type":"ContainerStarted","Data":"1f4dc1d8f2308ecfa867c84d0737d94e1de8e8d670e445374184b463d7387dde"}
Nov 04 02:16:24.619694 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:24.618791    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg" podStartSLOduration=397.504186764 podStartE2EDuration="6m39.618769721s" totalImagesPullingTime="2.114582957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:24.617326852 +0000 UTC m=+69.012149353" watchObservedRunningTime="2026-11-04 02:16:24.618769721 +0000 UTC m=+69.013592220"
Nov 04 02:16:26.515990 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:26.515948    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj" event={"ID":"dc3025c2-fdcb-4557-b5af-0433a3f89fef","Type":"ContainerStarted","Data":"0751d1e1499fd307fc66ebe3ee2186f71de6f7b5db535311464a25d5ef9fa9a6"}
Nov 04 02:16:26.516447 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:26.516031    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj" event={"ID":"dc3025c2-fdcb-4557-b5af-0433a3f89fef","Type":"ContainerStarted","Data":"60cedebbc22e3ebd32b314f8d77a5aa6d20f96db109c60c16bd8c8b1568ab18c"}
Nov 04 02:16:26.518064 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:26.518029    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn" event={"ID":"aece3088-8729-43a1-8533-7bdd145d2fdd","Type":"ContainerStarted","Data":"eb94186542b25ca6daaeb1b46de0808df76d641a48e5ebcffe79c7c7b2f60c92"}
Nov 04 02:16:26.520733 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:26.520698    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6zs7" event={"ID":"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a","Type":"ContainerStarted","Data":"5e95e30d8c3cc77fcf95276c789f758b19ff9bcd64b916dd6f82bab6baddb709"}
Nov 04 02:16:26.520887 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:26.520758    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6zs7" event={"ID":"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a","Type":"ContainerStarted","Data":"abc5054a64f39fd09eb9ebedc5ea438c51def2de9d2bab68f008d8644b36be7d"}
Nov 04 02:16:26.520887 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:26.520862    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:26.639298 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:26.639241    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xshqm" podStartSLOduration=67.410961467 podStartE2EDuration="1m9.639221041s" totalImagesPullingTime="2.228259574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:24.743333621 +0000 UTC m=+69.138156119" watchObservedRunningTime="2026-11-04 02:16:26.639221041 +0000 UTC m=+71.034043581"
Nov 04 02:16:26.639542 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:26.639513    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj" podStartSLOduration=433.593980217 podStartE2EDuration="7m17.639506724s" totalImagesPullingTime="4.045526507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:26.63816913 +0000 UTC m=+71.032991630" watchObservedRunningTime="2026-11-04 02:16:26.639506724 +0000 UTC m=+71.034329247"
Nov 04 02:16:26.763335 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:26.763266    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-b6zs7" podStartSLOduration=34.783302473 podStartE2EDuration="38.763249662s" totalImagesPullingTime="3.979947189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:26.76175901 +0000 UTC m=+71.156581511" watchObservedRunningTime="2026-11-04 02:16:26.763249662 +0000 UTC m=+71.158072160"
Nov 04 02:16:26.855228 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:26.855131    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:26.883713 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:26.883623    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn" podStartSLOduration=433.609215993 podStartE2EDuration="7m17.883603522s" totalImagesPullingTime="4.274387529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:26.882870681 +0000 UTC m=+71.277693179" watchObservedRunningTime="2026-11-04 02:16:26.883603522 +0000 UTC m=+71.278426019"
Nov 04 02:16:27.092754 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:27.092714    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:27.287531 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:27.287487    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:27.961372 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:27.961333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:28.175182 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:28.175145    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:28.379294 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:28.379263    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:16:28.463601 ip-10-0-136-190 kubenswrapper[2575]: I1104 02:16:28.463250    2575 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:16:28.463402 ip-10-0-136-190 systemd[1]: Stopping Kubernetes Kubelet...
Nov 04 02:16:28.475040 ip-10-0-136-190 systemd[1]: kubelet.service: Deactivated successfully.
Nov 04 02:16:28.475214 ip-10-0-136-190 systemd[1]: Stopped Kubernetes Kubelet.
Nov 04 02:16:28.475266 ip-10-0-136-190 systemd[1]: kubelet.service: Consumed 5.005s CPU time.
Nov 04 02:16:28.490419 ip-10-0-136-190 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 02:16:28.589086 ip-10-0-136-190 kubenswrapper[5722]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:16:28.589086 ip-10-0-136-190 kubenswrapper[5722]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 02:16:28.589086 ip-10-0-136-190 kubenswrapper[5722]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:16:28.589086 ip-10-0-136-190 kubenswrapper[5722]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:16:28.591518 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591411    5722 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:28.591518 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591514    5722 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:28.591518 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591519    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:28.591518 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591524    5722 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591531    5722 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591535    5722 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591539    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591542    5722 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591548    5722 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591554    5722 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591558    5722 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591562    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591572    5722 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591577    5722 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591580    5722 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591584    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591589    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591593    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591597    5722 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591601    5722 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591605    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591609    5722 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:28.591831 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591613    5722 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591617    5722 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591621    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591625    5722 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591629    5722 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591634    5722 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591638    5722 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591642    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591646    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591670    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591675    5722 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591680    5722 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591684    5722 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591688    5722 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591693    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591697    5722 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591703    5722 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591707    5722 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591712    5722 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591716    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:28.592740 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591721    5722 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591725    5722 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591730    5722 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591735    5722 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591740    5722 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591745    5722 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591749    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591753    5722 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591758    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591762    5722 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591766    5722 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591770    5722 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591775    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591779    5722 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591783    5722 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591788    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591792    5722 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591797    5722 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591801    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591806    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:28.593714 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591810    5722 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591815    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591820    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591824    5722 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591828    5722 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591832    5722 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591837    5722 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591841    5722 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591845    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591850    5722 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591854    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591858    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591862    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591866    5722 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591871    5722 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591875    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591881    5722 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591887    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591891    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:28.594617 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591896    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591900    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591904    5722 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591908    5722 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591913    5722 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591918    5722 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591922    5722 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591927    5722 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591931    5722 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591936    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591940    5722 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591944    5722 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591949    5722 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591954    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591958    5722 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591962    5722 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591970    5722 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591975    5722 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591982    5722 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:28.595528 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591991    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.591996    5722 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.592000    5722 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.592004    5722 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.592009    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.592013    5722 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593327    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593338    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593343    5722 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593348    5722 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593352    5722 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593357    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593362    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593366    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593371    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593376    5722 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593381    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593386    5722 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593390    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593395    5722 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:28.596432 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593399    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593403    5722 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593407    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593412    5722 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593416    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593420    5722 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593425    5722 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593429    5722 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593434    5722 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593439    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593443    5722 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593447    5722 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593451    5722 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593456    5722 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593460    5722 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593466    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593471    5722 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593474    5722 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593478    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593482    5722 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:28.597379 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593487    5722 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593491    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593496    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593500    5722 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593505    5722 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593513    5722 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593522    5722 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593527    5722 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593532    5722 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593536    5722 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593541    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593545    5722 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593550    5722 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593554    5722 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593558    5722 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593563    5722 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593567    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593571    5722 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593576    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:28.598251 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593580    5722 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593584    5722 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593588    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593594    5722 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593598    5722 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593603    5722 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593608    5722 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593613    5722 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593617    5722 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593621    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593626    5722 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593630    5722 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593635    5722 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593639    5722 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593643    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593648    5722 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593672    5722 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593677    5722 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593682    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593687    5722 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:28.598816 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593692    5722 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593696    5722 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593701    5722 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593705    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593709    5722 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593714    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593718    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593722    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593726    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593730    5722 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593734    5722 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593738    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593742    5722 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593749    5722 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593757    5722 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593763    5722 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593767    5722 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593772    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593777    5722 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:28.599364 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593781    5722 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593786    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593790    5722 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593794    5722 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593799    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593803    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593807    5722 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593812    5722 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593818    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593823    5722 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593826    5722 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593831    5722 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593837    5722 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.593841    5722 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594752    5722 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594762    5722 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594766    5722 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594770    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594775    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594779    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:28.599875 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594784    5722 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594789    5722 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594794    5722 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594798    5722 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594802    5722 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594806    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594810    5722 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594815    5722 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594819    5722 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594824    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594828    5722 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594833    5722 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594837    5722 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594841    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594845    5722 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594849    5722 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594854    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594858    5722 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594862    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594867    5722 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:28.600455 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594871    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594875    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594884    5722 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594889    5722 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594895    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594899    5722 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594904    5722 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594908    5722 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594912    5722 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594916    5722 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594920    5722 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594925    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594929    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594934    5722 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594938    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594942    5722 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594946    5722 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594950    5722 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594955    5722 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594960    5722 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:28.600992 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594964    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594968    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594973    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594980    5722 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594986    5722 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594991    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.594996    5722 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595001    5722 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595006    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595011    5722 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595015    5722 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595020    5722 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595024    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595028    5722 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595036    5722 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595040    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595045    5722 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595050    5722 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595054    5722 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:28.601546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595058    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595063    5722 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595067    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595071    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595076    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595080    5722 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595084    5722 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595088    5722 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595092    5722 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595098    5722 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595103    5722 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595108    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595112    5722 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595117    5722 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595121    5722 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595126    5722 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595130    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595135    5722 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595139    5722 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:28.602042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595143    5722 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595147    5722 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595152    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595157    5722 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595161    5722 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595165    5722 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595170    5722 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595174    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595180    5722 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595184    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595188    5722 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595192    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595198    5722 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595205    5722 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595210    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595215    5722 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595219    5722 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595224    5722 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595230    5722 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:28.602554 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595234    5722 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595238    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.595243    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595395    5722 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595432    5722 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595442    5722 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595454    5722 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595461    5722 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595466    5722 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595473    5722 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595480    5722 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595485    5722 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595490    5722 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595496    5722 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595502    5722 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595507    5722 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595512    5722 flags.go:64] FLAG: --cgroup-root=""
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595517    5722 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595521    5722 flags.go:64] FLAG: --client-ca-file=""
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595526    5722 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595530    5722 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595541    5722 flags.go:64] FLAG: --cluster-domain=""
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595545    5722 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595550    5722 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 02:16:28.603065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595554    5722 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595560    5722 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595569    5722 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595575    5722 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595580    5722 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595586    5722 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595591    5722 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595595    5722 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595600    5722 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595605    5722 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595610    5722 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595617    5722 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595622    5722 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595627    5722 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595632    5722 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595637    5722 flags.go:64] FLAG: --enable-server="true"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595641    5722 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595648    5722 flags.go:64] FLAG: --event-burst="100"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595672    5722 flags.go:64] FLAG: --event-qps="50"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595678    5722 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595684    5722 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595689    5722 flags.go:64] FLAG: --eviction-hard=""
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595696    5722 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595701    5722 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595706    5722 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 02:16:28.603681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595711    5722 flags.go:64] FLAG: --eviction-soft=""
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595716    5722 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595721    5722 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595727    5722 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595733    5722 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595738    5722 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595743    5722 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595747    5722 flags.go:64] FLAG: --feature-gates=""
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595754    5722 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595759    5722 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595765    5722 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595771    5722 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595776    5722 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595781    5722 flags.go:64] FLAG: --help="false"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595786    5722 flags.go:64] FLAG: --hostname-override="ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595791    5722 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595796    5722 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595801    5722 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595806    5722 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595812    5722 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595817    5722 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595822    5722 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595826    5722 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 02:16:28.604304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595831    5722 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595836    5722 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595841    5722 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595846    5722 flags.go:64] FLAG: --kube-reserved=""
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595851    5722 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595856    5722 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595860    5722 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595865    5722 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595870    5722 flags.go:64] FLAG: --lock-file=""
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595875    5722 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595880    5722 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595884    5722 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595894    5722 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595899    5722 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595904    5722 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595908    5722 flags.go:64] FLAG: --logging-format="text"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595913    5722 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595919    5722 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595923    5722 flags.go:64] FLAG: --manifest-url=""
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595928    5722 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595936    5722 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595941    5722 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595947    5722 flags.go:64] FLAG: --max-pods="110"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595952    5722 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595957    5722 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 02:16:28.604907 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595962    5722 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595967    5722 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595972    5722 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595976    5722 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595981    5722 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595993    5722 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.595998    5722 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596003    5722 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596009    5722 flags.go:64] FLAG: --pod-cidr=""
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596014    5722 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596018    5722 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596023    5722 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596028    5722 flags.go:64] FLAG: --port="10250"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596032    5722 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596037    5722 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0c293338267259061"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596042    5722 flags.go:64] FLAG: --qos-reserved=""
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596047    5722 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596052    5722 flags.go:64] FLAG: --register-node="true"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596056    5722 flags.go:64] FLAG: --register-with-taints=""
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596063    5722 flags.go:64] FLAG: --registry-burst="10"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596068    5722 flags.go:64] FLAG: --registry-qps="5"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596073    5722 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596077    5722 flags.go:64] FLAG: --reserved-memory=""
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596084    5722 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596089    5722 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596094    5722 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 02:16:28.605619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596101    5722 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596106    5722 flags.go:64] FLAG: --runonce="false"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596112    5722 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596117    5722 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596122    5722 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596127    5722 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596132    5722 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596137    5722 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596142    5722 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596147    5722 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596152    5722 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596157    5722 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596162    5722 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596167    5722 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596172    5722 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596177    5722 flags.go:64] FLAG: --system-cgroups=""
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596182    5722 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596191    5722 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596196    5722 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596201    5722 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596209    5722 flags.go:64] FLAG: --tls-min-version=""
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596213    5722 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596218    5722 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596222    5722 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596228    5722 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 02:16:28.606697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596233    5722 flags.go:64] FLAG: --v="2"
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596240    5722 flags.go:64] FLAG: --version="false"
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596247    5722 flags.go:64] FLAG: --vmodule=""
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596253    5722 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.596258    5722 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596492    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596500    5722 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596507    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596513    5722 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596517    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596524    5722 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596528    5722 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596533    5722 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596538    5722 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596542    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596547    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596552    5722 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596556    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596560    5722 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596565    5722 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:28.607366 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596569    5722 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596574    5722 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596578    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596583    5722 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596587    5722 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596591    5722 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596596    5722 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596600    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596604    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596610    5722 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596614    5722 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596619    5722 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596623    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596628    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596632    5722 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596636    5722 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596640    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596645    5722 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596649    5722 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:28.607898 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596673    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596678    5722 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596683    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596687    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596692    5722 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596697    5722 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596701    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596705    5722 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596710    5722 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596714    5722 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596718    5722 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596723    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596727    5722 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596731    5722 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596735    5722 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596740    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596744    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596748    5722 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596752    5722 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596756    5722 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:28.608435 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596761    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596765    5722 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596769    5722 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596773    5722 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596778    5722 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596782    5722 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596786    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596790    5722 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596795    5722 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596798    5722 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596803    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596807    5722 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596813    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596817    5722 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596822    5722 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596826    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596830    5722 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596836    5722 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596840    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596844    5722 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:28.609007 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596848    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596852    5722 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596856    5722 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596861    5722 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596866    5722 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596870    5722 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596874    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596879    5722 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596883    5722 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596887    5722 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596892    5722 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596899    5722 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596906    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596911    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596917    5722 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596921    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596925    5722 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596930    5722 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596934    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:28.609527 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596939    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596944    5722 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596948    5722 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596953    5722 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596957    5722 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596963    5722 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596968    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596972    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596976    5722 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596981    5722 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596987    5722 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596993    5722 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.596999    5722 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.597050    5722 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597142    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597150    5722 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:28.610142 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597155    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597160    5722 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597165    5722 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597170    5722 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597174    5722 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597178    5722 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597183    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597188    5722 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597192    5722 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597196    5722 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597201    5722 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597208    5722 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597214    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597219    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597224    5722 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597230    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597235    5722 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597239    5722 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597244    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:28.610529 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597248    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597252    5722 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597257    5722 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597264    5722 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597269    5722 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597273    5722 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597278    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597282    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597287    5722 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597292    5722 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597299    5722 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597305    5722 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597312    5722 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597316    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597321    5722 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597325    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597329    5722 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597334    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597338    5722 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:28.611107 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597342    5722 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597347    5722 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597351    5722 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597355    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597359    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597364    5722 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597368    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597372    5722 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597377    5722 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597382    5722 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597385    5722 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597390    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597394    5722 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597398    5722 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597402    5722 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597406    5722 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597412    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597416    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597422    5722 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:28.611742 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597426    5722 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597431    5722 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597436    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597440    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597450    5722 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597455    5722 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597459    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597463    5722 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597467    5722 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597472    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597476    5722 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597480    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597484    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597489    5722 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597493    5722 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597498    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597502    5722 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597506    5722 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597510    5722 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597514    5722 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:28.612310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597519    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597524    5722 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597528    5722 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597532    5722 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597537    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597541    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597545    5722 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597549    5722 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597553    5722 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597560    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597564    5722 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597569    5722 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597573    5722 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597577    5722 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597581    5722 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597585    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597590    5722 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597605    5722 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597613    5722 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597619    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:28.612935 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597623    5722 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597628    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597632    5722 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597636    5722 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597640    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597644    5722 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.597649    5722 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.601961    5722 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.601983    5722 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.602004    5722 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.602010    5722 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602103    5722 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602110    5722 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602115    5722 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602119    5722 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602121    5722 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602124    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602127    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602129    5722 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:28.614180 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602132    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602135    5722 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602137    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602140    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602142    5722 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602146    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602149    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602152    5722 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602154    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602157    5722 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602159    5722 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602162    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602165    5722 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602167    5722 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602170    5722 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602173    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602176    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602178    5722 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602181    5722 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:28.614678 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602184    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602186    5722 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602190    5722 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602193    5722 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602195    5722 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602198    5722 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602200    5722 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602203    5722 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602206    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602208    5722 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602211    5722 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602213    5722 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602216    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602218    5722 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602222    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602225    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602228    5722 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602231    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602233    5722 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602236    5722 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:28.615167 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602238    5722 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602241    5722 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602243    5722 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602246    5722 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602248    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602251    5722 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602254    5722 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602256    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602259    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602261    5722 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602264    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602266    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602269    5722 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602272    5722 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602274    5722 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602278    5722 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602281    5722 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602284    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602287    5722 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602290    5722 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:28.615723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602293    5722 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602295    5722 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602298    5722 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602301    5722 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602303    5722 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602306    5722 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602309    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602312    5722 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602314    5722 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602317    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602319    5722 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602322    5722 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602325    5722 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602328    5722 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602331    5722 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602333    5722 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602336    5722 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602338    5722 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602341    5722 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602343    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:28.616223 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602346    5722 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602349    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602351    5722 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602354    5722 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602357    5722 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602361    5722 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602365    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602368    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602371    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602374    5722 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602377    5722 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602380    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602382    5722 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602385    5722 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602387    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602390    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602393    5722 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602395    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:28.616764 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602398    5722 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.602428    5722 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602594    5722 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602601    5722 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602604    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602607    5722 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602610    5722 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602613    5722 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602616    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602618    5722 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602621    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602623    5722 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602626    5722 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602629    5722 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602631    5722 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:28.617566 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602634    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602637    5722 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602640    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602642    5722 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602645    5722 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602648    5722 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602652    5722 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602682    5722 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602687    5722 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602691    5722 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602693    5722 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602697    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602699    5722 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602702    5722 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602705    5722 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602708    5722 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602710    5722 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602713    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602716    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602718    5722 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:28.617994 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602721    5722 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602724    5722 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602727    5722 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602729    5722 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602732    5722 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602735    5722 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602737    5722 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602740    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602742    5722 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602745    5722 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602747    5722 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602750    5722 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602752    5722 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602758    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602760    5722 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602763    5722 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602766    5722 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602769    5722 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602771    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602774    5722 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:28.618511 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602777    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602780    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602782    5722 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602785    5722 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602788    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602790    5722 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602793    5722 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602795    5722 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602798    5722 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602800    5722 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602803    5722 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602805    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602808    5722 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602811    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602813    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602816    5722 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602819    5722 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602821    5722 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602824    5722 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602826    5722 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:28.619027 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602829    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602831    5722 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602835    5722 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602837    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602840    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602844    5722 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602847    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602849    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602852    5722 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602855    5722 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602858    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602860    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602863    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602865    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602868    5722 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602871    5722 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602874    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602876    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602879    5722 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:28.619570 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602881    5722 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602884    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602887    5722 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602889    5722 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602891    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602894    5722 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602896    5722 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602901    5722 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602905    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602908    5722 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602911    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602914    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602917    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602919    5722 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.602946    5722 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602979    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:28.620269 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602983    5722 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602985    5722 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602990    5722 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602993    5722 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602995    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.602998    5722 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603000    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603003    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603006    5722 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603008    5722 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603011    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603013    5722 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603016    5722 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603019    5722 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603021    5722 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603024    5722 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603026    5722 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603029    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603031    5722 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603034    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:28.620739 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603036    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603039    5722 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603042    5722 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603044    5722 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603049    5722 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603052    5722 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603054    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603057    5722 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603059    5722 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603062    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603065    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603067    5722 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603070    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603073    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603077    5722 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603080    5722 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603082    5722 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603085    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603087    5722 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603090    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:28.621235 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603092    5722 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603095    5722 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603097    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603100    5722 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603102    5722 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603105    5722 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603108    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603110    5722 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603113    5722 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603115    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603118    5722 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603120    5722 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603124    5722 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603128    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603132    5722 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603135    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603138    5722 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603141    5722 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603144    5722 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:28.621795 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603147    5722 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603152    5722 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603155    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603158    5722 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603161    5722 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603163    5722 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603166    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603169    5722 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603172    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603174    5722 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603177    5722 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603179    5722 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603182    5722 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603184    5722 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603187    5722 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603189    5722 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603192    5722 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603194    5722 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603197    5722 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:28.622286 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603200    5722 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603202    5722 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603205    5722 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603207    5722 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603210    5722 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603212    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603215    5722 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603218    5722 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603220    5722 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603223    5722 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603226    5722 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603228    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603231    5722 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603233    5722 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603236    5722 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603238    5722 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603241    5722 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603245    5722 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603247    5722 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603250    5722 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:28.622814 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603253    5722 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603255    5722 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603258    5722 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603260    5722 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603262    5722 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603265    5722 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:28.603267    5722 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.603347    5722 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.604388    5722 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.604445    5722 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.604640    5722 server.go:1014] "Starting client certificate rotation"
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.604782    5722 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.604833    5722 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 02:10:16 +0000 UTC" deadline="2028-04-21 04:36:08.122628654 +0000 UTC"
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.604873    5722 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12818h19m39.517757936s"
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.605119    5722 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.607461    5722 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:16:28.623323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.608848    5722 log.go:25] "Validated CRI v1 runtime API"
Nov 04 02:16:28.623735 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.610783    5722 log.go:25] "Validated CRI v1 image API"
Nov 04 02:16:28.623735 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.611589    5722 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 02:16:28.623735 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.613998    5722 fs.go:135] Filesystem UUIDs: map[250cade7-5844-46e2-95f5-471dabc7ff87:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 accfd9f5-2ec4-4b7c-bea0-27e782bb0475:/dev/nvme0n1p3]
Nov 04 02:16:28.623847 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.614020    5722 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/208ed61f954784b970a31efd3c31258026f2988ae25b24009fc6fc49a0c04890/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/208ed61f954784b970a31efd3c31258026f2988ae25b24009fc6fc49a0c04890/userdata/shm major:0 minor:334 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3122977277aef15f40acbc1029ef457e89697ed1a4221e12227dc7f4b6247903/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3122977277aef15f40acbc1029ef457e89697ed1a4221e12227dc7f4b6247903/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/392ef34ae96c7880f5b6b35520dda8cb020c00220c74faf3a06c3dd17ad32d4f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/392ef34ae96c7880f5b6b35520dda8cb020c00220c74faf3a06c3dd17ad32d4f/userdata/shm major:0 minor:206 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3c79da8c2694dcbeaa5f2c20a78050cfaf217303165e1bc7c51adce0bc056061/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3c79da8c2694dcbeaa5f2c20a78050cfaf217303165e1bc7c51adce0bc056061/userdata/shm major:0 minor:223 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3dfc0c86dd8b7ff4bf1e75e1fb35e0591b40e91f95e89d029e976eb56e9e43f1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3dfc0c86dd8b7ff4bf1e75e1fb35e0591b40e91f95e89d029e976eb56e9e43f1/userdata/shm major:0 minor:283 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/42296015d7c9d4f29db28b10eb503019be6d047af6f5042571735f9d9c7d5841/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/42296015d7c9d4f29db28b10eb503019be6d047af6f5042571735f9d9c7d5841/userdata/shm major:0 minor:245 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/50a80cb8c071698aaf3f06639e7ce835aa743946b02b5749b247b5b72a408fcf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/50a80cb8c071698aaf3f06639e7ce835aa743946b02b5749b247b5b72a408fcf/userdata/shm major:0 minor:375 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5f948d58e0d10c60aa871eda4631d8f4c81c915e3185f84fd661f6870d479ec1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5f948d58e0d10c60aa871eda4631d8f4c81c915e3185f84fd661f6870d479ec1/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/68a62d211c055303d6576b87c77e6ea65b50e01063e4674498876a815f5a5339/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/68a62d211c055303d6576b87c77e6ea65b50e01063e4674498876a815f5a5339/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/70d7fcbc726be444c444e9994a171c17e8ce8a0878a113a72c1c3c11404e7959/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/70d7fcbc726be444c444e9994a171c17e8ce8a0878a113a72c1c3c11404e7959/userdata/shm major:0 minor:221 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/736c48084a78ef54b820309336aae9998dc6eebffda46853dd3c65dac5fe9032/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/736c48084a78ef54b820309336aae9998dc6eebffda46853dd3c65dac5fe9032/userdata/shm major:0 minor:346 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/74ff51aa0184c5cf97a32737eedbd7ab430588c0724f8ed9d442ad2fa6938293/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/74ff51aa0184c5cf97a32737eedbd7ab430588c0724f8ed9d442ad2fa6938293/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/80c802d79b7174501f3ca233891e822bc03bf31dcc89ee63c3b3fa16cf19f4d1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/80c802d79b7174501f3ca233891e822bc03bf31dcc89ee63c3b3fa16cf19f4d1/userdata/shm major:0 minor:378 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/888fc91086fc7a42aff91473260801783cc9cfaa6c814c433d43b6700f5eb6d0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/888fc91086fc7a42aff91473260801783cc9cfaa6c814c433d43b6700f5eb6d0/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8a21bbb332496e1da45c4f9a66ac40996c6c4d0a5f52fc68c6d3262c5cd83e21/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8a21bbb332496e1da45c4f9a66ac40996c6c4d0a5f52fc68c6d3262c5cd83e21/userdata/shm major:0 minor:372 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8be675cfc5c7976e27448961b34650ed3996396c1e42c29a5c6e3caad6330760/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8be675cfc5c7976e27448961b34650ed3996396c1e42c29a5c6e3caad6330760/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9053cdd424a54a3e6487f460068aa12189ea1f18ff2a1b8df144bc8b3fde7012/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9053cdd424a54a3e6487f460068aa12189ea1f18ff2a1b8df144bc8b3fde7012/userdata/shm major:0 minor:247 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a30ef3e27e679c19ae50bdb28929f627437e7e9cfd2c3e88c5e9a558bb087ab8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a30ef3e27e679c19ae50bdb28929f627437e7e9cfd2c3e88c5e9a558bb087ab8/userdata/shm major:0 minor:388 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a4e7f05fa0e72d52dffc77b414fba839bce82f20ee554fe6ea29a69a84be077d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a4e7f05fa0e72d52dffc77b414fba839bce82f20ee554fe6ea29a69a84be077d/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bc2af2ccbc4ba7e925f11d10e1f3e77248e478747e9d34983f8ba74028d75054/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bc2af2ccbc4ba7e925f11d10e1f3e77248e478747e9d34983f8ba74028d75054/userdata/shm major:0 minor:243 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c21d4e603efcf7726e2d37f5c50b950dc585a74bc9bdd50e28ec3b9db15784fb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c21d4e603efcf7726e2d37f5c50b950dc585a74bc9bdd50e28ec3b9db15784fb/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c4e591d4062df69fffaad9b40568bf2c34efa0082d4c616ea1c662787781af1a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c4e591d4062df69fffaad9b40568bf2c34efa0082d4c616ea1c662787781af1a/userdata/shm major:0 minor:374 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d688c2c342d0e1635c2bd69b7d21827e28fa561b82f0c3e123c45713cd7927c9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d688c2c342d0e1635c2bd69b7d21827e28fa561b82f0c3e123c45713cd7927c9/userdata/shm major:0 minor:77 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9e569328a4b5f28704661331bf7696ddd0de8213b3f0f98e79cfe9068406054/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9e569328a4b5f28704661331bf7696ddd0de8213b3f0f98e79cfe9068406054/userdata/shm major:0 minor:367 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/db65703a2d35615b65e2666f80d107fd5e0f2ac4803c527f5525dacc37a6c288/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/db65703a2d35615b65e2666f80d107fd5e0f2ac4803c527f5525dacc37a6c288/userdata/shm major:0 minor:394 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e8c329d87ab072825d4b8b205d1a0d9674886fdcf8d30fadc706c8b162cf852b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e8c329d87ab072825d4b8b205d1a0d9674886fdcf8d30fadc706c8b162cf852b/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e95a0490abfeb4e0afdaf1ccdd3e14f044e97094f528f44c9b90c1fc2afef23e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e95a0490abfeb4e0afdaf1ccdd3e14f044e97094f528f44c9b90c1fc2afef23e/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ef80eef695c679633b66e0907d584ec1a4f132eadb565a5a5df4b4e3e6ab2ce3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ef80eef695c679633b66e0907d584ec1a4f132eadb565a5a5df4b4e3e6ab2ce3/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f7f709f4c834e44180c3589fd22a9121ed87617588cf190685400026021a2691/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f7f709f4c834e44180c3589fd22a9121ed87617588cf190685400026021a2691/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f836d7cad3ba9279d3edf5782ea51af37ee79e7d4e527fe50e0a21298a547237/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f836d7cad3ba9279d3edf5782ea51af37ee79e7d4e527fe50e0a21298a547237/userdata/shm major:0 minor:231 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/faa2f0dfd388b04df8db06de154633182babe84a2cf95ad6361c7427fc4c2b66/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/faa2f0dfd388b04df8db06de154633182babe84a2cf95ad6361c7427fc4c2b66/userdata/shm major:0 minor:370 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/122326d1-cd64-4662-8234-9ce0718e5c32/volumes/kubernetes.io~projected/kube-api-access-lt847:{mountpoint:/var/lib/kubelet/pods/122326d1-cd64-4662-8234-9ce0718e5c32/volumes/kubernetes.io~projected/kube-api-access-lt847 major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1486093b-695f-4ba3-8737-385bfe779147/volumes/kubernetes.io~projected/kube-api-access-sgs6g:{mountpoint:/var/lib/kubelet/pods/1486093b-695f-4ba3-8737-385bfe779147/volumes/kubernetes.io~projected/kube-api-access-sgs6g major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/159902bd-5489-46b3-8368-55551a6b9b68/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/159902bd-5489-46b3-8368-55551a6b9b68/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/159902bd-5489-46b3-8368-55551a6b9b68/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/159902bd-5489-46b3-8368-55551a6b9b68/volumes/kubernetes.io~empty-dir/tmp major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/159902bd-5489-46b3-8368-55551a6b9b68/volumes/kubernetes.io~projected/kube-api-access-sfm6n:{mountpoint:/var/lib/kubelet/pods/159902bd-5489-46b3-8368-55551a6b9b68/volumes/kubernetes.io~projected/kube-api-access-sfm6n major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~projected/kube-api-access-42s9q:{mountpoint:/var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~projected/kube-api-access-42s9q major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~secret/default-certificate major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~secret/metrics-certs major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~secret/stats-auth major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36162c63-49e7-4782-8ea9-55db430a4c73/volumes/kubernetes.io~projected/kube-api-access-bgk46:{mountpoint:/var/lib/kubelet/pods/36162c63-49e7-4782-8ea9-55db430a4c73/volumes/kubernetes.io~projected/kube-api-access-bgk46 major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/36162c63-49e7-4782-8ea9-55db430a4c73/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/36162c63-49e7-4782-8ea9-55db430a4c73/volumes/kubernetes.io~secret/metrics-certs major:0 minor:380 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3d9a67bf-5458-4857-acd0-473c00297677/volumes/kubernetes.io~projected/kube-api-access-5s5jr:{mountpoint:/var/lib/kubelet/pods/3d9a67bf-5458-4857-acd0-473c00297677/volumes/kubernetes.io~projected/kube-api-access-5s5jr major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/40222b3d-3cdb-4da6-8bfa-3764919a09a4/volumes/kubernetes.io~projected/kube-api-access-zvxlk:{mountpoint:/var/lib/kubelet/pods/40222b3d-3cdb-4da6-8bfa-3764919a09a4/volumes/kubernetes.io~projected/kube-api-access-zvxlk major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/40222b3d-3cdb-4da6-8bfa-3764919a09a4/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/40222b3d-3cdb-4da6-8bfa-3764919a09a4/volumes/kubernetes.io~secret/serving-cert major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/volumes/kubernetes.io~secret/agent-certs major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/482a1092-091d-415e-bbbf-c2e41a770ba0/volumes/kubernetes.io~projected/kube-api-access-k8vtj:{mountpoint:/var/lib/kubelet/pods/482a1092-091d-415e-bbbf-c2e41a770ba0/volumes/kubernetes.io~projected/kube-api-access-k8vtj major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5435f585-4325-42b2-8992-988af472d105/volumes/kubernetes.io~projected/kube-api-access-2w48f:{mountpoint:/var/lib/kubelet/pods/5435f585-4325-42b2-8992-988af472d105/volumes/kubernetes.io~projected/kube-api-access-2w48f major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5435f585-4325-42b2-8992-988af472d105/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/5435f585-4325-42b2-8992-988af472d105/volumes/kubernetes.io~secret/serving-cert major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab36405-af90-4b38-9ede-4ffad5c1ad8f/volumes/kubernetes.io~projected/kube-api-access-6xvrt:{mountpoint:/var/lib/kubelet/pods/5ab36405-af90-4b38-9ede-4ffad5c1ad8f/volumes/kubernetes.io~projected/kube-api-access-6xvrt major:0 minor:239 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5ab36405-af90-4b38-9ede-4ffad5c1ad8f/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/5ab36405-af90-4b38-9ede-4ffad5c1ad8f/volumes/kubernetes.io~secret/cert major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/69dc840b-bd18-41ad-a213-f0d2c1252fca/volumes/kubernetes.io~projected/kube-api-access-czjth:{mountpoint:/var/lib/kubelet/pods/69dc840b-bd18-41ad-a213-f0d2c1252fca/volumes/kubernetes.io~projected/kube-api-access-czjth major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/69dc840b-bd18-41ad-a213-f0d2c1252fca/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/69dc840b-bd18-41ad-a213-f0d2c1252fca/volumes/kubernetes.io~secret/serving-cert major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/735db15d-9069-4b87-ab87-7ed88d365bdb/volumes/kubernetes.io~projected/kube-api-access-bxbr9:{mountpoint:/var/lib/kubelet/pods/735db15d-9069-4b87-ab87-7ed88d365bdb/volumes/kubernetes.io~projected/kube-api-access-bxbr9 major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82713f3a-e89e-4116-8160-03fbc4122635/volumes/kubernetes.io~projected/kube-api-access-l4xd5:{mountpoint:/var/lib/kubelet/pods/82713f3a-e89e-4116-8160-03fbc4122635/volumes/kubernetes.io~projected/kube-api-access-l4xd5 major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a21ec19-27ea-4fd8-bbeb-154ef1063833/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/9a21ec19-27ea-4fd8-bbeb-154ef1063833/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a21ec19-27ea-4fd8-bbeb-154ef1063833/volumes/kubernetes.io~projected/kube-api-access-q82m4:{mountpoint:/var/lib/kubelet/pods/9a21ec19-27ea-4fd8-bbeb-154ef1063833/volumes/kubernetes.io~projected/kube-api-access-q82m4 major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a21ec19-27ea-4fd8-bbeb-154ef1063833/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/9a21ec19-27ea-4fd8-bbeb-154ef1063833/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5d0efd2-3946-4144-8971-b4867230e8ec/volumes/kubernetes.io~projected/kube-api-access-rcwlx:{mountpoint:/var/lib/kubelet/pods/a5d0efd2-3946-4144-8971-b4867230e8ec/volumes/kubernetes.io~projected/kube-api-access-rcwlx major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a/volumes/kubernetes.io~projected/kube-api-access-pcgwg:{mountpoint:/var/lib/kubelet/pods/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a/volumes/kubernetes.io~projected/kube-api-access-pcgwg major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a/volumes/kubernetes.io~secret/metrics-tls major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aece3088-8729-43a1-8533-7bdd145d2fdd/volumes/kubernetes.io~projected/kube-api-access-vsdwr:{mountpoint:/var/lib/kubelet/pods/aece3088-8729-43a1-8533-7bdd145d2fdd/volumes/kubernetes.io~projected/kube-api-access-vsdwr major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aece3088-8729-43a1-8533-7bdd145d2fdd/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls:{mountpoint:/var/lib/kubelet/pods/aece3088-8729-43a1-8533-7bdd145d2fdd/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b4f3aa40-09ba-47db-b65b-ed4db9045c1f/volumes/kubernetes.io~projected/kube-api-access-c4gp6:{mountpoint:/var/lib/kubelet/pods/b4f3aa40-09ba-47db-b65b-ed4db9045c1f/volumes/kubernetes.io~projected/kube-api-access-c4gp6 major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b4f3aa40-09ba-47db-b65b-ed4db9045c1f/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/b4f3aa40-09ba-47db-b65b-ed4db9045c1f/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ba210879-af81-4f17-9948-16a94100f39b/volumes/kubernetes.io~projected/kube-api-access-zxsps:{mountpoint:/var/lib/kubelet/pods/ba210879-af81-4f17-9948-16a94100f39b/volumes/kubernetes.io~projected/kube-api-access-zxsps major:0 minor:238 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/be37687a-5d12-4543-83eb-61961531f81f/volumes/kubernetes.io~projected/kube-api-access-pb95c:{mountpoint:/var/lib/kubelet/pods/be37687a-5d12-4543-83eb-61961531f81f/volumes/kubernetes.io~projected/kube-api-access-pb95c major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c80a9883-2db8-4389-aba0-813ecf38be30/volumes/kubernetes.io~projected/kube-api-access-zdmnh:{mountpoint:/var/lib/kubelet/pods/c80a9883-2db8-4389-aba0-813ecf38be30/volumes/kubernetes.io~projected/kube-api-access-zdmnh major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d8b9b855-1e9b-47f9-b775-304910b95667/volumes/kubernetes.io~projected/kube-api-access-htvgh:{mountpoint:/var/lib/kubelet/pods/d8b9b855-1e9b-47f9-b775-304910b95667/volumes/kubernetes.io~projected/kube-api-access-htvgh major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dac01f36-2182-40fb-9599-dbbac45a4b76/volumes/kubernetes.io~projected/kube-api-access-krnh6:{mountpoint:/var/lib/kubelet/pods/dac01f36-2182-40fb-9599-dbbac45a4b76/volumes/kubernetes.io~projected/kube-api-access-krnh6 major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dc3025c2-fdcb-4557-b5af-0433a3f89fef/volumes/kubernetes.io~projected/kube-api-access-q8hjr:{mountpoint:/var/lib/kubelet/pods/dc3025c2-fdcb-4557-b5af-0433a3f89fef/volumes/kubernetes.io~projected/kube-api-access-q8hjr major:0 minor:240 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dc3025c2-fdcb-4557-b5af-0433a3f89fef/volumes/kubernetes.io~secret/samples-operator-tls:{mountpoint:/var/lib/kubelet/pods/dc3025c2-fdcb-4557-b5af-0433a3f89fef/volumes/kubernetes.io~secret/samples-operator-tls major:0 minor:369 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dcca8570-7261-499b-938a-10097ca652b0/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/dcca8570-7261-499b-938a-10097ca652b0/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:381 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9/volumes/kubernetes.io~secret/networking-console-plugin-cert:{mountpoint:/var/lib/kubelet/pods/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9/volumes/kubernetes.io~secret/networking-console-plugin-cert major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e64633a6-4199-4a1e-ac6e-b610f6a9f034/volumes/kubernetes.io~projected/kube-api-access-92wnq:{mountpoint:/var/lib/kubelet/pods/e64633a6-4199-4a1e-ac6e-b610f6a9f034/volumes/kubernetes.io~projected/kube-api-access-92wnq major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e64633a6-4199-4a1e-ac6e-b610f6a9f034/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/e64633a6-4199-4a1e-ac6e-b610f6a9f034/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:341 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e8f75c8e-a241-4641-814e-f233535d9b7e/volumes/kubernetes.io~projected/kube-api-access-hr9bf:{mountpoint:/var/lib/kubelet/pods/e8f75c8e-a241-4641-814e-f233535d9b7e/volumes/kubernetes.io~projected/kube-api-access-hr9bf major:0 minor:242 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~projected/kube-api-access-vpxxh:{mountpoint:/var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~projected/kube-api-access-vpxxh major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~projected/registry-tls:{mountpoint:/var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~projected/registry-tls major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:216 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/e08af9d4008de9f9bc019c4a831600ecd4be6e1bcd3f993da5a9bea8bb3964cc/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/b765d9272dc0848d90b5e6924352625176f8462061af5ce6af9fe70a21a95313/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/3a96d29500ff3d811c56a1634dde3c3bb51e6446b1a888991c0122d336a2d83c/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/0a93a33ff9fe3bdb38e4f4716d560a24d8c43037f612cee05576484a512a49ca/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/60736ed014ac0276bc2766a5a19c776b4f852252677589b832474f8ba93e24b5/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/5625c085a79cd5a04365c7dacf854bed5ec484cdf908fb37f01dfb831a67a085/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/0238d4087c6b4b1cc65ca940e46cebc77eb1a1760a466bd78e552e57a69b52f4/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/8d357b63c3ec3b05a4f7040c2ebf18713246add569eccaa96ff089c6bda56425/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/18fc8319894aaed386a92d2f1324b6ef09cfc0e489cc74ec2746c0a9c7aacead/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/26c7f96e53f4de0f6bb960a4c6a6c9e6ac759e390b6f9d49b9e463bdf84c66b4/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/18680d1016d8e3dcf2c2006fe17bb230d7d129faf830f67c678133c87c01b22a/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/a077671caadf90734d6cad834b1a802f4a9a147c115ce238746c0f1a76005695/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/243e340707ce7af87f7963ae5bbbf45865e9d03ce0ab2868d5a6385d6976b574/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/b5d84ec8c8f3b184d2d05c75c1f262b8b2bb208695039d419595708c59cdf0ed/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/85cb80a7a9cf477f5ebbd4340b878def0574d978af4c34b6e86266284f0d3e1d/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/64d93024aa3b0d85eb661bdede2187849a7f0236f0bba921e470726456fecafa/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/e34a85c3077387ba6a55257849ea319034bb4705fe678bb1c11e9cc242609c84/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/3729a6b336977889e30fe2424d81ac293c1ad94ac5732de292deef15988c1b87/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/5bb1a13fa33395fb52b231884857bcc5bbaf6c76ebcb1bb8aa42f8ef89dbed5b/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/410f8a3af5d7fd960d6bad7051d837a384eef322e8bc889870d02cc8a472a418/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/3dba6ac9b5739ebf37b2b948541f838db330f8b4c37603332e6c6e3f352864ef/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-249:{mountpoint:/var/lib/containers/storage/overlay/7c9a4eadcc87e50886d54383963699a2b540a239780011d95e3191e85b03af48/merged major:0 minor:249 fsType:overlay blockSize:0} overlay_0-251:{mountpoint:/var/lib/containers/storage/overlay/73acbcf66656a84f3e1c7fa3fb656818c80c4b117241ddec3e4b31797d65d0dc/merged major:0 minor:251 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/6488d95196f020efee5462eb17fafdb9289f8f98e40dc850847a80c340dfd65c/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/a8ae44c74f5e9c02b77123ffdeab79c2dbee036ca05dc8c0ba249c4d50d98912/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-257:{mountpoint:/var/lib/containers/storage/overlay/ca0032140e8af7f496e3ebd3624a6acf6798364ec3715c1c2fa5e7b40d934d17/merged major:0 minor:257 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/92c6da7dd7848b4ed056d8cc02dceba75869ad8b1efac78c981d97c62c330ca4/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-261:{mountpoint:/var/lib/containers/storage/overlay/7428fb22654a2f004805b7b0db9ff704b8e6bb6f5594c1cfe9368090962487ac/merged major:0 minor:261 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/8bd4adb1a314fcb5dcbfc405797f55d487e56fb3c5172e93e8373aab85eeb5a3/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/16cc3cef11405b4be6b6d167c30c0f5d174be7eb204e9c1c19f615aba287df52/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/0fbcd14bda205486a823832ab07edf36a396378953e9eca9b9437fe13aae94fa/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/604602afc471f70340c01f1c34a1b0ddd2d1a02e80df5ce6d901db54f3a875d1/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-279:{mountpoint:/var/lib/containers/storage/overlay/6f62f6aff0ec2f15ffbbb4622df488853d7a08da6a3ee40c3fa0313bb81a3bd4/merged major:0 minor:279 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/d11f6116ff830bfbe2f3cfdd3c4df274e4b986741c2c7b8685d499dacb1f2feb/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/f71947c9e3d5064f58c6f72d5375815d9890842dd84853cfd61e2a420163c42e/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-291:{mountpoint:/var/lib/containers/storage/overlay/a0194aeae22876a131e3a9bf13f94bd74eee1d3c91e683ccc1cd576c977c3e77/merged major:0 minor:291 fsType:overlay blockSize:0} overlay_0-293:{mountpoint:/var/lib/containers/storage/overlay/e31e19502fa459e4d8ac81487a9563a2d992acb61e700d7d7c1c7416d25d980a/merged major:0 minor:293 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/be057064ce5eff268577ddbca08bd0e0d14f6f787e69ced71a5ab4d149c01039/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-301:{mountpoint:/var/lib/containers/storage/overlay/035e4a9fe286b70e43ef6f5adf8633c50015a6d8624ec7015b3ab4a29ba22419/merged major:0 minor:301 fsType:overlay blockSize:0} overlay_0-303:{mountpoint:/var/lib/containers/storage/overlay/def241b249cdce461e198f9560322f3e645f272f34c4cd9b2237bc9a7ebe4d31/merged major:0 minor:303 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/0bbddf2dbbb397c32a0f1e5f6f8b4bd1f34f4ed60d8de899bc590c78faef1e8d/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/d6f6fcaa3abc74db4e689b0810e69d24158748937c0e9c2f054b0bb54c9822bc/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/4d876e28a37448b1b00b415885a8b9431398b038b98afe48a838a68c1f84d64e/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/601849e2d9d9d927facffc924fbcb7f67ec3c5ca0d115c2a9e89ee645075dd7d/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/fd63ba0f178d045f294b004a878bd1502c143f0875bba83d6619bdb7d81aa6ce/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/31547ed8c64064c917caa37d6ca89f30f617961c082831a81c5e060149d3d439/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/b626bd8232c116d5fde314f75be9e45bbee6d85f578ce77d5060167bb8a20f93/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/b4055073d4144eb1169771806ccc379d52ef14da65fab6ff5bc7c8e544a64579/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-382:{mountpoint:/var/lib/containers/storage/overlay/aae378717c73d509dee5826f3ab8818aa2c423ff8449aed0a1882a611e26bb6c/merged major:0 minor:382 fsType:overlay blockSize:0} overlay_0-384:{mountpoint:/var/lib/containers/storage/overlay/7c203aabd9e90eab5316a50300fb503ed23d37255316ee24b23f67849f2e1774/merged major:0 minor:384 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/c6a59e251e059c67256ba2ac06191a2f44d074971a9efb3ee800fa1604155175/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-396:{mountpoint:/var/lib/containers/storage/overlay/faaaccc041d108170bd4144d5f0e3d50b7b3e91b806975cd5ff8a6dc65c3251a/merged major:0 minor:396 fsType:overlay blockSize:0} overlay_0-398:{mountpoint:/var/lib/containers/storage/overlay/b8202c861bb896a4307e0ea46ceb9461cbd8bf7f4a729f10ee768ac1513b8a4f/merged major:0 minor:398 fsType:overlay blockSize:0} overlay_0-400:{mountpoint:/var/lib/containers/storage/overlay/74ad129548aee5bf90edafc6e591927caff194b2d201c0717a4ae8d3f6efcab5/merged major:0 minor:400 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/e6b315a82191a7182abaa16a949d3a0882a455b773506591da1d23b483bb1b1d/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-409:{mountpoint:/var/lib/containers/storage/overlay/df3b315f5a5d073af424a459888676409cdc5b2893b3c1d998e96348f660fe21/merged major:0 minor:409 fsType:overlay blockSize:0} overlay_0-414:{mountpoint:/var/lib/containers/storage/overlay/ee09e81221cb308c93f095543ae72a7f7fa42f881d8c9a225c238ad20eb3460a/merged major:0 minor:414 fsType:overlay blockSize:0} overlay_0-416:{mountpoint:/var/lib/containers/storage/overlay/27651bb3797b88edafd561dc5bb34947e52e1338c8f48f33194f71c1b9a2491c/merged major:0 minor:416 fsType:overlay blockSize:0} overlay_0-418:{mountpoint:/var/lib/containers/storage/overlay/42171fd5770cb9a50e3b7cd840ba06b1fa25ffbfc7b6a77dec8af26907ec8bd2/merged major:0 minor:418 fsType:overlay blockSize:0} overlay_0-420:{mountpoint:/var/lib/containers/storage/overlay/8ac92ac39131b3b74207419adef51ac3319b07ace4303438c32a1b086e7c6eab/merged major:0 minor:420 fsType:overlay blockSize:0} overlay_0-426:{mountpoint:/var/lib/containers/storage/overlay/fb3846212de49a86169d136c04e8d3ff7fb5bcff22b36db6023f579dc62862df/merged major:0 minor:426 fsType:overlay blockSize:0} overlay_0-432:{mountpoint:/var/lib/containers/storage/overlay/b2d3ca74e06f36ab63c0908e83ab897416b4ab23dec0ce79943b5950557f0f99/merged major:0 minor:432 fsType:overlay blockSize:0} overlay_0-437:{mountpoint:/var/lib/containers/storage/overlay/6c4b52553aaac5fb8701c42a7070fcf0ba132a27d475430b4510fa6f46a8e1bf/merged major:0 minor:437 fsType:overlay blockSize:0} overlay_0-439:{mountpoint:/var/lib/containers/storage/overlay/4f70e7d3a464a119a654a072a6628a68534c2ac7df464fd7e61fa4e4b06bf1b5/merged major:0 minor:439 fsType:overlay blockSize:0} overlay_0-441:{mountpoint:/var/lib/containers/storage/overlay/5a8d8bfa5d4e827a491ad2862b20bba3a2d3a3a7e08a640790aa3722ef8a479a/merged major:0 minor:441 fsType:overlay blockSize:0} overlay_0-450:{mountpoint:/var/lib/containers/storage/overlay/f8758c28ff5cf4c095120e1f21b212d062809c120f1879cfe43defe263125e2e/merged major:0 minor:450 fsType:overlay blockSize:0} overlay_0-456:{mountpoint:/var/lib/containers/storage/overlay/9b028cf78963b579c9bdabdeb956ddb5dac5b790b402616e09ce1b4d0917fd1d/merged major:0 minor:456 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/53a5e6d8a5d419c59a7311a78a547483a009d9549af0d5c56e86645f2ae3dc53/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/f6405f7035da36b5daf51d55213a85f396e6cc4c8665b4e9652cbe54a95a759d/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/31aa926de3a5202a862c0ae40dc6a74b010056d54affe14bd229f2980fc2c1dc/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/510c1722e9ae256fb9cf77c63cb94520379d817e53c9c98631177a9708e46792/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/17c279dde45c3663217474bc6f539cc952458314ecc40a887204b58fca36faa9/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/4f4fa11ce3ff5dc8aed5b666b9b040286147fb3568e4084093232d04a2b1d872/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/d5a85be4431a39ee3d6ce0bdc96eab39d82072237e68e0b6eabe974de5d66af8/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/dc5ffeb1ac0a3a862329d41bf33a752ea14b96635a763870a4054ef037759c99/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/e087b9b26233b637c731f661c8ae59766f5870b97c0312ce8c322bb906e5b4dd/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/9a30a9b1d5b5dc57935e880fbd29194b456a044a3549b244fe96a4f7f96394dc/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 04 02:16:28.624107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.622857    5722 manager.go:217] Machine: {Timestamp:2026-11-04 02:16:28.622346662 +0000 UTC m=+0.095883836 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100114 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec287f4e8e7ac9872f575ce459e8b86a SystemUUID:ec287f4e-8e7a-c987-2f57-5ce459e8b86a BootID:6640e8cb-9ab2-467a-9f28-b2e327f19af4 Filesystems:[{Device:/var/lib/kubelet/pods/159902bd-5489-46b3-8368-55551a6b9b68/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:48 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f7f709f4c834e44180c3589fd22a9121ed87617588cf190685400026021a2691/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/70d7fcbc726be444c444e9994a171c17e8ce8a0878a113a72c1c3c11404e7959/userdata/shm DeviceMajor:0 DeviceMinor:221 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/42296015d7c9d4f29db28b10eb503019be6d047af6f5042571735f9d9c7d5841/userdata/shm DeviceMajor:0 DeviceMinor:245 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-249 DeviceMajor:0 DeviceMinor:249 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:219 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:363 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/aece3088-8729-43a1-8533-7bdd145d2fdd/volumes/kubernetes.io~projected/kube-api-access-vsdwr DeviceMajor:0 DeviceMinor:209 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b4f3aa40-09ba-47db-b65b-ed4db9045c1f/volumes/kubernetes.io~projected/kube-api-access-c4gp6 DeviceMajor:0 DeviceMinor:211 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a4e7f05fa0e72d52dffc77b414fba839bce82f20ee554fe6ea29a69a84be077d/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3c79da8c2694dcbeaa5f2c20a78050cfaf217303165e1bc7c51adce0bc056061/userdata/shm DeviceMajor:0 DeviceMinor:223 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f836d7cad3ba9279d3edf5782ea51af37ee79e7d4e527fe50e0a21298a547237/userdata/shm DeviceMajor:0 DeviceMinor:231 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/dac01f36-2182-40fb-9599-dbbac45a4b76/volumes/kubernetes.io~projected/kube-api-access-krnh6 DeviceMajor:0 DeviceMinor:309 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-257 DeviceMajor:0 DeviceMinor:257 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-398 DeviceMajor:0 DeviceMinor:398 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/40222b3d-3cdb-4da6-8bfa-3764919a09a4/volumes/kubernetes.io~projected/kube-api-access-zvxlk DeviceMajor:0 DeviceMinor:226 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c80a9883-2db8-4389-aba0-813ecf38be30/volumes/kubernetes.io~projected/kube-api-access-zdmnh DeviceMajor:0 DeviceMinor:227 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8a21bbb332496e1da45c4f9a66ac40996c6c4d0a5f52fc68c6d3262c5cd83e21/userdata/shm DeviceMajor:0 DeviceMinor:372 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/dcca8570-7261-499b-938a-10097ca652b0/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:381 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-418 DeviceMajor:0 DeviceMinor:418 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:216 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:228 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bc2af2ccbc4ba7e925f11d10e1f3e77248e478747e9d34983f8ba74028d75054/userdata/shm DeviceMajor:0 DeviceMinor:243 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-439 DeviceMajor:0 DeviceMinor:439 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9a21ec19-27ea-4fd8-bbeb-154ef1063833/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/735db15d-9069-4b87-ab87-7ed88d365bdb/volumes/kubernetes.io~projected/kube-api-access-bxbr9 DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c4e591d4062df69fffaad9b40568bf2c34efa0082d4c616ea1c662787781af1a/userdata/shm DeviceMajor:0 DeviceMinor:374 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-400 DeviceMajor:0 DeviceMinor:400 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9a21ec19-27ea-4fd8-bbeb-154ef1063833/volumes/kubernetes.io~projected/kube-api-access-q82m4 DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e95a0490abfeb4e0afdaf1ccdd3e14f044e97094f528f44c9b90c1fc2afef23e/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-261 DeviceMajor:0 DeviceMinor:261 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-409 DeviceMajor:0 DeviceMinor:409 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-414 DeviceMajor:0 DeviceMinor:414 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/888fc91086fc7a42aff91473260801783cc9cfaa6c814c433d43b6700f5eb6d0/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/392ef34ae96c7880f5b6b35520dda8cb020c00220c74faf3a06c3dd17ad32d4f/userdata/shm DeviceMajor:0 DeviceMinor:206 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e64633a6-4199-4a1e-ac6e-b610f6a9f034/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:341 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1486093b-695f-4ba3-8737-385bfe779147/volumes/kubernetes.io~projected/kube-api-access-sgs6g DeviceMajor:0 DeviceMinor:212 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~projected/kube-api-access-vpxxh DeviceMajor:0 DeviceMinor:230 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e8f75c8e-a241-4641-814e-f233535d9b7e/volumes/kubernetes.io~projected/kube-api-access-hr9bf DeviceMajor:0 DeviceMinor:242 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9e569328a4b5f28704661331bf7696ddd0de8213b3f0f98e79cfe9068406054/userdata/shm DeviceMajor:0 DeviceMinor:367 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/69dc840b-bd18-41ad-a213-f0d2c1252fca/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:204 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5435f585-4325-42b2-8992-988af472d105/volumes/kubernetes.io~projected/kube-api-access-2w48f DeviceMajor:0 DeviceMinor:210 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a/volumes/kubernetes.io~projected/kube-api-access-pcgwg DeviceMajor:0 DeviceMinor:241 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/736c48084a78ef54b820309336aae9998dc6eebffda46853dd3c65dac5fe9032/userdata/shm DeviceMajor:0 DeviceMinor:346 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/36162c63-49e7-4782-8ea9-55db430a4c73/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:380 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/159902bd-5489-46b3-8368-55551a6b9b68/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:47 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/482a1092-091d-415e-bbbf-c2e41a770ba0/volumes/kubernetes.io~projected/kube-api-access-k8vtj DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e8c329d87ab072825d4b8b205d1a0d9674886fdcf8d30fadc706c8b162cf852b/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5f948d58e0d10c60aa871eda4631d8f4c81c915e3185f84fd661f6870d479ec1/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/122326d1-cd64-4662-8234-9ce0718e5c32/volumes/kubernetes.io~projected/kube-api-access-lt847 DeviceMajor:0 DeviceMinor:54 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/82713f3a-e89e-4116-8160-03fbc4122635/volumes/kubernetes.io~projected/kube-api-access-l4xd5 DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c21d4e603efcf7726e2d37f5c50b950dc585a74bc9bdd50e28ec3b9db15784fb/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/69dc840b-bd18-41ad-a213-f0d2c1252fca/volumes/kubernetes.io~projected/kube-api-access-czjth DeviceMajor:0 DeviceMinor:208 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~projected/kube-api-access-42s9q DeviceMajor:0 DeviceMinor:213 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-301 DeviceMajor:0 DeviceMinor:301 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-437 DeviceMajor:0 DeviceMinor:437 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:49 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9053cdd424a54a3e6487f460068aa12189ea1f18ff2a1b8df144bc8b3fde7012/userdata/shm DeviceMajor:0 DeviceMinor:247 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~projected/registry-tls DeviceMajor:0 DeviceMinor:225 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-382 DeviceMajor:0 DeviceMinor:382 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3122977277aef15f40acbc1029ef457e89697ed1a4221e12227dc7f4b6247903/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b4f3aa40-09ba-47db-b65b-ed4db9045c1f/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-291 DeviceMajor:0 DeviceMinor:291 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-303 DeviceMajor:0 DeviceMinor:303 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9/volumes/kubernetes.io~secret/networking-console-plugin-cert DeviceMajor:0 DeviceMinor:229 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-416 DeviceMajor:0 DeviceMinor:416 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-426 DeviceMajor:0 DeviceMinor:426 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-432 DeviceMajor:0 DeviceMinor:432 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ef80eef695c679633b66e0907d584ec1a4f132eadb565a5a5df4b4e3e6ab2ce3/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3dfc0c86dd8b7ff4bf1e75e1fb35e0591b40e91f95e89d029e976eb56e9e43f1/userdata/shm DeviceMajor:0 DeviceMinor:283 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/74ff51aa0184c5cf97a32737eedbd7ab430588c0724f8ed9d442ad2fa6938293/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/68a62d211c055303d6576b87c77e6ea65b50e01063e4674498876a815f5a5339/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/dc3025c2-fdcb-4557-b5af-0433a3f89fef/volumes/kubernetes.io~projected/kube-api-access-q8hjr DeviceMajor:0 DeviceMinor:240 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/159902bd-5489-46b3-8368-55551a6b9b68/volumes/kubernetes.io~projected/kube-api-access-sfm6n DeviceMajor:0 DeviceMinor:51 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/36162c63-49e7-4782-8ea9-55db430a4c73/volumes/kubernetes.io~projected/kube-api-access-bgk46 DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3d9a67bf-5458-4857-acd0-473c00297677/volumes/kubernetes.io~projected/kube-api-access-5s5jr DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-441 DeviceMajor:0 DeviceMinor:441 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/faa2f0dfd388b04df8db06de154633182babe84a2cf95ad6361c7427fc4c2b66/userdata/shm DeviceMajor:0 DeviceMinor:370 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d8b9b855-1e9b-47f9-b775-304910b95667/volumes/kubernetes.io~projected/kube-api-access-htvgh DeviceMajor:0 DeviceMinor:52 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a5d0efd2-3946-4144-8971-b4867230e8ec/volumes/kubernetes.io~projected/kube-api-access-rcwlx DeviceMajor:0 DeviceMinor:53 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/be37687a-5d12-4543-83eb-61961531f81f/volumes/kubernetes.io~projected/kube-api-access-pb95c DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/80c802d79b7174501f3ca233891e822bc03bf31dcc89ee63c3b3fa16cf19f4d1/userdata/shm DeviceMajor:0 DeviceMinor:378 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a30ef3e27e679c19ae50bdb28929f627437e7e9cfd2c3e88c5e9a558bb087ab8/userdata/shm DeviceMajor:0 DeviceMinor:388 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/40222b3d-3cdb-4da6-8bfa-3764919a09a4/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:218 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-384 DeviceMajor:0 DeviceMinor:384 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-420 DeviceMajor:0 DeviceMinor:420 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-456 DeviceMajor:0 DeviceMinor:456 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-279 DeviceMajor:0 DeviceMinor:279 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5435f585-4325-42b2-8992-988af472d105/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:205 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dc3025c2-fdcb-4557-b5af-0433a3f89fef/volumes/kubernetes.io~secret/samples-operator-tls DeviceMajor:0 DeviceMinor:369 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:220 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab36405-af90-4b38-9ede-4ffad5c1ad8f/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:235 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ba210879-af81-4f17-9948-16a94100f39b/volumes/kubernetes.io~projected/kube-api-access-zxsps DeviceMajor:0 DeviceMinor:238 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9a21ec19-27ea-4fd8-bbeb-154ef1063833/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:50 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8be675cfc5c7976e27448961b34650ed3996396c1e42c29a5c6e3caad6330760/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e64633a6-4199-4a1e-ac6e-b610f6a9f034/volumes/kubernetes.io~projected/kube-api-access-92wnq DeviceMajor:0 DeviceMinor:336 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/aece3088-8729-43a1-8533-7bdd145d2fdd/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls DeviceMajor:0 DeviceMinor:217 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d688c2c342d0e1635c2bd69b7d21827e28fa561b82f0c3e123c45713cd7927c9/userdata/shm DeviceMajor:0 DeviceMinor:77 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2e4e9c2c-7e7b-45d1-8e50-d850011dea19/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5ab36405-af90-4b38-9ede-4ffad5c1ad8f/volumes/kubernetes.io~projected/kube-api-access-6xvrt DeviceMajor:0 DeviceMinor:239 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/208ed61f954784b970a31efd3c31258026f2988ae25b24009fc6fc49a0c04890/userdata/shm DeviceMajor:0 DeviceMinor:334 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/50a80cb8c071698aaf3f06639e7ce835aa743946b02b5749b247b5b72a408fcf/userdata/shm DeviceMajor:0 DeviceMinor:375 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-293 DeviceMajor:0 DeviceMinor:293 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-396 DeviceMajor:0 DeviceMinor:396 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-450 DeviceMajor:0 DeviceMinor:450 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-251 DeviceMajor:0 DeviceMinor:251 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/db65703a2d35615b65e2666f80d107fd5e0f2ac4803c527f5525dacc37a6c288/userdata/shm DeviceMajor:0 DeviceMinor:394 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:208ed61f954784b MacAddress:ee:aa:fa:a3:0d:66 Speed:10000 Mtu:8901} {Name:392ef34ae96c788 MacAddress:06:bf:f6:30:e5:03 Speed:10000 Mtu:8901} {Name:3c79da8c2694dcb MacAddress:e2:2e:0e:0c:ce:a4 Speed:10000 Mtu:8901} {Name:3dfc0c86dd8b7ff MacAddress:b6:1d:86:1b:c5:1c Speed:10000 Mtu:8901} {Name:42296015d7c9d4f MacAddress:06:58:67:09:58:7a Speed:10000 Mtu:8901} {Name:50a80cb8c071698 MacAddress:42:af:fa:35:d7:fc Speed:10000 Mtu:8901} {Name:68a62d211c05530 MacAddress:f6:6b:0d:7b:0c:12 Speed:10000 Mtu:8901} {Name:70d7fcbc726be44 MacAddress:46:eb:d9:5d:91:ac Speed:10000 Mtu:8901} {Name:736c48084a78ef5 MacAddress:aa:64:e6:28:dd:23 Speed:10000 Mtu:8901} {Name:80c802d79b71745 MacAddress:1e:e4:b0:a9:20:16 Speed:10000 Mtu:8901} {Name:8a21bbb332496e1 MacAddress:a6:9a:d3:bc:c6:01 Speed:10000 Mtu:8901} {Name:9053cdd424a54a3 MacAddress:ea:23:77:bb:06:32 Speed:10000 Mtu:8901} {Name:a30ef3e27e679c1 MacAddress:aa:23:71:6f:24:21 Speed:10000 Mtu:8901} {Name:a4e7f05fa0e72d5 MacAddress:32:19:f0:d4:a0:c3 Speed:10000 Mtu:8901} {Name:bc2af2ccbc4ba7e MacAddress:42:bd:8e:42:57:4f Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:ca:3c:0d:cf Speed:0 Mtu:9001} {Name:br-int MacAddress:32:ec:38:60:6c:ef Speed:0 Mtu:8901} {Name:c4e591d4062df69 MacAddress:b6:62:a9:62:fd:6f Speed:10000 Mtu:8901} {Name:d9e569328a4b5f2 MacAddress:06:82:a6:73:16:5b Speed:10000 Mtu:8901} {Name:db65703a2d35615 MacAddress:fa:83:9c:7f:0c:b9 Speed:10000 Mtu:8901} {Name:ef80eef695c6796 MacAddress:5a:39:a0:7e:0b:3d Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:ca:3c:0d:cf Speed:0 Mtu:9001} {Name:f836d7cad3ba927 MacAddress:5a:32:63:66:c1:68 Speed:10000 Mtu:8901} {Name:faa2f0dfd388b04 MacAddress:8a:81:f1:8a:a5:25 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:da:e0:de:6a:17:1d Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:b2:c8:94:f7:b6:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 02:16:28.624107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.623261    5722 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 02:16:28.624107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.623311    5722 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 02:16:28.624107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.623605    5722 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 02:16:28.624107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.623629    5722 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-190.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 02:16:28.624107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.623802    5722 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 02:16:28.624107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.623811    5722 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 02:16:28.624107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.623821    5722 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:16:28.624107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.623836    5722 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:16:28.624107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.623857    5722 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 02:16:28.624107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.624043    5722 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 02:16:28.624773 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.624167    5722 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 02:16:28.624773 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.624206    5722 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 02:16:28.624773 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.624218    5722 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 02:16:28.624773 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.624230    5722 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 02:16:28.624773 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.624239    5722 kubelet.go:405] "Adding apiserver pod source"
Nov 04 02:16:28.624773 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.624247    5722 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 02:16:28.626764 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.626033    5722 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 02:16:28.626764 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.626055    5722 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:16:28.627625 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.626835    5722 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 02:16:28.630073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630050    5722 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 02:16:28.630073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630071    5722 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:16:28.630191 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630180    5722 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 04 02:16:28.630385 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630373    5722 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 02:16:28.630421 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630403    5722 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 02:16:28.630499 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630490    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 02:16:28.630544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630506    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 02:16:28.630544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630512    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 02:16:28.630544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630518    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 02:16:28.630544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630524    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 02:16:28.630544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630529    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 02:16:28.630544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630535    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 02:16:28.630544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630541    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 02:16:28.630774 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630555    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 02:16:28.630774 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630562    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 02:16:28.630774 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630574    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 02:16:28.630774 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630583    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 02:16:28.630774 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630606    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 02:16:28.630774 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.630612    5722 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 02:16:28.634233 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.634206    5722 server.go:1263] "Started kubelet"
Nov 04 02:16:28.634317 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.634291    5722 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 02:16:28.634442 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.634378    5722 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 02:16:28.634530 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.634471    5722 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 02:16:28.634793 ip-10-0-136-190 systemd[1]: Started Kubernetes Kubelet.
Nov 04 02:16:28.634947 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.634895    5722 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 02:16:28.638135 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.638103    5722 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 02:16:28.638253 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.638130    5722 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 02:16:28.638406 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.638294    5722 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:10:17 +0000 UTC" deadline="2028-05-23 20:50:33.419173991 +0000 UTC"
Nov 04 02:16:28.638406 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.638346    5722 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13602h34m4.78083175s"
Nov 04 02:16:28.638573 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.638527    5722 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 02:16:28.638573 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.638564    5722 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 02:16:28.638822 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.638809    5722 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 02:16:28.641472 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:28.638889    5722 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-190.us-west-2.compute.internal\" not found"
Nov 04 02:16:28.641472 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.640742    5722 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 02:16:28.642826 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.642800    5722 factory.go:55] Registering systemd factory
Nov 04 02:16:28.642826 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.642826    5722 factory.go:223] Registration of the systemd container factory successfully
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.643420    5722 factory.go:153] Registering CRI-O factory
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.643441    5722 factory.go:223] Registration of the crio container factory successfully
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.643518    5722 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.643550    5722 factory.go:103] Registering Raw factory
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.643566    5722 manager.go:1199] Started watching for new ooms in manager
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.643971    5722 manager.go:319] Starting recovery of all containers
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644533    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab36405-af90-4b38-9ede-4ffad5c1ad8f" volumeName="kubernetes.io/projected/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-kube-api-access-6xvrt" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644586    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a21ec19-27ea-4fd8-bbeb-154ef1063833" volumeName="kubernetes.io/projected/9a21ec19-27ea-4fd8-bbeb-154ef1063833-kube-api-access-q82m4" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644600    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159902bd-5489-46b3-8368-55551a6b9b68" volumeName="kubernetes.io/projected/159902bd-5489-46b3-8368-55551a6b9b68-kube-api-access-sfm6n" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644616    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5435f585-4325-42b2-8992-988af472d105" volumeName="kubernetes.io/projected/5435f585-4325-42b2-8992-988af472d105-kube-api-access-2w48f" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644635    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5d0efd2-3946-4144-8971-b4867230e8ec" volumeName="kubernetes.io/projected/a5d0efd2-3946-4144-8971-b4867230e8ec-kube-api-access-rcwlx" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644649    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8b9b855-1e9b-47f9-b775-304910b95667" volumeName="kubernetes.io/projected/d8b9b855-1e9b-47f9-b775-304910b95667-kube-api-access-htvgh" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644700    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcca8570-7261-499b-938a-10097ca652b0" volumeName="kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644713    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0514b3f-cb7b-475a-9338-8a9ae26f8fb9" volumeName="kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644729    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e64633a6-4199-4a1e-ac6e-b610f6a9f034" volumeName="kubernetes.io/projected/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-api-access-92wnq" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644746    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e8f75c8e-a241-4641-814e-f233535d9b7e" volumeName="kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644763    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4f3aa40-09ba-47db-b65b-ed4db9045c1f" volumeName="kubernetes.io/configmap/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-config" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644781    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4f3aa40-09ba-47db-b65b-ed4db9045c1f" volumeName="kubernetes.io/secret/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-serving-cert" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644794    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be37687a-5d12-4543-83eb-61961531f81f" volumeName="kubernetes.io/projected/be37687a-5d12-4543-83eb-61961531f81f-kube-api-access-pb95c" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644812    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e64633a6-4199-4a1e-ac6e-b610f6a9f034" volumeName="kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644838    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159902bd-5489-46b3-8368-55551a6b9b68" volumeName="kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-tmp" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644857    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10" volumeName="kubernetes.io/secret/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-agent-certs" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644876    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dc3025c2-fdcb-4557-b5af-0433a3f89fef" volumeName="kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644892    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e96b7798-598c-4934-a2a1-40cb966e98c4" volumeName="kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-installation-pull-secrets" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644910    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e4e9c2c-7e7b-45d1-8e50-d850011dea19" volumeName="kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-stats-auth" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644926    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40222b3d-3cdb-4da6-8bfa-3764919a09a4" volumeName="kubernetes.io/projected/40222b3d-3cdb-4da6-8bfa-3764919a09a4-kube-api-access-zvxlk" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644948    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82713f3a-e89e-4116-8160-03fbc4122635" volumeName="kubernetes.io/projected/82713f3a-e89e-4116-8160-03fbc4122635-kube-api-access-l4xd5" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644965    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ba210879-af81-4f17-9948-16a94100f39b" volumeName="kubernetes.io/projected/ba210879-af81-4f17-9948-16a94100f39b-kube-api-access-zxsps" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.644981    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="122326d1-cd64-4662-8234-9ce0718e5c32" volumeName="kubernetes.io/projected/122326d1-cd64-4662-8234-9ce0718e5c32-kube-api-access-lt847" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645001    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69dc840b-bd18-41ad-a213-f0d2c1252fca" volumeName="kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-trusted-ca" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645019    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab58cc26-ed1e-4d73-b63a-9ca5b327d18a" volumeName="kubernetes.io/projected/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-kube-api-access-pcgwg" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645039    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e96b7798-598c-4934-a2a1-40cb966e98c4" volumeName="kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-certificates" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645060    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e96b7798-598c-4934-a2a1-40cb966e98c4" volumeName="kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-image-registry-private-configuration" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645075    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="122326d1-cd64-4662-8234-9ce0718e5c32" volumeName="kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645102    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="482a1092-091d-415e-bbbf-c2e41a770ba0" volumeName="kubernetes.io/projected/482a1092-091d-415e-bbbf-c2e41a770ba0-kube-api-access-k8vtj" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645122    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a21ec19-27ea-4fd8-bbeb-154ef1063833" volumeName="kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-config" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645136    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a21ec19-27ea-4fd8-bbeb-154ef1063833" volumeName="kubernetes.io/secret/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645149    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8b9b855-1e9b-47f9-b775-304910b95667" volumeName="kubernetes.io/empty-dir/d8b9b855-1e9b-47f9-b775-304910b95667-tmp-dir" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645168    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0514b3f-cb7b-475a-9338-8a9ae26f8fb9" volumeName="kubernetes.io/configmap/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-nginx-conf" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645184    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e64633a6-4199-4a1e-ac6e-b610f6a9f034" volumeName="kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645204    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e96b7798-598c-4934-a2a1-40cb966e98c4" volumeName="kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-kube-api-access-vpxxh" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645220    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab58cc26-ed1e-4d73-b63a-9ca5b327d18a" volumeName="kubernetes.io/empty-dir/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-tmp-dir" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645235    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab58cc26-ed1e-4d73-b63a-9ca5b327d18a" volumeName="kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645253    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aece3088-8729-43a1-8533-7bdd145d2fdd" volumeName="kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645268    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e64633a6-4199-4a1e-ac6e-b610f6a9f034" volumeName="kubernetes.io/empty-dir/e64633a6-4199-4a1e-ac6e-b610f6a9f034-data-volume" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645287    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e96b7798-598c-4934-a2a1-40cb966e98c4" volumeName="kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645301    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="159902bd-5489-46b3-8368-55551a6b9b68" volumeName="kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-etc-tuned" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645315    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="735db15d-9069-4b87-ab87-7ed88d365bdb" volumeName="kubernetes.io/projected/735db15d-9069-4b87-ab87-7ed88d365bdb-kube-api-access-bxbr9" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645338    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4f3aa40-09ba-47db-b65b-ed4db9045c1f" volumeName="kubernetes.io/projected/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-kube-api-access-c4gp6" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645351    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c80a9883-2db8-4389-aba0-813ecf38be30" volumeName="kubernetes.io/projected/c80a9883-2db8-4389-aba0-813ecf38be30-kube-api-access-zdmnh" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645368    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e96b7798-598c-4934-a2a1-40cb966e98c4" volumeName="kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-bound-sa-token" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645381    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="482a1092-091d-415e-bbbf-c2e41a770ba0" volumeName="kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-cni-binary-copy" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645401    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5435f585-4325-42b2-8992-988af472d105" volumeName="kubernetes.io/secret/5435f585-4325-42b2-8992-988af472d105-serving-cert" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645414    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e96b7798-598c-4934-a2a1-40cb966e98c4" volumeName="kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-trusted-ca" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.645428    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e96b7798-598c-4934-a2a1-40cb966e98c4" volumeName="kubernetes.io/empty-dir/e96b7798-598c-4934-a2a1-40cb966e98c4-ca-trust-extracted" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646003    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="122326d1-cd64-4662-8234-9ce0718e5c32" volumeName="kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-binary-copy" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646026    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e4e9c2c-7e7b-45d1-8e50-d850011dea19" volumeName="kubernetes.io/projected/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-kube-api-access-42s9q" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646048    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e4e9c2c-7e7b-45d1-8e50-d850011dea19" volumeName="kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646065    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d9a67bf-5458-4857-acd0-473c00297677" volumeName="kubernetes.io/configmap/3d9a67bf-5458-4857-acd0-473c00297677-serviceca" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646080    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5435f585-4325-42b2-8992-988af472d105" volumeName="kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-service-ca-bundle" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646099    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5435f585-4325-42b2-8992-988af472d105" volumeName="kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-snapshots" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646115    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dac01f36-2182-40fb-9599-dbbac45a4b76" volumeName="kubernetes.io/projected/dac01f36-2182-40fb-9599-dbbac45a4b76-kube-api-access-krnh6" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646156    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dc3025c2-fdcb-4557-b5af-0433a3f89fef" volumeName="kubernetes.io/configmap/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-config" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646171    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36162c63-49e7-4782-8ea9-55db430a4c73" volumeName="kubernetes.io/projected/36162c63-49e7-4782-8ea9-55db430a4c73-kube-api-access-bgk46" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646184    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40222b3d-3cdb-4da6-8bfa-3764919a09a4" volumeName="kubernetes.io/configmap/40222b3d-3cdb-4da6-8bfa-3764919a09a4-config" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646204    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69dc840b-bd18-41ad-a213-f0d2c1252fca" volumeName="kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-config" seLinuxMountContext=""
Nov 04 02:16:28.646251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646217    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69dc840b-bd18-41ad-a213-f0d2c1252fca" volumeName="kubernetes.io/projected/69dc840b-bd18-41ad-a213-f0d2c1252fca-kube-api-access-czjth" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.646239    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a21ec19-27ea-4fd8-bbeb-154ef1063833" volumeName="kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-env-overrides" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647094    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10" volumeName="kubernetes.io/configmap/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-konnectivity-ca" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647132    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5435f585-4325-42b2-8992-988af472d105" volumeName="kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647157    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5435f585-4325-42b2-8992-988af472d105" volumeName="kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-tmp" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647172    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69dc840b-bd18-41ad-a213-f0d2c1252fca" volumeName="kubernetes.io/secret/69dc840b-bd18-41ad-a213-f0d2c1252fca-serving-cert" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647197    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dc3025c2-fdcb-4557-b5af-0433a3f89fef" volumeName="kubernetes.io/projected/dc3025c2-fdcb-4557-b5af-0433a3f89fef-kube-api-access-q8hjr" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647213    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e4e9c2c-7e7b-45d1-8e50-d850011dea19" volumeName="kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647227    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ab36405-af90-4b38-9ede-4ffad5c1ad8f" volumeName="kubernetes.io/secret/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-cert" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647245    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aece3088-8729-43a1-8533-7bdd145d2fdd" volumeName="kubernetes.io/configmap/aece3088-8729-43a1-8533-7bdd145d2fdd-telemetry-config" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647259    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aece3088-8729-43a1-8533-7bdd145d2fdd" volumeName="kubernetes.io/projected/aece3088-8729-43a1-8533-7bdd145d2fdd-kube-api-access-vsdwr" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647278    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1486093b-695f-4ba3-8737-385bfe779147" volumeName="kubernetes.io/projected/1486093b-695f-4ba3-8737-385bfe779147-kube-api-access-sgs6g" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647291    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82713f3a-e89e-4116-8160-03fbc4122635" volumeName="kubernetes.io/configmap/82713f3a-e89e-4116-8160-03fbc4122635-iptables-alerter-script" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.647306    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a21ec19-27ea-4fd8-bbeb-154ef1063833" volumeName="kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-script-lib" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.648503    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ab58cc26-ed1e-4d73-b63a-9ca5b327d18a" volumeName="kubernetes.io/configmap/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-config-volume" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.648523    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="122326d1-cd64-4662-8234-9ce0718e5c32" volumeName="kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.648553    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e4e9c2c-7e7b-45d1-8e50-d850011dea19" volumeName="kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-default-certificate" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.648571    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="36162c63-49e7-4782-8ea9-55db430a4c73" volumeName="kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.648585    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d9a67bf-5458-4857-acd0-473c00297677" volumeName="kubernetes.io/projected/3d9a67bf-5458-4857-acd0-473c00297677-kube-api-access-5s5jr" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.648598    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40222b3d-3cdb-4da6-8bfa-3764919a09a4" volumeName="kubernetes.io/secret/40222b3d-3cdb-4da6-8bfa-3764919a09a4-serving-cert" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.648609    5722 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="482a1092-091d-415e-bbbf-c2e41a770ba0" volumeName="kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-daemon-config" seLinuxMountContext=""
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.648621    5722 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 02:16:28.649106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.648630    5722 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 02:16:28.664569 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.664519    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:16:28.665459 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.665435    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:16:28.670967 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.670802    5722 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 02:16:28.671148 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.671128    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:16:28.672337 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.672317    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:16:28.672588 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.672569    5722 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 02:16:28.672588 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.672592    5722 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 02:16:28.672819 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.672613    5722 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 02:16:28.672819 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:28.672649    5722 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 04 02:16:28.685400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.685214    5722 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="2073d18bb6600f922a6fba879dd586d313121afd04ee38fe460518b3444031c4" exitCode=0
Nov 04 02:16:28.685400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.685250    5722 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="5bd0253d82bb2c7990a144f5d34b50c8900961e1b0e03f7f81ef3f06320d906e" exitCode=0
Nov 04 02:16:28.685400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.685264    5722 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="8c792fa516fccc568161d35bb57d80b6a38dbd6c355b8ed0bbabf14f3becff60" exitCode=0
Nov 04 02:16:28.685400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.685274    5722 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="110c8ee12620ba9afa52804c71d7828a1619825fab9a7cb6d5984b828dc1c53a" exitCode=0
Nov 04 02:16:28.685400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.685283    5722 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="59c785b6f338c33face59566a6b64b41f57febc9807ab05ab3ca84c784e8333d" exitCode=0
Nov 04 02:16:28.685400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.685293    5722 generic.go:356] "Generic (PLEG): container finished" podID="122326d1-cd64-4662-8234-9ce0718e5c32" containerID="876060ab2c3937657f92be55806e03090a468122c4ec2d6dc2fbae5e7f687ff3" exitCode=0
Nov 04 02:16:28.707930 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.707901    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:16:28.708119 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.707938    5722 generic.go:356] "Generic (PLEG): container finished" podID="69dc840b-bd18-41ad-a213-f0d2c1252fca" containerID="13ba0fe808be3ff5a62c2adef6ef7e7808dddb1dfa39617e18e053a05623032b" exitCode=255
Nov 04 02:16:28.714342 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.714309    5722 generic.go:356] "Generic (PLEG): container finished" podID="25537345b15c5579bee86c1fcfc147e8" containerID="116e825a71af679267a68e8429842ed134c2f755e66467e02d192ac5569984f6" exitCode=0
Nov 04 02:16:28.739243 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:28.739148    5722 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-190.us-west-2.compute.internal\" not found"
Nov 04 02:16:28.749911 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.749882    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:16:28.750294 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.750267    5722 generic.go:356] "Generic (PLEG): container finished" podID="9a21ec19-27ea-4fd8-bbeb-154ef1063833" containerID="d1df727e6e503aa527389e3be87515c699885ec26f62950052ea2afcf50c501d" exitCode=1
Nov 04 02:16:28.764624 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.764600    5722 manager.go:324] Recovery completed
Nov 04 02:16:28.772739 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:28.772712    5722 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 04 02:16:28.785268 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.785246    5722 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:28.787435 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.787416    5722 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:28.787556 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.787451    5722 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:28.787556 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.787463    5722 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:28.790037 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790017    5722 cpu_manager.go:226] "Starting" policy="none"
Nov 04 02:16:28.790037 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790034    5722 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 02:16:28.790037 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790038    5722 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:28.790222 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790060    5722 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 02:16:28.790268 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790224    5722 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 04 02:16:28.790268 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790252    5722 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 04 02:16:28.790325 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790272    5722 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 04 02:16:28.790325 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790278    5722 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 04 02:16:28.790325 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790283    5722 policy_none.go:50] "Start"
Nov 04 02:16:28.790325 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790310    5722 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 02:16:28.790325 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790321    5722 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 02:16:28.790483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790460    5722 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 04 02:16:28.790483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790470    5722 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 04 02:16:28.790483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.790476    5722 policy_none.go:44] "Start"
Nov 04 02:16:28.791089 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.791071    5722 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:28.791188 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.791108    5722 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:28.791188 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.791123    5722 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:28.795739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.795710    5722 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 02:16:28.798508 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.798494    5722 manager.go:341] "Starting Device Plugin manager"
Nov 04 02:16:28.798571 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:28.798523    5722 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 02:16:28.798571 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.798533    5722 server.go:87] "Starting device plugin registration server"
Nov 04 02:16:28.799020 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.799006    5722 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 02:16:28.799072 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.799024    5722 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 02:16:28.799151 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.799117    5722 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 02:16:28.800617 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.799253    5722 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 02:16:28.800617 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.799295    5722 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 02:16:28.800617 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.799302    5722 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 02:16:28.800617 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.799360    5722 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T02:16:28.799284125Z","UUID":"aca64301-56d1-49a6-9822-8a7541189eb4","Handler":null,"Name":"","Endpoint":""}
Nov 04 02:16:28.802161 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:28.802055    5722 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 02:16:28.802269 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:28.802206    5722 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-190.us-west-2.compute.internal\" not found"
Nov 04 02:16:28.802434 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.802414    5722 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 02:16:28.802547 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.802488    5722 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 02:16:28.846023 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.845981    5722 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:28.846023 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.845989    5722 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:28.888110 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.888079    5722 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 04 02:16:28.896275 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.896242    5722 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:28.900136 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.900116    5722 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:28.901293 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.901273    5722 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:28.901367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.901306    5722 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:28.901367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.901316    5722 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-190.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:28.901453 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.901381    5722 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:28.939562 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.939537    5722 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:28.973640 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.973571    5722 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"]
Nov 04 02:16:28.974261 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.974226    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal" event={"ID":"c60ccd19b86040261adde19f6117c493","Type":"ContainerStarted","Data":"279288ab9b24fed8bd85ff10c4aacdb2570a9fa13c843fbecaed6215a5313d93"}
Nov 04 02:16:28.974304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.974268    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal" event={"ID":"c60ccd19b86040261adde19f6117c493","Type":"ContainerStarted","Data":"8be675cfc5c7976e27448961b34650ed3996396c1e42c29a5c6e3caad6330760"}
Nov 04 02:16:28.974304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.974293    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal" event={"ID":"25537345b15c5579bee86c1fcfc147e8","Type":"ContainerStarted","Data":"f75ef79f8da9a540f33262d3e04d0de155f6b8881f081197cc710dfdc3fc93b6"}
Nov 04 02:16:28.974417 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.974305    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal" event={"ID":"25537345b15c5579bee86c1fcfc147e8","Type":"ContainerDied","Data":"116e825a71af679267a68e8429842ed134c2f755e66467e02d192ac5569984f6"}
Nov 04 02:16:28.974417 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.974317    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal" event={"ID":"25537345b15c5579bee86c1fcfc147e8","Type":"ContainerStarted","Data":"3122977277aef15f40acbc1029ef457e89697ed1a4221e12227dc7f4b6247903"}
Nov 04 02:16:28.974417 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.974321    5722 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:28.974507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:28.974448    5722 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.041161 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.041079    5722 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:16:29.041161 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:29.041134    5722 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.041983 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.041967    5722 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:16:29.042028 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:29.042008    5722 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.051515 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.051489    5722 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.051651 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.051569    5722 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.089736 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.089701    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.089736 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.089739    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.089940 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.089767    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c60ccd19b86040261adde19f6117c493-config\") pod \"kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"c60ccd19b86040261adde19f6117c493\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.189956 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.189902    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.190158 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.189964    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.190158 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.189991    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c60ccd19b86040261adde19f6117c493-config\") pod \"kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"c60ccd19b86040261adde19f6117c493\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.190158 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.190039    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c60ccd19b86040261adde19f6117c493-config\") pod \"kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"c60ccd19b86040261adde19f6117c493\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.190158 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.190043    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.190158 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.190045    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25537345b15c5579bee86c1fcfc147e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" (UID: \"25537345b15c5579bee86c1fcfc147e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.626053 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.626012    5722 apiserver.go:52] "Watching apiserver"
Nov 04 02:16:29.733942 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.733903    5722 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 02:16:29.734687 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.734629    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b6zs7","openshift-multus/multus-additional-cni-plugins-v6s7g","openshift-multus/network-metrics-daemon-xshqm","openshift-dns/node-resolver-2bcnd","openshift-network-operator/iptables-alerter-lwtfq","openshift-network-diagnostics/network-check-target-7bvrs","openshift-ingress/router-default-6b8f6d865c-c8tlq","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj","kube-system/kas-connection-checker-685895c7c9-6dk89","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln","openshift-multus/multus-8rx5r","kube-system/kas-connection-checker-685895c7c9-bxplw","openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6","openshift-image-registry/node-ca-dtg7p","kube-system/konnectivity-agent-6npmv","openshift-network-console/networking-console-plugin-86c478bb88-8ztwg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx","openshift-ingress-canary/ingress-canary-clnj4","openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb","openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn","openshift-insights/insights-operator-7c4986d449-ts54b","openshift-image-registry/image-registry-6bcfd7b985-mn847","openshift-insights/insights-runtime-extractor-v29px","kube-system/kas-connection-checker-685895c7c9-4sqvd","openshift-cluster-node-tuning-operator/tuned-jv78s","openshift-console-operator/console-operator-7cd56b8dbc-sxrh5","openshift-ovn-kubernetes/ovnkube-node-dgm27","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal","openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq","kube-system/global-pull-secret-syncer-jzwmx","kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"]
Nov 04 02:16:29.754223 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.754195    5722 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.754402 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.754317    5722 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.791780 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.791740    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Nov 04 02:16:29.791980 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.791814    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Nov 04 02:16:29.791980 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.791899    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Nov 04 02:16:29.791980 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.791901    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Nov 04 02:16:29.792220 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792202    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-serving-cert\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:16:29.792273 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792228    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-config\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:16:29.792273 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792246    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40222b3d-3cdb-4da6-8bfa-3764919a09a4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:16:29.792273 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792265    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsdwr\" (UniqueName: \"kubernetes.io/projected/aece3088-8729-43a1-8533-7bdd145d2fdd-kube-api-access-vsdwr\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:16:29.792435 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792294    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb95c\" (UniqueName: \"kubernetes.io/projected/be37687a-5d12-4543-83eb-61961531f81f-kube-api-access-pb95c\") pod \"kas-connection-checker-685895c7c9-bxplw\" (UID: \"be37687a-5d12-4543-83eb-61961531f81f\") " pod="kube-system/kas-connection-checker-685895c7c9-bxplw"
Nov 04 02:16:29.792435 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792413    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Nov 04 02:16:29.792528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792426    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4gp6\" (UniqueName: \"kubernetes.io/projected/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-kube-api-access-c4gp6\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:16:29.792528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792483    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-stats-auth\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:29.792528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792509    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:29.792747 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792543    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5435f585-4325-42b2-8992-988af472d105-serving-cert\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.792747 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792571    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aece3088-8729-43a1-8533-7bdd145d2fdd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:16:29.792747 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792600    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:16:29.792747 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792641    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:16:29.792747 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792684    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-snapshots\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.792747 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792710    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-service-ca-bundle\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.792747 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792739    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.793071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792739    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvxlk\" (UniqueName: \"kubernetes.io/projected/40222b3d-3cdb-4da6-8bfa-3764919a09a4-kube-api-access-zvxlk\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:16:29.793071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792801    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.793071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792817    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxbr9\" (UniqueName: \"kubernetes.io/projected/735db15d-9069-4b87-ab87-7ed88d365bdb-kube-api-access-bxbr9\") pod \"kas-connection-checker-685895c7c9-6dk89\" (UID: \"735db15d-9069-4b87-ab87-7ed88d365bdb\") " pod="kube-system/kas-connection-checker-685895c7c9-6dk89"
Nov 04 02:16:29.793071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792848    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdmnh\" (UniqueName: \"kubernetes.io/projected/c80a9883-2db8-4389-aba0-813ecf38be30-kube-api-access-zdmnh\") pod \"volume-data-source-validator-58c9f5f46d-clp78\" (UID: \"c80a9883-2db8-4389-aba0-813ecf38be30\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78"
Nov 04 02:16:29.793071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792886    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-default-certificate\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:29.793071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792909    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-metrics-certs\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:29.793071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793024    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-snapshots\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.793071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792912    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8hjr\" (UniqueName: \"kubernetes.io/projected/dc3025c2-fdcb-4557-b5af-0433a3f89fef-kube-api-access-q8hjr\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793087    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-trusted-ca\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793124    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793140    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793153    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69dc840b-bd18-41ad-a213-f0d2c1252fca-serving-cert\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793178    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjth\" (UniqueName: \"kubernetes.io/projected/69dc840b-bd18-41ad-a213-f0d2c1252fca-kube-api-access-czjth\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793205    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxsps\" (UniqueName: \"kubernetes.io/projected/ba210879-af81-4f17-9948-16a94100f39b-kube-api-access-zxsps\") pod \"network-check-source-6f78d59f99-hl8hq\" (UID: \"ba210879-af81-4f17-9948-16a94100f39b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793193    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-default-certificate\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793238    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40222b3d-3cdb-4da6-8bfa-3764919a09a4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793284    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-tmp\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793317    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w48f\" (UniqueName: \"kubernetes.io/projected/5435f585-4325-42b2-8992-988af472d105-kube-api-access-2w48f\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793350    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793378    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42s9q\" (UniqueName: \"kubernetes.io/projected/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-kube-api-access-42s9q\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:29.793427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793379    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5435f585-4325-42b2-8992-988af472d105-tmp\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.792851    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-stats-auth\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793476    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgs6g\" (UniqueName: \"kubernetes.io/projected/1486093b-695f-4ba3-8737-385bfe779147-kube-api-access-sgs6g\") pod \"kas-connection-checker-685895c7c9-4sqvd\" (UID: \"1486093b-695f-4ba3-8737-385bfe779147\") " pod="kube-system/kas-connection-checker-685895c7c9-4sqvd"
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793450    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793509    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-config\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793540    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793561    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793567    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793733    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793810    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793820    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793841    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793840    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-serving-cert\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:16:29.794005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.793893    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Nov 04 02:16:29.794552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794025    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.794552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794031    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.794552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794067    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.794552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794199    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.794552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794261    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.794552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794319    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.794552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794332    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.794552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794388    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.794552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794407    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.794930 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794582    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.794930 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794712    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.794930 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794752    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Nov 04 02:16:29.794930 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.794868    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Nov 04 02:16:29.795061 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.795000    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.795278 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.795259    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Nov 04 02:16:29.795680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.795667    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.795752 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.795700    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Nov 04 02:16:29.795752 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.795731    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Nov 04 02:16:29.795843 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.795813    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.795921 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.795889    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.795921 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.795914    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Nov 04 02:16:29.796321 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.796307    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Nov 04 02:16:29.803045 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.803011    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-config\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:16:29.803211 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.803011    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40222b3d-3cdb-4da6-8bfa-3764919a09a4-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:16:29.803211 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.803113    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc3025c2-fdcb-4557-b5af-0433a3f89fef-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:16:29.803329 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.803254    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aece3088-8729-43a1-8533-7bdd145d2fdd-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:16:29.803416 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.803397    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-service-ca-bundle\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.803502 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.803400    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-service-ca-bundle\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:29.803502 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.803427    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69dc840b-bd18-41ad-a213-f0d2c1252fca-serving-cert\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:29.803502 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.803489    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5435f585-4325-42b2-8992-988af472d105-serving-cert\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.803705 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.803649    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40222b3d-3cdb-4da6-8bfa-3764919a09a4-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:16:29.803765 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.803712    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aece3088-8729-43a1-8533-7bdd145d2fdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:16:29.803815 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.803800    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-config\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:29.840138 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.840100    5722 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 02:16:29.848579 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.848545    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 02:16:29.849185 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.849151    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 02:16:29.849185 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.849188    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.849376 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.849293    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.849424 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.849383    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 02:16:29.849497 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.849477    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 02:16:29.850208 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850182    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m589d\""
Nov 04 02:16:29.850319 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.849165    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 02:16:29.850319 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850306    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 04 02:16:29.850441 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850356    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.850441 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850414    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.850441 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850428    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 02:16:29.850589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850446    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.850589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850473    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.850589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850483    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 04 02:16:29.850589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850507    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6q9ld\""
Nov 04 02:16:29.850589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850518    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Nov 04 02:16:29.850589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850546    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 02:16:29.850589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850552    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 04 02:16:29.850589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850581    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.850923 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850593    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.850923 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850572    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.851015 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850597    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 02:16:29.851064 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851029    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 02:16:29.851064 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851046    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2f9b\""
Nov 04 02:16:29.851150 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.850360    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 02:16:29.851150 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851135    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 02:16:29.851239 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851164    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 02:16:29.851239 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851183    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 02:16:29.851239 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851192    5722 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:16:29.851239 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851183    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wpmk6\""
Nov 04 02:16:29.851239 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851218    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851241    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-q8p76\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851264    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851303    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851314    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851346    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851359    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zrn9f\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851366    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zjj5c\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851372    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851402    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851406    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851291    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rhnhd\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851370    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k925t\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851440    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851409    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851461    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.851477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851466    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b2fnf\""
Nov 04 02:16:29.852125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851499    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 02:16:29.852125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851528    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-nw2cx\""
Nov 04 02:16:29.852125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851556    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-px2wd\""
Nov 04 02:16:29.852125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851583    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 02:16:29.852125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851587    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n2j4c\""
Nov 04 02:16:29.852125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851593    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 02:16:29.852125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851691    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 02:16:29.852125 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:29.851708    5722 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.852125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851768    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gsgrb\""
Nov 04 02:16:29.852125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851930    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-275xk\""
Nov 04 02:16:29.852125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.851952    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pszzf\""
Nov 04 02:16:29.852555 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.852161    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 04 02:16:29.852555 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.852241    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-n8x9d\""
Nov 04 02:16:29.852555 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.852321    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 04 02:16:29.852555 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.852384    5722 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:16:29.852555 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.852414    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Nov 04 02:16:29.852555 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.852423    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 02:16:29.852555 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:29.852436    5722 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-190.us-west-2.compute.internal"
Nov 04 02:16:29.852555 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.852463    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-v7b9k\""
Nov 04 02:16:29.854432 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.854411    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69dc840b-bd18-41ad-a213-f0d2c1252fca-trusted-ca\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:29.854484 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.854470    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5435f585-4325-42b2-8992-988af472d105-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.858826 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.858807    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb95c\" (UniqueName: \"kubernetes.io/projected/be37687a-5d12-4543-83eb-61961531f81f-kube-api-access-pb95c\") pod \"kas-connection-checker-685895c7c9-bxplw\" (UID: \"be37687a-5d12-4543-83eb-61961531f81f\") " pod="kube-system/kas-connection-checker-685895c7c9-bxplw"
Nov 04 02:16:29.858893 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.858823    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgs6g\" (UniqueName: \"kubernetes.io/projected/1486093b-695f-4ba3-8737-385bfe779147-kube-api-access-sgs6g\") pod \"kas-connection-checker-685895c7c9-4sqvd\" (UID: \"1486093b-695f-4ba3-8737-385bfe779147\") " pod="kube-system/kas-connection-checker-685895c7c9-4sqvd"
Nov 04 02:16:29.858976 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.858961    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w48f\" (UniqueName: \"kubernetes.io/projected/5435f585-4325-42b2-8992-988af472d105-kube-api-access-2w48f\") pod \"insights-operator-7c4986d449-ts54b\" (UID: \"5435f585-4325-42b2-8992-988af472d105\") " pod="openshift-insights/insights-operator-7c4986d449-ts54b"
Nov 04 02:16:29.864041 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.864011    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxbr9\" (UniqueName: \"kubernetes.io/projected/735db15d-9069-4b87-ab87-7ed88d365bdb-kube-api-access-bxbr9\") pod \"kas-connection-checker-685895c7c9-6dk89\" (UID: \"735db15d-9069-4b87-ab87-7ed88d365bdb\") " pod="kube-system/kas-connection-checker-685895c7c9-6dk89"
Nov 04 02:16:29.864351 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.864324    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvxlk\" (UniqueName: \"kubernetes.io/projected/40222b3d-3cdb-4da6-8bfa-3764919a09a4-kube-api-access-zvxlk\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-p8dln\" (UID: \"40222b3d-3cdb-4da6-8bfa-3764919a09a4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln"
Nov 04 02:16:29.864448 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.864376    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdmnh\" (UniqueName: \"kubernetes.io/projected/c80a9883-2db8-4389-aba0-813ecf38be30-kube-api-access-zdmnh\") pod \"volume-data-source-validator-58c9f5f46d-clp78\" (UID: \"c80a9883-2db8-4389-aba0-813ecf38be30\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-clp78"
Nov 04 02:16:29.864448 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.864385    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4gp6\" (UniqueName: \"kubernetes.io/projected/b4f3aa40-09ba-47db-b65b-ed4db9045c1f-kube-api-access-c4gp6\") pod \"service-ca-operator-544d749c8c-r8br6\" (UID: \"b4f3aa40-09ba-47db-b65b-ed4db9045c1f\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6"
Nov 04 02:16:29.864533 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.864456    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxsps\" (UniqueName: \"kubernetes.io/projected/ba210879-af81-4f17-9948-16a94100f39b-kube-api-access-zxsps\") pod \"network-check-source-6f78d59f99-hl8hq\" (UID: \"ba210879-af81-4f17-9948-16a94100f39b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-hl8hq"
Nov 04 02:16:29.864533 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.864495    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsdwr\" (UniqueName: \"kubernetes.io/projected/aece3088-8729-43a1-8533-7bdd145d2fdd-kube-api-access-vsdwr\") pod \"cluster-monitoring-operator-884576c57-vckzn\" (UID: \"aece3088-8729-43a1-8533-7bdd145d2fdd\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-vckzn"
Nov 04 02:16:29.864593 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.864556    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czjth\" (UniqueName: \"kubernetes.io/projected/69dc840b-bd18-41ad-a213-f0d2c1252fca-kube-api-access-czjth\") pod \"console-operator-7cd56b8dbc-sxrh5\" (UID: \"69dc840b-bd18-41ad-a213-f0d2c1252fca\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:29.864623 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.864609    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8hjr\" (UniqueName: \"kubernetes.io/projected/dc3025c2-fdcb-4557-b5af-0433a3f89fef-kube-api-access-q8hjr\") pod \"cluster-samples-operator-6ddb6c8b94-hx9zj\" (UID: \"dc3025c2-fdcb-4557-b5af-0433a3f89fef\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-hx9zj"
Nov 04 02:16:29.866881 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.866864    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42s9q\" (UniqueName: \"kubernetes.io/projected/2e4e9c2c-7e7b-45d1-8e50-d850011dea19-kube-api-access-42s9q\") pod \"router-default-6b8f6d865c-c8tlq\" (UID: \"2e4e9c2c-7e7b-45d1-8e50-d850011dea19\") " pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:29.894870 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.894781    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.894870 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.894827    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82713f3a-e89e-4116-8160-03fbc4122635-iptables-alerter-script\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:16:29.894870 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.894846    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d9a67bf-5458-4857-acd0-473c00297677-serviceca\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:16:29.895108 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.894900    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-kubernetes\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.895108 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.894928    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-hostroot\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.895108 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.894959    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-daemon-config\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.895108 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.894987    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-conf\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.895108 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895009    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr9bf\" (UniqueName: \"kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf\") pod \"network-check-target-7bvrs\" (UID: \"e8f75c8e-a241-4641-814e-f233535d9b7e\") " pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:16:29.895108 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895031    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:16:29.895108 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895062    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-node-log\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.895333 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895134    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-cni-binary-copy\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.895333 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895183    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-daemon-config\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.895333 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895208    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82713f3a-e89e-4116-8160-03fbc4122635-iptables-alerter-script\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:16:29.895452 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895328    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-var-lib-kubelet\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.895452 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895353    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36162c63-49e7-4782-8ea9-55db430a4c73-metrics-certs\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:16:29.895452 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895363    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-etc-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.895452 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895388    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.895452 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895391    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/482a1092-091d-415e-bbbf-c2e41a770ba0-cni-binary-copy\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.895452 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895431    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.895624 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895487    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-multus\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.895624 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895522    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d9a67bf-5458-4857-acd0-473c00297677-serviceca\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:16:29.895624 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895532    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-image-registry-private-configuration\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.895624 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895565    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-var-lib-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.895779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895642    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b9b855-1e9b-47f9-b775-304910b95667-tmp-dir\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:16:29.895779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895697    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e64633a6-4199-4a1e-ac6e-b610f6a9f034-data-volume\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:29.895779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895720    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:16:29.895779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895727    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8b9b855-1e9b-47f9-b775-304910b95667-tmp-dir\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:16:29.895779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895736    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:29.895779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895759    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.895779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895731    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-image-registry-private-configuration\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895798    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895818    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-config\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895833    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgk46\" (UniqueName: \"kubernetes.io/projected/36162c63-49e7-4782-8ea9-55db430a4c73-kube-api-access-bgk46\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895774    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e64633a6-4199-4a1e-ac6e-b610f6a9f034-data-volume\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895863    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-k8s-cni-cncf-io\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895888    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-installation-pull-secrets\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895919    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895927    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895946    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpxxh\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-kube-api-access-vpxxh\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.895974    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-etc-tuned\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896023    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e64633a6-4199-4a1e-ac6e-b610f6a9f034-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896045    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-config\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896048    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-netns\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896062    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-etc-tuned\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896094    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-bin\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896123    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-netd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896163    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-cnibin\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896165    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-installation-pull-secrets\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896165    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcca8570-7261-499b-938a-10097ca652b0-original-pull-secret\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896187    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8vtj\" (UniqueName: \"kubernetes.io/projected/482a1092-091d-415e-bbbf-c2e41a770ba0-kube-api-access-k8vtj\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896219    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d9a67bf-5458-4857-acd0-473c00297677-host\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896248    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e64633a6-4199-4a1e-ac6e-b610f6a9f034-crio-socket\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896351    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-systemd\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.896392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896399    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-registration-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896437    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-agent-certs\") pod \"konnectivity-agent-6npmv\" (UID: \"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10\") " pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896491    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-socket-dir-parent\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896517    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s5jr\" (UniqueName: \"kubernetes.io/projected/3d9a67bf-5458-4857-acd0-473c00297677-kube-api-access-5s5jr\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896571    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-tmp\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896632    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-config-volume\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896669    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159902bd-5489-46b3-8368-55551a6b9b68-tmp\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896674    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krnh6\" (UniqueName: \"kubernetes.io/projected/dac01f36-2182-40fb-9599-dbbac45a4b76-kube-api-access-krnh6\") pod \"migrator-66df5d496b-qsddb\" (UID: \"dac01f36-2182-40fb-9599-dbbac45a4b76\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896634    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-agent-certs\") pod \"konnectivity-agent-6npmv\" (UID: \"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10\") " pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896699    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-host\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896722    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8b9b855-1e9b-47f9-b775-304910b95667-hosts-file\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896754    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-device-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896778    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-dbus\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896809    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896820    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-config-volume\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896837    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-multus-certs\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896856    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-bound-sa-token\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896913    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xvrt\" (UniqueName: \"kubernetes.io/projected/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-kube-api-access-6xvrt\") pod \"ingress-canary-clnj4\" (UID: \"5ab36405-af90-4b38-9ede-4ffad5c1ad8f\") " pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.896974    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897004    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-system-cni-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897004    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897046    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82713f3a-e89e-4116-8160-03fbc4122635-host-slash\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897066    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-slash\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897092    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovn-node-metrics-cert\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.897201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897128    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897254    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-sys-fs\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897273    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovn-node-metrics-cert\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897290    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-konnectivity-ca\") pod \"konnectivity-agent-6npmv\" (UID: \"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10\") " pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897322    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-netns\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897338    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-bin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897367    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgwg\" (UniqueName: \"kubernetes.io/projected/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-kube-api-access-pcgwg\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897438    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-script-lib\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897459    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-kubelet-config\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897483    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897486    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10-konnectivity-ca\") pod \"konnectivity-agent-6npmv\" (UID: \"4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10\") " pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897499    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt847\" (UniqueName: \"kubernetes.io/projected/122326d1-cd64-4662-8234-9ce0718e5c32-kube-api-access-lt847\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897601    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-conf-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897617    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897645    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897680    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-ovnkube-script-lib\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897722    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-log-socket\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897750    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-env-overrides\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897797    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htvgh\" (UniqueName: \"kubernetes.io/projected/d8b9b855-1e9b-47f9-b775-304910b95667-kube-api-access-htvgh\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897823    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-sys\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.897891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897882    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-lib-modules\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.898425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897971    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a21ec19-27ea-4fd8-bbeb-154ef1063833-env-overrides\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.898425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.897968    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-cert\") pod \"ingress-canary-clnj4\" (UID: \"5ab36405-af90-4b38-9ede-4ffad5c1ad8f\") " pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:16:29.898425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898066    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-etc-kubernetes\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.898425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898094    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-kubelet\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.898425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898121    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-systemd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.898425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898138    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfm6n\" (UniqueName: \"kubernetes.io/projected/159902bd-5489-46b3-8368-55551a6b9b68-kube-api-access-sfm6n\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.898425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898148    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-cert\") pod \"ingress-canary-clnj4\" (UID: \"5ab36405-af90-4b38-9ede-4ffad5c1ad8f\") " pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:16:29.898425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898161    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-ovn\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.898425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898209    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q82m4\" (UniqueName: \"kubernetes.io/projected/9a21ec19-27ea-4fd8-bbeb-154ef1063833-kube-api-access-q82m4\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.898425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898288    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:16:29.898425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898363    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-cnibin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.898899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898495    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-trusted-ca\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.898899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898514    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:16:29.898899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898556    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-tmp-dir\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:29.898899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898606    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:29.898899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898636    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-tmp-dir\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:29.898899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898713    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcwlx\" (UniqueName: \"kubernetes.io/projected/a5d0efd2-3946-4144-8971-b4867230e8ec-kube-api-access-rcwlx\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:29.898899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898777    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:16:29.898899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898783    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:29.898899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898808    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-certificates\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.899193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898912    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysconfig\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.899193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898969    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-trusted-ca\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.899193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.898984    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0514b3f-cb7b-475a-9338-8a9ae26f8fb9-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8ztwg\" (UID: \"e0514b3f-cb7b-475a-9338-8a9ae26f8fb9\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8ztwg"
Nov 04 02:16:29.899193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899027    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-binary-copy\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:29.899193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899054    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-system-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.899193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899117    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-certificates\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.899193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899158    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-kubelet\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.899193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899182    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/122326d1-cd64-4662-8234-9ce0718e5c32-cni-binary-copy\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:29.899193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899183    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e96b7798-598c-4934-a2a1-40cb966e98c4-ca-trust-extracted\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.899560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899222    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e96b7798-598c-4934-a2a1-40cb966e98c4-ca-trust-extracted\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.899560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899249    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-modprobe-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.899560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899278    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:29.899560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899304    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92wnq\" (UniqueName: \"kubernetes.io/projected/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-api-access-92wnq\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:29.899560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899395    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-systemd-units\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:29.899560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899426    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-socket-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:29.899560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899451    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4xd5\" (UniqueName: \"kubernetes.io/projected/82713f3a-e89e-4116-8160-03fbc4122635-kube-api-access-l4xd5\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:16:29.899560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899490    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-run\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.899560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.899522    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-metrics-tls\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:29.955148 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.955099    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:29.955755 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.955735    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr9bf\" (UniqueName: \"kubernetes.io/projected/e8f75c8e-a241-4641-814e-f233535d9b7e-kube-api-access-hr9bf\") pod \"network-check-target-7bvrs\" (UID: \"e8f75c8e-a241-4641-814e-f233535d9b7e\") " pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:16:29.957294 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.957266    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8vtj\" (UniqueName: \"kubernetes.io/projected/482a1092-091d-415e-bbbf-c2e41a770ba0-kube-api-access-k8vtj\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:29.957426 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.957369    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-bound-sa-token\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.957472 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.957440    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krnh6\" (UniqueName: \"kubernetes.io/projected/dac01f36-2182-40fb-9599-dbbac45a4b76-kube-api-access-krnh6\") pod \"migrator-66df5d496b-qsddb\" (UID: \"dac01f36-2182-40fb-9599-dbbac45a4b76\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-qsddb"
Nov 04 02:16:29.957503 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.957465    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s5jr\" (UniqueName: \"kubernetes.io/projected/3d9a67bf-5458-4857-acd0-473c00297677-kube-api-access-5s5jr\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:16:29.957503 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.957491    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcgwg\" (UniqueName: \"kubernetes.io/projected/ab58cc26-ed1e-4d73-b63a-9ca5b327d18a-kube-api-access-pcgwg\") pod \"dns-default-b6zs7\" (UID: \"ab58cc26-ed1e-4d73-b63a-9ca5b327d18a\") " pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:29.957579 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.957492    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xvrt\" (UniqueName: \"kubernetes.io/projected/5ab36405-af90-4b38-9ede-4ffad5c1ad8f-kube-api-access-6xvrt\") pod \"ingress-canary-clnj4\" (UID: \"5ab36405-af90-4b38-9ede-4ffad5c1ad8f\") " pod="openshift-ingress-canary/ingress-canary-clnj4"
Nov 04 02:16:29.958478 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.958456    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgk46\" (UniqueName: \"kubernetes.io/projected/36162c63-49e7-4782-8ea9-55db430a4c73-kube-api-access-bgk46\") pod \"network-metrics-daemon-xshqm\" (UID: \"36162c63-49e7-4782-8ea9-55db430a4c73\") " pod="openshift-multus/network-metrics-daemon-xshqm"
Nov 04 02:16:29.959814 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.959796    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpxxh\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-kube-api-access-vpxxh\") pod \"image-registry-6bcfd7b985-mn847\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") " pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:29.960924 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.960904    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcwlx\" (UniqueName: \"kubernetes.io/projected/a5d0efd2-3946-4144-8971-b4867230e8ec-kube-api-access-rcwlx\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:29.961237 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.961219    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92wnq\" (UniqueName: \"kubernetes.io/projected/e64633a6-4199-4a1e-ac6e-b610f6a9f034-kube-api-access-92wnq\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:29.962026 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.962000    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt847\" (UniqueName: \"kubernetes.io/projected/122326d1-cd64-4662-8234-9ce0718e5c32-kube-api-access-lt847\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:29.962288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.962273    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfm6n\" (UniqueName: \"kubernetes.io/projected/159902bd-5489-46b3-8368-55551a6b9b68-kube-api-access-sfm6n\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:29.962433 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.962416    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htvgh\" (UniqueName: \"kubernetes.io/projected/d8b9b855-1e9b-47f9-b775-304910b95667-kube-api-access-htvgh\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:16:29.962948 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.962924    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4xd5\" (UniqueName: \"kubernetes.io/projected/82713f3a-e89e-4116-8160-03fbc4122635-kube-api-access-l4xd5\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:16:29.963140 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:29.963124    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q82m4\" (UniqueName: \"kubernetes.io/projected/9a21ec19-27ea-4fd8-bbeb-154ef1063833-kube-api-access-q82m4\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.000207 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000166    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysconfig\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000208    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-system-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.000367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000249    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-kubelet\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.000367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000272    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-modprobe-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000301    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-systemd-units\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.000367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000305    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysconfig\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000325    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-socket-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.000367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000347    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-run\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000385    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-kubelet\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000385    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-system-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000419    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-systemd-units\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000432    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-socket-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000452    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000469    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-run\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000442    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-modprobe-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000502    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-kubernetes\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000500    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000523    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-hostroot\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000548    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-conf\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000562    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-kubernetes\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000579    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-node-log\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000592    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-hostroot\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000600    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-var-lib-kubelet\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000638    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-etc-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000672    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-var-lib-kubelet\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000683    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-conf\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000687    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000688    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-node-log\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000714    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000712    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-etc-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000721    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.000779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000741    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-multus\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000803    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-var-lib-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000811    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-cni-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000815    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-multus\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000854    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-var-lib-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000897    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-k8s-cni-cncf-io\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000916    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-netns\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000930    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-bin\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000947    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-netd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000978    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-run-netns\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000985    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-k8s-cni-cncf-io\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000979    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-netd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.000989    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-cnibin\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001005    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-cnibin\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001016    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-cni-bin\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001021    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d9a67bf-5458-4857-acd0-473c00297677-host\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001037    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d9a67bf-5458-4857-acd0-473c00297677-host\") pod \"node-ca-dtg7p\" (UID: \"3d9a67bf-5458-4857-acd0-473c00297677\") " pod="openshift-image-registry/node-ca-dtg7p"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001057    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e64633a6-4199-4a1e-ac6e-b610f6a9f034-crio-socket\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001080    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-systemd\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001112    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e64633a6-4199-4a1e-ac6e-b610f6a9f034-crio-socket\") pod \"insights-runtime-extractor-v29px\" (UID: \"e64633a6-4199-4a1e-ac6e-b610f6a9f034\") " pod="openshift-insights/insights-runtime-extractor-v29px"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001112    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-registration-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001143    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-socket-dir-parent\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001160    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-host\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001161    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-systemd\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001160    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-registration-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001175    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8b9b855-1e9b-47f9-b775-304910b95667-hosts-file\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001193    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-socket-dir-parent\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001202    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-device-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001217    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8b9b855-1e9b-47f9-b775-304910b95667-hosts-file\") pod \"node-resolver-2bcnd\" (UID: \"d8b9b855-1e9b-47f9-b775-304910b95667\") " pod="openshift-dns/node-resolver-2bcnd"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001232    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-dbus\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001248    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-host\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001258    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-multus-certs\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001281    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001283    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-dbus\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001294    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-device-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001297    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-system-cni-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001319    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-system-cni-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001296    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-multus-certs\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001331    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82713f3a-e89e-4116-8160-03fbc4122635-host-slash\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001354    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-slash\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001331    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001372    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001388    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-sys-fs\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001402    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-netns\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001404    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001356    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82713f3a-e89e-4116-8160-03fbc4122635-host-slash\") pod \"iptables-alerter-lwtfq\" (UID: \"82713f3a-e89e-4116-8160-03fbc4122635\") " pod="openshift-network-operator/iptables-alerter-lwtfq"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001409    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-slash\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001428    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-run-netns\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001438    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5d0efd2-3946-4144-8971-b4867230e8ec-sys-fs\") pod \"aws-ebs-csi-driver-node-4bdzx\" (UID: \"a5d0efd2-3946-4144-8971-b4867230e8ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4bdzx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001442    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-bin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001471    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-kubelet-config\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001498    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001519    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-host-var-lib-cni-bin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001524    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-conf-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001545    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcca8570-7261-499b-938a-10097ca652b0-kubelet-config\") pod \"global-pull-secret-syncer-jzwmx\" (UID: \"dcca8570-7261-499b-938a-10097ca652b0\") " pod="kube-system/global-pull-secret-syncer-jzwmx"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001551    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001560    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-multus-conf-dir\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001562    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/122326d1-cd64-4662-8234-9ce0718e5c32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v6s7g\" (UID: \"122326d1-cd64-4662-8234-9ce0718e5c32\") " pod="openshift-multus/multus-additional-cni-plugins-v6s7g"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001578    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001604    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-log-socket\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001630    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-sys\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001639    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-etc-sysctl-d\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001645    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-openvswitch\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001684    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-lib-modules\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001703    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-etc-kubernetes\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001712    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-sys\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001718    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-kubelet\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001738    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-host-kubelet\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001744    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-systemd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001756    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/159902bd-5489-46b3-8368-55551a6b9b68-lib-modules\") pod \"tuned-jv78s\" (UID: \"159902bd-5489-46b3-8368-55551a6b9b68\") " pod="openshift-cluster-node-tuning-operator/tuned-jv78s"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001769    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-etc-kubernetes\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001769    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-ovn\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.001719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001686    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-log-socket\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.003695 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001788    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-systemd\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.003695 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001793    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-cnibin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.003695 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001821    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a21ec19-27ea-4fd8-bbeb-154ef1063833-run-ovn\") pod \"ovnkube-node-dgm27\" (UID: \"9a21ec19-27ea-4fd8-bbeb-154ef1063833\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:30.003695 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.001875    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/482a1092-091d-415e-bbbf-c2e41a770ba0-cnibin\") pod \"multus-8rx5r\" (UID: \"482a1092-091d-415e-bbbf-c2e41a770ba0\") " pod="openshift-multus/multus-8rx5r"
Nov 04 02:16:30.036994 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.036953    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:30.037709 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.037689    5722 scope.go:122] "RemoveContainer" containerID="13ba0fe808be3ff5a62c2adef6ef7e7808dddb1dfa39617e18e053a05623032b"
Nov 04 02:16:30.136069 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.136037    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:30.507706 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.507646    5722 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:30.580948 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.580907    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:30.757185 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.757144    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:30.759763 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.759698    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:16:30.759892 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.759835    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5" event={"ID":"69dc840b-bd18-41ad-a213-f0d2c1252fca","Type":"ContainerStarted","Data":"806f3c87ad888d8b9db7667b345a3b02684f9e603bb8d2dcff33fa9b0a9017a4"}
Nov 04 02:16:30.843573 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:30.843546    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:31.038756 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.038651    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:31.675835 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.675800    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:31.766160 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.766067    5722 generic.go:356] "Generic (PLEG): container finished" podID="5435f585-4325-42b2-8992-988af472d105" containerID="68372c858053362db44207e29274a4f4f9d5af474742d8d1f2efb464155859ea" exitCode=0
Nov 04 02:16:31.766160 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.766133    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-ts54b" event={"ID":"5435f585-4325-42b2-8992-988af472d105","Type":"ContainerDied","Data":"68372c858053362db44207e29274a4f4f9d5af474742d8d1f2efb464155859ea"}
Nov 04 02:16:31.766641 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.766532    5722 scope.go:122] "RemoveContainer" containerID="68372c858053362db44207e29274a4f4f9d5af474742d8d1f2efb464155859ea"
Nov 04 02:16:31.768035 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.768010    5722 generic.go:356] "Generic (PLEG): container finished" podID="b4f3aa40-09ba-47db-b65b-ed4db9045c1f" containerID="33a3f0ae869898ebd52c780b29843e8fd9ce5b700cf0f191420b4e9066b974fc" exitCode=0
Nov 04 02:16:31.768165 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.768085    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6" event={"ID":"b4f3aa40-09ba-47db-b65b-ed4db9045c1f","Type":"ContainerDied","Data":"33a3f0ae869898ebd52c780b29843e8fd9ce5b700cf0f191420b4e9066b974fc"}
Nov 04 02:16:31.768495 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.768477    5722 scope.go:122] "RemoveContainer" containerID="33a3f0ae869898ebd52c780b29843e8fd9ce5b700cf0f191420b4e9066b974fc"
Nov 04 02:16:31.770019 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.769974    5722 generic.go:356] "Generic (PLEG): container finished" podID="40222b3d-3cdb-4da6-8bfa-3764919a09a4" containerID="356fc6a816c23618518eca49acdcb514f6bdbd435d5de6e52a5a29b41193ab37" exitCode=0
Nov 04 02:16:31.770116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.770046    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln" event={"ID":"40222b3d-3cdb-4da6-8bfa-3764919a09a4","Type":"ContainerDied","Data":"356fc6a816c23618518eca49acdcb514f6bdbd435d5de6e52a5a29b41193ab37"}
Nov 04 02:16:31.770238 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.770220    5722 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 02:16:31.771098 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.771072    5722 scope.go:122] "RemoveContainer" containerID="356fc6a816c23618518eca49acdcb514f6bdbd435d5de6e52a5a29b41193ab37"
Nov 04 02:16:31.858952 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.858927    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:31.905860 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.905735    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:31.922095 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:31.916991    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-sxrh5"
Nov 04 02:16:32.036269 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:32.036184    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:32.209549 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:32.209502    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:32.387648 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:32.387609    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:32.401795 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:32.401763    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:32.582075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:32.582033    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:32.755393 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:32.755311    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:32.777822 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:32.777783    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-p8dln" event={"ID":"40222b3d-3cdb-4da6-8bfa-3764919a09a4","Type":"ContainerStarted","Data":"ada390b85e410f44582820a0d39f03639a938d163385ae4c885bd59262803cfa"}
Nov 04 02:16:32.780101 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:32.780071    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-ts54b" event={"ID":"5435f585-4325-42b2-8992-988af472d105","Type":"ContainerStarted","Data":"1fd4c9b6a3ce33e3e2355ac598b2e2140a403358a8c9252a7f8336e088c7093b"}
Nov 04 02:16:32.783173 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:32.783141    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-r8br6" event={"ID":"b4f3aa40-09ba-47db-b65b-ed4db9045c1f","Type":"ContainerStarted","Data":"22fed2ff5a21d04bd7390d735d94237dd74dbe6a10e98ef775360258a1e747bd"}
Nov 04 02:16:32.940469 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:32.940438    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:35.391037 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:35.390997    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b6zs7"
Nov 04 02:16:37.023264 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:37.023224    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7bvrs"
Nov 04 02:16:37.251027 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:37.250941    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:37.254636 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:37.254606    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:16:37.864238 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:37.864200    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:38.050608 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:38.050582    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:38.051093 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:38.050880    5722 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 02:16:38.515037 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:38.514984    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:38.700983 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:38.700927    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:38.895007 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:38.894957    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:38.899932 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:38.899908    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:38.900079 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:38.900067    5722 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 02:16:38.901589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:38.901564    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b8f6d865c-c8tlq"
Nov 04 02:16:39.098678 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.098567    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:39.272861 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.272634    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:39.365890 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.365833    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2n7wg"]
Nov 04 02:16:39.369019 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.368975    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.425395 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.425350    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 02:16:39.425395 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.425377    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 02:16:39.425395 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.425370    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qzhl8\""
Nov 04 02:16:39.473485 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.473435    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:39.483532 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.483484    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-accelerators-collector-config\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.483793 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.483542    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-tls\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.483793 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.483740    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/094a872b-f79f-4899-8b8b-c84b58335ea5-metrics-client-ca\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.483869 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.483838    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.483909 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.483894    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/094a872b-f79f-4899-8b8b-c84b58335ea5-root\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.483959 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.483941    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-textfile\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.484054 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.483987    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj6gg\" (UniqueName: \"kubernetes.io/projected/094a872b-f79f-4899-8b8b-c84b58335ea5-kube-api-access-cj6gg\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.484054 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.484023    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-wtmp\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.484112 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.484062    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/094a872b-f79f-4899-8b8b-c84b58335ea5-sys\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.502489 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.502443    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 02:16:39.502489 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.502490    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 02:16:39.585140 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585041    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/094a872b-f79f-4899-8b8b-c84b58335ea5-root\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585140 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585086    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-textfile\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585140 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585110    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj6gg\" (UniqueName: \"kubernetes.io/projected/094a872b-f79f-4899-8b8b-c84b58335ea5-kube-api-access-cj6gg\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585140 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585134    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-wtmp\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585471 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585162    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/094a872b-f79f-4899-8b8b-c84b58335ea5-sys\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585471 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585160    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/094a872b-f79f-4899-8b8b-c84b58335ea5-root\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585471 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585236    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-accelerators-collector-config\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585471 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585262    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/094a872b-f79f-4899-8b8b-c84b58335ea5-sys\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585471 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585267    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-tls\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585471 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585309    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/094a872b-f79f-4899-8b8b-c84b58335ea5-metrics-client-ca\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585471 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585332    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-wtmp\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585471 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585401    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585918 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585508    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-textfile\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.585918 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.585832    5722 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 02:16:39.586042 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.586021    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/094a872b-f79f-4899-8b8b-c84b58335ea5-metrics-client-ca\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.586098 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.586022    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-accelerators-collector-config\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.588078 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.588056    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.588161 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.588148    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/094a872b-f79f-4899-8b8b-c84b58335ea5-node-exporter-tls\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.648913 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.648884    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj6gg\" (UniqueName: \"kubernetes.io/projected/094a872b-f79f-4899-8b8b-c84b58335ea5-kube-api-access-cj6gg\") pod \"node-exporter-2n7wg\" (UID: \"094a872b-f79f-4899-8b8b-c84b58335ea5\") " pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.684966 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.684920    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2n7wg"
Nov 04 02:16:39.696181 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:16:39.696145    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094a872b_f79f_4899_8b8b_c84b58335ea5.slice/crio-c6cdc68bd1eb9aa5d43abea0b0408bd42e456b707c3583dfe85b868531077f1f WatchSource:0}: Error finding container c6cdc68bd1eb9aa5d43abea0b0408bd42e456b707c3583dfe85b868531077f1f: Status 404 returned error can't find the container with id c6cdc68bd1eb9aa5d43abea0b0408bd42e456b707c3583dfe85b868531077f1f
Nov 04 02:16:39.698304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.698283    5722 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:16:39.758528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.758497    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:39.814645 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:39.814599    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2n7wg" event={"ID":"094a872b-f79f-4899-8b8b-c84b58335ea5","Type":"ContainerStarted","Data":"c6cdc68bd1eb9aa5d43abea0b0408bd42e456b707c3583dfe85b868531077f1f"}
Nov 04 02:16:40.032101 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:40.032015    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:40.610783 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:16:40.610748    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:16:40.842865 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:40.842825    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:41.285103 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:41.285065    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:41.652348 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:41.652312    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:42.094607 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:42.094575    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:42.309214 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:42.309129    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:42.828400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:42.828350    5722 generic.go:356] "Generic (PLEG): container finished" podID="094a872b-f79f-4899-8b8b-c84b58335ea5" containerID="ca351f2a727b7c2c78bdd0e6e08d7a71006b01887d629823d6e8b7e74fc6aa3f" exitCode=0
Nov 04 02:16:42.828914 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:42.828434    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2n7wg" event={"ID":"094a872b-f79f-4899-8b8b-c84b58335ea5","Type":"ContainerDied","Data":"ca351f2a727b7c2c78bdd0e6e08d7a71006b01887d629823d6e8b7e74fc6aa3f"}
Nov 04 02:16:42.850130 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:42.850097    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bcfd7b985-mn847"]
Nov 04 02:16:42.976298 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:42.976264    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:43.178208 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:43.178174    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:43.374029 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:43.373981    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:43.793793 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:43.793758    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:43.835711 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:43.835674    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2n7wg" event={"ID":"094a872b-f79f-4899-8b8b-c84b58335ea5","Type":"ContainerStarted","Data":"ce445787593f001a5bdbfc5c57b89693489acc7810b4029b3a3bc0c0f25c9435"}
Nov 04 02:16:43.836117 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:43.835764    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2n7wg" event={"ID":"094a872b-f79f-4899-8b8b-c84b58335ea5","Type":"ContainerStarted","Data":"1cde3fb9d89c641feec44b8d8b8134743244ee970f04539ee03d16556ddcf70d"}
Nov 04 02:16:43.962847 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:43.962785    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2n7wg" podStartSLOduration=2.673825087 podStartE2EDuration="4.962770912s" totalImagesPullingTime="2.207043856s" totalInitContainerRuntime="81.901969ms" isStatefulPod=true podCreationTimestamp="2026-11-04 02:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:43.96157698 +0000 UTC m=+15.435114162" watchObservedRunningTime="2026-11-04 02:16:43.962770912 +0000 UTC m=+15.436308158"
Nov 04 02:16:43.992036 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:43.991991    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:44.174044 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:44.174012    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:44.393537 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:44.393468    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:46.831350 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:46.831308    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:47.038398 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:47.038368    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:48.099428 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:48.099388    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:48.276363 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:48.276331    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:48.848284 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:48.848240    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:49.536037 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:49.536004    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:49.711036 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:49.711003    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:49.932393 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:49.932341    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:50.183142 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:50.183054    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:57.054553 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:57.054503    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:57.230869 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:57.230837    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:59.253292 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:59.253253    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgm27"
Nov 04 02:16:59.256060 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:59.256005    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6npmv"
Nov 04 02:16:59.480234 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:59.480189    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:16:59.661110 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:16:59.661070    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:02.083609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:02.083570    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:02.263016 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:02.262924    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:06.092044 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:06.092010    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:06.289153 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:06.289120    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:07.878894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:07.878847    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847" podUID="e96b7798-598c-4934-a2a1-40cb966e98c4" containerName="registry" containerID="cri-o://c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124" gracePeriod=30
Nov 04 02:17:08.132158 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.132089    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:17:08.204479 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.204445    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-certificates\") pod \"e96b7798-598c-4934-a2a1-40cb966e98c4\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") "
Nov 04 02:17:08.204716 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.204529    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") pod \"e96b7798-598c-4934-a2a1-40cb966e98c4\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") "
Nov 04 02:17:08.204716 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.204566    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-image-registry-private-configuration\") pod \"e96b7798-598c-4934-a2a1-40cb966e98c4\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") "
Nov 04 02:17:08.204716 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.204614    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-trusted-ca\") pod \"e96b7798-598c-4934-a2a1-40cb966e98c4\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") "
Nov 04 02:17:08.204716 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.204638    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-installation-pull-secrets\") pod \"e96b7798-598c-4934-a2a1-40cb966e98c4\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") "
Nov 04 02:17:08.204716 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.204697    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-bound-sa-token\") pod \"e96b7798-598c-4934-a2a1-40cb966e98c4\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") "
Nov 04 02:17:08.204978 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.204727    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-kube-api-access-vpxxh\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-kube-api-access-vpxxh\") pod \"e96b7798-598c-4934-a2a1-40cb966e98c4\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") "
Nov 04 02:17:08.204978 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.204802    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e96b7798-598c-4934-a2a1-40cb966e98c4-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e96b7798-598c-4934-a2a1-40cb966e98c4-ca-trust-extracted\") pod \"e96b7798-598c-4934-a2a1-40cb966e98c4\" (UID: \"e96b7798-598c-4934-a2a1-40cb966e98c4\") "
Nov 04 02:17:08.204978 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.204946    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-certificates" pod "e96b7798-598c-4934-a2a1-40cb966e98c4" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:17:08.205133 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.205066    5722 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-certificates\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:08.205516 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.205406    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-trusted-ca" pod "e96b7798-598c-4934-a2a1-40cb966e98c4" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:17:08.207497 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.207453    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-image-registry-private-configuration" pod "e96b7798-598c-4934-a2a1-40cb966e98c4" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:17:08.207617 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.207475    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-bound-sa-token" pod "e96b7798-598c-4934-a2a1-40cb966e98c4" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:17:08.207783 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.207758    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls" pod "e96b7798-598c-4934-a2a1-40cb966e98c4" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:17:08.207851 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.207761    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-installation-pull-secrets" pod "e96b7798-598c-4934-a2a1-40cb966e98c4" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:17:08.207851 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.207830    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-kube-api-access-vpxxh" pod "e96b7798-598c-4934-a2a1-40cb966e98c4" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4"). InnerVolumeSpecName "kube-api-access-vpxxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:17:08.212515 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.212493    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e96b7798-598c-4934-a2a1-40cb966e98c4-ca-trust-extracted" pod "e96b7798-598c-4934-a2a1-40cb966e98c4" (UID: "e96b7798-598c-4934-a2a1-40cb966e98c4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:17:08.254850 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.254792    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:08.306246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.306205    5722 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e96b7798-598c-4934-a2a1-40cb966e98c4-ca-trust-extracted\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:08.306246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.306243    5722 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-registry-tls\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:08.306246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.306255    5722 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-image-registry-private-configuration\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:08.306533 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.306265    5722 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e96b7798-598c-4934-a2a1-40cb966e98c4-trusted-ca\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:08.306533 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.306275    5722 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e96b7798-598c-4934-a2a1-40cb966e98c4-installation-pull-secrets\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:08.306533 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.306283    5722 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-bound-sa-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:08.306533 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.306293    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpxxh\" (UniqueName: \"kubernetes.io/projected/e96b7798-598c-4934-a2a1-40cb966e98c4-kube-api-access-vpxxh\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:17:08.441506 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.441411    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:08.931843 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.931806    5722 generic.go:356] "Generic (PLEG): container finished" podID="e96b7798-598c-4934-a2a1-40cb966e98c4" containerID="c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124" exitCode=0
Nov 04 02:17:08.932329 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.931858    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847"
Nov 04 02:17:08.932329 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.931880    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847" event={"ID":"e96b7798-598c-4934-a2a1-40cb966e98c4","Type":"ContainerDied","Data":"c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124"}
Nov 04 02:17:08.932329 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.931927    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bcfd7b985-mn847" event={"ID":"e96b7798-598c-4934-a2a1-40cb966e98c4","Type":"ContainerDied","Data":"c4e591d4062df69fffaad9b40568bf2c34efa0082d4c616ea1c662787781af1a"}
Nov 04 02:17:08.932329 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.931960    5722 scope.go:122] "RemoveContainer" containerID="c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124"
Nov 04 02:17:08.941103 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.941080    5722 scope.go:122] "RemoveContainer" containerID="c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124"
Nov 04 02:17:08.941381 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:17:08.941362    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124\": container with ID starting with c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124 not found: ID does not exist" containerID="c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124"
Nov 04 02:17:08.941423 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:08.941391    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124"} err="failed to get container status \"c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124\": rpc error: code = NotFound desc = could not find container \"c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124\": container with ID starting with c4a2649edcf1d739c87aed39ccb4213e2fa4b5926378b5b8907bcf8240b75124 not found: ID does not exist"
Nov 04 02:17:09.152212 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:09.152174    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bcfd7b985-mn847"]
Nov 04 02:17:09.203876 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:09.203799    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bcfd7b985-mn847"]
Nov 04 02:17:10.610706 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:17:10.610670    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:17:10.677811 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:10.677777    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e96b7798-598c-4934-a2a1-40cb966e98c4" path="/var/lib/kubelet/pods/e96b7798-598c-4934-a2a1-40cb966e98c4/volumes"
Nov 04 02:17:16.830906 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:16.830860    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:17.010961 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:17.010925    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:31.834361 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:31.834325    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:32.018710 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:32.018673    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:40.610113 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:17:40.610067    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:17:50.288811 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:50.288775    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:50.546602 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:50.546514    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:51.749581 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:51.749493    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:58.481733 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:58.481693    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:17:58.654267 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:17:58.654236    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:18:02.351386 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:18:02.351343    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:18:02.525113 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:18:02.525074    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:18:02.764944 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:18:02.764903    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:18:02.967275 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:18:02.967237    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:18:10.609331 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:18:10.609250    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:18:11.144904 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:18:11.144868    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:18:11.405009 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:18:11.404918    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:18:16.833871 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:18:16.833832    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:18:17.010187 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:18:17.010154    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:18:31.932082 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:18:31.932044    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:18:40.609416 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:18:40.609373    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:18:50.589002 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:18:50.588913    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:10.609172 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:19:10.609129    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:19:40.609948 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:19:40.609868    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:19:41.979574 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:41.979539    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:42.172980 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:42.172944    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:43.446804 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.446770    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"]
Nov 04 02:19:43.447254 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.447235    5722 cpu_manager.go:414] "containerMap: removing container" podUID="e96b7798-598c-4934-a2a1-40cb966e98c4" containerName="registry"
Nov 04 02:19:43.447296 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.447256    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e96b7798-598c-4934-a2a1-40cb966e98c4" containerName="registry"
Nov 04 02:19:43.447330 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.447316    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="e96b7798-598c-4934-a2a1-40cb966e98c4" containerName="registry"
Nov 04 02:19:43.449194 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.449178    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.485089 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.485047    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:43.506249 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.506207    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.506435 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.506263    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d306eac1-1744-435f-bc38-0983ee8cf01a-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.506435 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.506335    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.506435 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.506391    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.506540 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.506442    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.506540 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.506471    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhjns\" (UniqueName: \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-kube-api-access-vhjns\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.506604 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.506544    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.508513 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.508487    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 04 02:19:43.508513 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.508497    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qlvkm\""
Nov 04 02:19:43.508699 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.508526    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 04 02:19:43.508699 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.508508    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 04 02:19:43.508699 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.508508    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 04 02:19:43.559668 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.559632    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"]
Nov 04 02:19:43.607148 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.607108    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.607148 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.607152    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhjns\" (UniqueName: \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-kube-api-access-vhjns\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.607423 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.607175    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.607423 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.607195    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.607423 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.607217    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d306eac1-1744-435f-bc38-0983ee8cf01a-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.607423 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.607233    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.607423 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.607276    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.608203 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.608176    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.609772 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.609745    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d306eac1-1744-435f-bc38-0983ee8cf01a-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.609954 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.609931    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.610032 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.609996    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.610077 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.610031    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.667966 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.667932    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:43.670550 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.670527    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhjns\" (UniqueName: \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-kube-api-access-vhjns\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.670630 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.670589    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-hs66c\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:43.759770 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:43.759678    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:44.177370 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:19:44.177336    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd306eac1_1744_435f_bc38_0983ee8cf01a.slice/crio-853f13c78807d6068b0f146bf8a2d2abff813be34f0e0a5d0a994f4ca82b3a3e WatchSource:0}: Error finding container 853f13c78807d6068b0f146bf8a2d2abff813be34f0e0a5d0a994f4ca82b3a3e: Status 404 returned error can't find the container with id 853f13c78807d6068b0f146bf8a2d2abff813be34f0e0a5d0a994f4ca82b3a3e
Nov 04 02:19:44.179360 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:44.179333    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"]
Nov 04 02:19:44.490741 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:44.490635    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c" event={"ID":"d306eac1-1744-435f-bc38-0983ee8cf01a","Type":"ContainerStarted","Data":"853f13c78807d6068b0f146bf8a2d2abff813be34f0e0a5d0a994f4ca82b3a3e"}
Nov 04 02:19:44.814435 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:44.814350    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:48.649234 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:48.649204    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:19:48.649560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:48.649272    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:19:49.514345 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:49.514310    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c" event={"ID":"d306eac1-1744-435f-bc38-0983ee8cf01a","Type":"ContainerStarted","Data":"8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1"}
Nov 04 02:19:49.514543 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:49.514474    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:49.516193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:49.516163    5722 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-hs66c container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 02:19:49.516340 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:49.516221    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c" podUID="d306eac1-1744-435f-bc38-0983ee8cf01a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 02:19:49.728453 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:49.728390    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c" podStartSLOduration=2.259468034 podStartE2EDuration="6.728375239s" totalImagesPullingTime="4.468907205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:19:49.727908212 +0000 UTC m=+201.201445393" watchObservedRunningTime="2026-11-04 02:19:49.728375239 +0000 UTC m=+201.201912418"
Nov 04 02:19:50.031111 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:50.031059    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:50.202926 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:50.202892    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:50.519405 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:50.519375    5722 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-hs66c container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 02:19:50.519576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:50.519434    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c" podUID="d306eac1-1744-435f-bc38-0983ee8cf01a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 02:19:50.957073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:50.957038    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:51.498205 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:51.498169    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:51.836461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:51.836419    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:52.021022 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:52.016923    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:19:53.520424 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:53.520379    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:19:55.364353 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:19:55.364313    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:10.609797 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:20:10.609759    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:20:40.628775 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:20:40.628676    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:20:45.569416 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:45.569385    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:48.955101 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:48.955065    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:49.128573 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:49.128520    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:51.327197 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:51.327164    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:51.990450 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:51.990414    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:53.465801 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:53.465770    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:53.659268 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:53.659237    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:54.999080 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:54.999036    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:55.805293 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:55.805248    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:56.338806 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:56.338764    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:58.835268 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:58.835234    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:20:59.177145 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:20:59.177109    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:00.024602 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:00.024551    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:03.781777 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:03.781740    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:03.954733 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:03.954691    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:04.257793 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:04.257760    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:04.908264 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:04.908234    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:05.118946 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.118893    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:05.256940 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.256861    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"]
Nov 04 02:21:05.260387 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.260363    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.321050 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.321009    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:05.321528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.321511    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 04 02:21:05.370911 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.370871    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 04 02:21:05.370911 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.370909    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 04 02:21:05.371184 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.370974    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-fkgjv\""
Nov 04 02:21:05.371184 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.371092    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 04 02:21:05.371269 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.371218    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 04 02:21:05.372456 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.372439    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"]
Nov 04 02:21:05.393609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.393569    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/feffb543-27c1-4bb6-94fb-9db55b55a0cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.393609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.393612    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/feffb543-27c1-4bb6-94fb-9db55b55a0cd-metrics-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.393864 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.393638    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feffb543-27c1-4bb6-94fb-9db55b55a0cd-tmp\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.393864 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.393782    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/feffb543-27c1-4bb6-94fb-9db55b55a0cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.393864 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.393821    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzh5z\" (UniqueName: \"kubernetes.io/projected/feffb543-27c1-4bb6-94fb-9db55b55a0cd-kube-api-access-pzh5z\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.393864 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.393847    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/feffb543-27c1-4bb6-94fb-9db55b55a0cd-manifests\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.495213 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.495174    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/feffb543-27c1-4bb6-94fb-9db55b55a0cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.495213 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.495220    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/feffb543-27c1-4bb6-94fb-9db55b55a0cd-metrics-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.495502 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.495247    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feffb543-27c1-4bb6-94fb-9db55b55a0cd-tmp\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.495502 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.495266    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/feffb543-27c1-4bb6-94fb-9db55b55a0cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.495502 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.495293    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzh5z\" (UniqueName: \"kubernetes.io/projected/feffb543-27c1-4bb6-94fb-9db55b55a0cd-kube-api-access-pzh5z\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.495502 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.495322    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/feffb543-27c1-4bb6-94fb-9db55b55a0cd-manifests\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.495858 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.495832    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/feffb543-27c1-4bb6-94fb-9db55b55a0cd-manifests\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.498075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.498051    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/feffb543-27c1-4bb6-94fb-9db55b55a0cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.498178 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.498073    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feffb543-27c1-4bb6-94fb-9db55b55a0cd-tmp\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.498266 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.498246    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/feffb543-27c1-4bb6-94fb-9db55b55a0cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.498302 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.498246    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/feffb543-27c1-4bb6-94fb-9db55b55a0cd-metrics-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.505170 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.505142    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:05.559122 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.559038    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzh5z\" (UniqueName: \"kubernetes.io/projected/feffb543-27c1-4bb6-94fb-9db55b55a0cd-kube-api-access-pzh5z\") pod \"opendatahub-operator-controller-manager-8bf8997fb-smgkh\" (UID: \"feffb543-27c1-4bb6-94fb-9db55b55a0cd\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.575704 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.575644    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:05.700315 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.700275    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:05.932324 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:05.932293    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:06.081985 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:21:06.081946    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeffb543_27c1_4bb6_94fb_9db55b55a0cd.slice/crio-7db58db846094960be728913ba4224bca990323693f915fd58492dd66ee96151 WatchSource:0}: Error finding container 7db58db846094960be728913ba4224bca990323693f915fd58492dd66ee96151: Status 404 returned error can't find the container with id 7db58db846094960be728913ba4224bca990323693f915fd58492dd66ee96151
Nov 04 02:21:06.083068 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:06.083048    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"]
Nov 04 02:21:06.110885 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:06.110850    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:06.722191 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:06.722152    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:06.799057 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:06.799012    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh" event={"ID":"feffb543-27c1-4bb6-94fb-9db55b55a0cd","Type":"ContainerStarted","Data":"7db58db846094960be728913ba4224bca990323693f915fd58492dd66ee96151"}
Nov 04 02:21:08.426235 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:08.426162    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:08.969821 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:08.969782    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:09.497088 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:09.497045    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:09.705567 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:09.705525    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:10.609793 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:21:10.609705    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:21:10.821440 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:10.821401    5722 generic.go:356] "Generic (PLEG): container finished" podID="feffb543-27c1-4bb6-94fb-9db55b55a0cd" containerID="aaee57a377b2cddc63a2a0988b69bf4b1450c6393451c16f97cec8c71edcac4d" exitCode=0
Nov 04 02:21:10.821440 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:10.821444    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh" event={"ID":"feffb543-27c1-4bb6-94fb-9db55b55a0cd","Type":"ContainerDied","Data":"aaee57a377b2cddc63a2a0988b69bf4b1450c6393451c16f97cec8c71edcac4d"}
Nov 04 02:21:11.417552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:11.417512    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:11.696437 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:11.696407    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:11.829487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:11.829449    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh" event={"ID":"feffb543-27c1-4bb6-94fb-9db55b55a0cd","Type":"ContainerStarted","Data":"ad57770de90c9aaa024a0701389088c1fc3bd9d6020a7b36b74e61fd69c34a9b"}
Nov 04 02:21:11.829687 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:11.829641    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:11.971753 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:11.971616    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh" podStartSLOduration=1.590314925 podStartE2EDuration="6.971600546s" totalImagesPullingTime="4.905603008s" totalInitContainerRuntime="475.682613ms" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:11.97038806 +0000 UTC m=+283.443925245" watchObservedRunningTime="2026-11-04 02:21:11.971600546 +0000 UTC m=+283.445137725"
Nov 04 02:21:13.405804 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:13.405762    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:14.891167 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:14.891133    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:15.077121 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:15.077086    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:16.451234 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:16.451189    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:16.640843 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:16.640808    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:20.776439 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:20.776393    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:20.965565 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:20.965531    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:21.184679 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:21.184619    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:21.367295 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:21.367260    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:22.837096 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:22.837067    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-smgkh"
Nov 04 02:21:23.374432 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:23.374388    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:23.546176 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:23.546121    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:26.887711 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:26.887674    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:27.110529 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:27.110494    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:28.694180 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:28.694155    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:21:28.696330 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:28.696305    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:21:28.699388 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:28.699367    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:21:28.701736 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:28.701719    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:21:29.572000 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:29.571962    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:29.743554 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:29.743514    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:31.754036 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:31.754003    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:31.928170 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:31.928134    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:36.303488 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:36.303449    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:36.480623 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:36.480582    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:40.043000 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:40.042963    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:40.224385 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:40.224349    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:40.440523 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:40.440494    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:40.609558 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:21:40.609514    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:21:40.619530 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:40.619498    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:40.992918 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:40.992884    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:42.737695 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.737643    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:42.750471 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.750437    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"]
Nov 04 02:21:42.753761 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.753735    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"
Nov 04 02:21:42.804507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.804457    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d38c5f91-ffbf-4780-8675-6fd1c01ab733-tls-certs\") pod \"kube-auth-proxy-d555fc4c8-6r5vq\" (UID: \"d38c5f91-ffbf-4780-8675-6fd1c01ab733\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"
Nov 04 02:21:42.804730 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.804570    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38c5f91-ffbf-4780-8675-6fd1c01ab733-tmp\") pod \"kube-auth-proxy-d555fc4c8-6r5vq\" (UID: \"d38c5f91-ffbf-4780-8675-6fd1c01ab733\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"
Nov 04 02:21:42.804730 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.804591    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpw6b\" (UniqueName: \"kubernetes.io/projected/d38c5f91-ffbf-4780-8675-6fd1c01ab733-kube-api-access-gpw6b\") pod \"kube-auth-proxy-d555fc4c8-6r5vq\" (UID: \"d38c5f91-ffbf-4780-8675-6fd1c01ab733\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"
Nov 04 02:21:42.859003 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.858968    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 04 02:21:42.859198 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.859050    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xvxdr\""
Nov 04 02:21:42.859198 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.859111    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 04 02:21:42.859869 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.859850    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"]
Nov 04 02:21:42.904986 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.904956    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38c5f91-ffbf-4780-8675-6fd1c01ab733-tmp\") pod \"kube-auth-proxy-d555fc4c8-6r5vq\" (UID: \"d38c5f91-ffbf-4780-8675-6fd1c01ab733\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"
Nov 04 02:21:42.904986 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.904994    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpw6b\" (UniqueName: \"kubernetes.io/projected/d38c5f91-ffbf-4780-8675-6fd1c01ab733-kube-api-access-gpw6b\") pod \"kube-auth-proxy-d555fc4c8-6r5vq\" (UID: \"d38c5f91-ffbf-4780-8675-6fd1c01ab733\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"
Nov 04 02:21:42.905238 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.905045    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d38c5f91-ffbf-4780-8675-6fd1c01ab733-tls-certs\") pod \"kube-auth-proxy-d555fc4c8-6r5vq\" (UID: \"d38c5f91-ffbf-4780-8675-6fd1c01ab733\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"
Nov 04 02:21:42.907750 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.907714    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38c5f91-ffbf-4780-8675-6fd1c01ab733-tmp\") pod \"kube-auth-proxy-d555fc4c8-6r5vq\" (UID: \"d38c5f91-ffbf-4780-8675-6fd1c01ab733\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"
Nov 04 02:21:42.907879 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.907853    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d38c5f91-ffbf-4780-8675-6fd1c01ab733-tls-certs\") pod \"kube-auth-proxy-d555fc4c8-6r5vq\" (UID: \"d38c5f91-ffbf-4780-8675-6fd1c01ab733\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"
Nov 04 02:21:42.968470 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.968444    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpw6b\" (UniqueName: \"kubernetes.io/projected/d38c5f91-ffbf-4780-8675-6fd1c01ab733-kube-api-access-gpw6b\") pod \"kube-auth-proxy-d555fc4c8-6r5vq\" (UID: \"d38c5f91-ffbf-4780-8675-6fd1c01ab733\") " pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"
Nov 04 02:21:42.974892 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:42.974853    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:43.066276 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:43.066180    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"
Nov 04 02:21:43.155358 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:43.155327    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:43.377548 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:43.377516    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:43.454399 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:21:43.454366    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38c5f91_ffbf_4780_8675_6fd1c01ab733.slice/crio-862fcebe54ab6b9831e4e31bcf28c9a766305456164cafe97361a776ae81d8c3 WatchSource:0}: Error finding container 862fcebe54ab6b9831e4e31bcf28c9a766305456164cafe97361a776ae81d8c3: Status 404 returned error can't find the container with id 862fcebe54ab6b9831e4e31bcf28c9a766305456164cafe97361a776ae81d8c3
Nov 04 02:21:43.456631 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:43.456606    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq"]
Nov 04 02:21:43.456759 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:43.456731    5722 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:21:43.610610 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:43.610572    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:43.956644 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:43.956610    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq" event={"ID":"d38c5f91-ffbf-4780-8675-6fd1c01ab733","Type":"ContainerStarted","Data":"862fcebe54ab6b9831e4e31bcf28c9a766305456164cafe97361a776ae81d8c3"}
Nov 04 02:21:44.246440 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:44.246355    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:44.414180 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:44.414143    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:44.729180 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:44.729150    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:45.098031 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:45.097948    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:45.279295 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:45.279242    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:46.520592 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:46.520550    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:46.737154 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:46.737120    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:47.983917 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:47.983866    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq" event={"ID":"d38c5f91-ffbf-4780-8675-6fd1c01ab733","Type":"ContainerStarted","Data":"5e62edd313a4f0cd690149e51d5935b933fef6bec251cb99412523833ad2763b"}
Nov 04 02:21:48.104001 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:48.103931    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d555fc4c8-6r5vq" podStartSLOduration=2.673765039 podStartE2EDuration="6.103910902s" totalImagesPullingTime="3.430145863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:48.103364004 +0000 UTC m=+319.576901185" watchObservedRunningTime="2026-11-04 02:21:48.103910902 +0000 UTC m=+319.577448084"
Nov 04 02:21:50.037676 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:50.037627    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:50.218346 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:50.218307    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:50.410812 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:50.410776    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:50.996611 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:50.996574    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:51.691335 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:51.691239    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:55.366176 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:55.366132    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:55.542578 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:55.542546    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:55.945311 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:55.945278    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"]
Nov 04 02:21:55.949962 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:55.949941    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.006008 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.005967    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 04 02:21:56.006008 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.005971    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 04 02:21:56.033360 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.033319    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.033553 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.033373    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.033553 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.033480    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wml4c\" (UniqueName: \"kubernetes.io/projected/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-kube-api-access-wml4c\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.033553 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.033525    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.134891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.134855    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.135109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.134910    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.135109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.134945    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wml4c\" (UniqueName: \"kubernetes.io/projected/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-kube-api-access-wml4c\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.135109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.134979    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.135343 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.135319    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.135415 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.135325    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.160404 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.160352    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-phmmc\""
Nov 04 02:21:56.160404 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.160399    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Nov 04 02:21:56.161266 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.161251    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"]
Nov 04 02:21:56.166434 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.166410    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.198767 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.198689    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wml4c\" (UniqueName: \"kubernetes.io/projected/50ff7381-5e3b-44cb-ae1c-208ec2ab5b09-kube-api-access-wml4c\") pod \"kserve-module-controller-manager-7566cf5fc8-9x7xf\" (UID: \"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.262594 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.262551    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:56.679606 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:21:56.679568    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ff7381_5e3b_44cb_ae1c_208ec2ab5b09.slice/crio-5291309fc306b0cf64f3e3695b769d9c47ebe292e9b47b5778317a1d3773257c WatchSource:0}: Error finding container 5291309fc306b0cf64f3e3695b769d9c47ebe292e9b47b5778317a1d3773257c: Status 404 returned error can't find the container with id 5291309fc306b0cf64f3e3695b769d9c47ebe292e9b47b5778317a1d3773257c
Nov 04 02:21:56.681401 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:56.681369    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"]
Nov 04 02:21:57.021918 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:57.021828    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf" event={"ID":"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09","Type":"ContainerStarted","Data":"5291309fc306b0cf64f3e3695b769d9c47ebe292e9b47b5778317a1d3773257c"}
Nov 04 02:21:58.307012 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:58.306967    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:58.487589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:58.487545    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:21:59.033712 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:59.033645    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf" event={"ID":"50ff7381-5e3b-44cb-ae1c-208ec2ab5b09","Type":"ContainerStarted","Data":"145cf7bf447cd88d9faa89584685187be7e6669f22c50a14f83b0ce55c58c055"}
Nov 04 02:21:59.033900 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:59.033777    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:21:59.207226 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:21:59.207073    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf" podStartSLOduration=2.063446825 podStartE2EDuration="4.207057437s" totalImagesPullingTime="2.143610612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:59.206283662 +0000 UTC m=+330.679820844" watchObservedRunningTime="2026-11-04 02:21:59.207057437 +0000 UTC m=+330.680594616"
Nov 04 02:22:08.514359 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:08.514320    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5hrdw"]
Nov 04 02:22:08.517722 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:08.517686    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw"
Nov 04 02:22:08.575300 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:08.575269    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5hrdw"]
Nov 04 02:22:08.576830 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:08.576810    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 04 02:22:08.625390 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:08.625349    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 04 02:22:08.625390 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:08.625373    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gsqs5\""
Nov 04 02:22:08.645357 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:08.645316    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rltt\" (UniqueName: \"kubernetes.io/projected/ac256e79-e51b-4fa5-96a0-5a6be1f1b43f-kube-api-access-5rltt\") pod \"authorino-56c6c9ddd5-5hrdw\" (UID: \"ac256e79-e51b-4fa5-96a0-5a6be1f1b43f\") " pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw"
Nov 04 02:22:08.746141 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:08.746074    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rltt\" (UniqueName: \"kubernetes.io/projected/ac256e79-e51b-4fa5-96a0-5a6be1f1b43f-kube-api-access-5rltt\") pod \"authorino-56c6c9ddd5-5hrdw\" (UID: \"ac256e79-e51b-4fa5-96a0-5a6be1f1b43f\") " pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw"
Nov 04 02:22:08.812463 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:08.812281    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rltt\" (UniqueName: \"kubernetes.io/projected/ac256e79-e51b-4fa5-96a0-5a6be1f1b43f-kube-api-access-5rltt\") pod \"authorino-56c6c9ddd5-5hrdw\" (UID: \"ac256e79-e51b-4fa5-96a0-5a6be1f1b43f\") " pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw"
Nov 04 02:22:08.846910 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:08.846845    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw"
Nov 04 02:22:09.242556 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:22:09.242487    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac256e79_e51b_4fa5_96a0_5a6be1f1b43f.slice/crio-04210f0c8d5ce47b66deb8c47c3060bb626e444506a087c3d762edfa52a70025 WatchSource:0}: Error finding container 04210f0c8d5ce47b66deb8c47c3060bb626e444506a087c3d762edfa52a70025: Status 404 returned error can't find the container with id 04210f0c8d5ce47b66deb8c47c3060bb626e444506a087c3d762edfa52a70025
Nov 04 02:22:09.244330 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:09.244297    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5hrdw"]
Nov 04 02:22:10.079945 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:10.079912    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw" event={"ID":"ac256e79-e51b-4fa5-96a0-5a6be1f1b43f","Type":"ContainerStarted","Data":"04210f0c8d5ce47b66deb8c47c3060bb626e444506a087c3d762edfa52a70025"}
Nov 04 02:22:10.609888 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:22:10.609846    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:22:13.096023 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:13.095933    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw" event={"ID":"ac256e79-e51b-4fa5-96a0-5a6be1f1b43f","Type":"ContainerStarted","Data":"077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248"}
Nov 04 02:22:13.213327 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:13.213268    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw" podStartSLOduration=1.676012112 podStartE2EDuration="5.213254408s" totalImagesPullingTime="3.537242296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:22:13.212190744 +0000 UTC m=+344.685727923" watchObservedRunningTime="2026-11-04 02:22:13.213254408 +0000 UTC m=+344.686791590"
Nov 04 02:22:20.039209 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:20.039177    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-9x7xf"
Nov 04 02:22:28.654992 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:28.654954    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:22:28.830282 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:28.830249    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:22:29.419864 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:29.419830    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:22:40.609685 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:22:40.609564    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:22:40.814535 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:40.814499    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:22:40.987061 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:40.987013    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:22:52.057513 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:52.057459    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:22:52.391625 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:52.391528    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:22:57.458513 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.458472    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"]
Nov 04 02:22:57.467843 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.467819    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.570071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.570029    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c07e2a7b-8139-48f7-aaf8-4b9579003b57-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.570071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.570075    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.570294 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.570222    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.570294 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.570258    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c07e2a7b-8139-48f7-aaf8-4b9579003b57-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.570294 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.570283    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.570409 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.570353    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.570451 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.570419    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zqg\" (UniqueName: \"kubernetes.io/projected/c07e2a7b-8139-48f7-aaf8-4b9579003b57-kube-api-access-79zqg\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.574415 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.574386    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"]
Nov 04 02:22:57.672290 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.672251    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.672610 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.672576    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.672805 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.672789    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79zqg\" (UniqueName: \"kubernetes.io/projected/c07e2a7b-8139-48f7-aaf8-4b9579003b57-kube-api-access-79zqg\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.672919 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.672905    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c07e2a7b-8139-48f7-aaf8-4b9579003b57-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.673031 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.673017    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.673193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.673179    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.673304 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.673291    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c07e2a7b-8139-48f7-aaf8-4b9579003b57-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.676686 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.676535    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c07e2a7b-8139-48f7-aaf8-4b9579003b57-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.678194 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.678148    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.680263 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.680235    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.680362 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.680343    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.680422 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.680345    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c07e2a7b-8139-48f7-aaf8-4b9579003b57-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.740044 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.739964    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c07e2a7b-8139-48f7-aaf8-4b9579003b57-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.740044 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.739996    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zqg\" (UniqueName: \"kubernetes.io/projected/c07e2a7b-8139-48f7-aaf8-4b9579003b57-kube-api-access-79zqg\") pod \"istiod-openshift-gateway-7ddd9cfdc8-lwlzf\" (UID: \"c07e2a7b-8139-48f7-aaf8-4b9579003b57\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:57.780465 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:57.780425    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:58.199244 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:22:58.199216    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07e2a7b_8139_48f7_aaf8_4b9579003b57.slice/crio-bfaf830c75939e58bd50cce94b8270f065626414f001364f40f7ab3296baa519 WatchSource:0}: Error finding container bfaf830c75939e58bd50cce94b8270f065626414f001364f40f7ab3296baa519: Status 404 returned error can't find the container with id bfaf830c75939e58bd50cce94b8270f065626414f001364f40f7ab3296baa519
Nov 04 02:22:58.201715 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:58.201501    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"]
Nov 04 02:22:58.202066 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:58.202036    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:22:58.202109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:58.202097    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:22:58.293154 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:58.293104    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf" event={"ID":"c07e2a7b-8139-48f7-aaf8-4b9579003b57","Type":"ContainerStarted","Data":"db7996e3d4bd27d22a0bee11706a4ce440307982f1822597d182d54d4db71a34"}
Nov 04 02:22:58.293342 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:58.293175    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf" event={"ID":"c07e2a7b-8139-48f7-aaf8-4b9579003b57","Type":"ContainerStarted","Data":"bfaf830c75939e58bd50cce94b8270f065626414f001364f40f7ab3296baa519"}
Nov 04 02:22:58.293342 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:58.293295    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:22:58.419932 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:58.419876    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf" podStartSLOduration=1.419859647 podStartE2EDuration="1.419859647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:22:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:22:58.41868948 +0000 UTC m=+389.892226660" watchObservedRunningTime="2026-11-04 02:22:58.419859647 +0000 UTC m=+389.893396826"
Nov 04 02:22:59.299434 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:59.299401    5722 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-lwlzf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 02:22:59.299864 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:22:59.299455    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf" podUID="c07e2a7b-8139-48f7-aaf8-4b9579003b57" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 02:23:02.298777 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.298745    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-lwlzf"
Nov 04 02:23:02.527528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.527492    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"]
Nov 04 02:23:02.527812 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.527746    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c" podUID="d306eac1-1744-435f-bc38-0983ee8cf01a" containerName="discovery" containerID="cri-o://8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1" gracePeriod=30
Nov 04 02:23:02.581120 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.580995    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:02.758492 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.758456    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:02.798281 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.798254    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:23:02.920547 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.920506    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-dns-cert\") pod \"d306eac1-1744-435f-bc38-0983ee8cf01a\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") "
Nov 04 02:23:02.920774 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.920627    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-kubeconfig\") pod \"d306eac1-1744-435f-bc38-0983ee8cf01a\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") "
Nov 04 02:23:02.920774 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.920731    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-ca-configmap\") pod \"d306eac1-1744-435f-bc38-0983ee8cf01a\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") "
Nov 04 02:23:02.920774 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.920773    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d306eac1-1744-435f-bc38-0983ee8cf01a-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d306eac1-1744-435f-bc38-0983ee8cf01a-local-certs\") pod \"d306eac1-1744-435f-bc38-0983ee8cf01a\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") "
Nov 04 02:23:02.920963 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.920834    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-cacerts\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-cacerts\") pod \"d306eac1-1744-435f-bc38-0983ee8cf01a\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") "
Nov 04 02:23:02.920963 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.920861    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-kube-api-access-vhjns\" (UniqueName: \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-kube-api-access-vhjns\") pod \"d306eac1-1744-435f-bc38-0983ee8cf01a\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") "
Nov 04 02:23:02.920963 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.920890    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-token\" (UniqueName: \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-token\") pod \"d306eac1-1744-435f-bc38-0983ee8cf01a\" (UID: \"d306eac1-1744-435f-bc38-0983ee8cf01a\") "
Nov 04 02:23:02.921179 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.921150    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-ca-configmap" pod "d306eac1-1744-435f-bc38-0983ee8cf01a" (UID: "d306eac1-1744-435f-bc38-0983ee8cf01a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:23:02.925292 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.925257    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-kubeconfig" pod "d306eac1-1744-435f-bc38-0983ee8cf01a" (UID: "d306eac1-1744-435f-bc38-0983ee8cf01a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:23:02.926059 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.926020    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-kube-api-access-vhjns" pod "d306eac1-1744-435f-bc38-0983ee8cf01a" (UID: "d306eac1-1744-435f-bc38-0983ee8cf01a"). InnerVolumeSpecName "kube-api-access-vhjns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:23:02.926194 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.926080    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-dns-cert" pod "d306eac1-1744-435f-bc38-0983ee8cf01a" (UID: "d306eac1-1744-435f-bc38-0983ee8cf01a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:23:02.926194 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.926142    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-cacerts" pod "d306eac1-1744-435f-bc38-0983ee8cf01a" (UID: "d306eac1-1744-435f-bc38-0983ee8cf01a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:23:02.926314 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.926298    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d306eac1-1744-435f-bc38-0983ee8cf01a-local-certs" pod "d306eac1-1744-435f-bc38-0983ee8cf01a" (UID: "d306eac1-1744-435f-bc38-0983ee8cf01a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:23:02.929990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.929952    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-token" pod "d306eac1-1744-435f-bc38-0983ee8cf01a" (UID: "d306eac1-1744-435f-bc38-0983ee8cf01a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:23:02.940861 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:02.940820    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:03.021549 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.021510    5722 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d306eac1-1744-435f-bc38-0983ee8cf01a-local-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:23:03.021549 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.021543    5722 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-cacerts\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:23:03.021549 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.021556    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhjns\" (UniqueName: \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-kube-api-access-vhjns\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:23:03.021846 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.021565    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:23:03.021846 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.021575    5722 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-dns-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:23:03.021846 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.021583    5722 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-kubeconfig\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:23:03.021846 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.021592    5722 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d306eac1-1744-435f-bc38-0983ee8cf01a-istio-csr-ca-configmap\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:23:03.114860 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.114820    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:03.296720 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.296628    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:03.315891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.315859    5722 generic.go:356] "Generic (PLEG): container finished" podID="d306eac1-1744-435f-bc38-0983ee8cf01a" containerID="8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1" exitCode=0
Nov 04 02:23:03.316324 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.315915    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"
Nov 04 02:23:03.316324 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.315948    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c" event={"ID":"d306eac1-1744-435f-bc38-0983ee8cf01a","Type":"ContainerDied","Data":"8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1"}
Nov 04 02:23:03.316324 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.316039    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c" event={"ID":"d306eac1-1744-435f-bc38-0983ee8cf01a","Type":"ContainerDied","Data":"853f13c78807d6068b0f146bf8a2d2abff813be34f0e0a5d0a994f4ca82b3a3e"}
Nov 04 02:23:03.316324 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.316066    5722 scope.go:122] "RemoveContainer" containerID="8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1"
Nov 04 02:23:03.326498 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.326476    5722 scope.go:122] "RemoveContainer" containerID="8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1"
Nov 04 02:23:03.327538 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:23:03.327513    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1\": container with ID starting with 8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1 not found: ID does not exist" containerID="8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1"
Nov 04 02:23:03.327640 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.327553    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1"} err="failed to get container status \"8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1\": rpc error: code = NotFound desc = could not find container \"8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1\": container with ID starting with 8e3c7c9d76c5c2a6cc867b5ca2346173ee1c4d04463691f86e3da874fef6a2b1 not found: ID does not exist"
Nov 04 02:23:03.482131 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.482097    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:03.484822 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.484788    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"]
Nov 04 02:23:03.490045 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.490005    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-hs66c"]
Nov 04 02:23:03.585803 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.585716    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"]
Nov 04 02:23:03.586202 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.586186    5722 cpu_manager.go:414] "containerMap: removing container" podUID="d306eac1-1744-435f-bc38-0983ee8cf01a" containerName="discovery"
Nov 04 02:23:03.586248 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.586206    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d306eac1-1744-435f-bc38-0983ee8cf01a" containerName="discovery"
Nov 04 02:23:03.586334 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.586321    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="d306eac1-1744-435f-bc38-0983ee8cf01a" containerName="discovery"
Nov 04 02:23:03.591012 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.590995    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:23:03.649278 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.649248    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"]
Nov 04 02:23:03.659564 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.659535    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:03.683894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.683860    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Nov 04 02:23:03.683894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.683886    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lmf55\""
Nov 04 02:23:03.727731 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.727688    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btgkq\" (UniqueName: \"kubernetes.io/projected/567530ce-29f0-4faa-b8d1-9692ea54716d-kube-api-access-btgkq\") pod \"llmisvc-controller-manager-869d5dcc5d-m5ppb\" (UID: \"567530ce-29f0-4faa-b8d1-9692ea54716d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:23:03.727731 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.727732    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/567530ce-29f0-4faa-b8d1-9692ea54716d-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-m5ppb\" (UID: \"567530ce-29f0-4faa-b8d1-9692ea54716d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:23:03.828296 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.828257    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgkq\" (UniqueName: \"kubernetes.io/projected/567530ce-29f0-4faa-b8d1-9692ea54716d-kube-api-access-btgkq\") pod \"llmisvc-controller-manager-869d5dcc5d-m5ppb\" (UID: \"567530ce-29f0-4faa-b8d1-9692ea54716d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:23:03.828296 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.828298    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/567530ce-29f0-4faa-b8d1-9692ea54716d-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-m5ppb\" (UID: \"567530ce-29f0-4faa-b8d1-9692ea54716d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:23:03.831213 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.831179    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/567530ce-29f0-4faa-b8d1-9692ea54716d-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-m5ppb\" (UID: \"567530ce-29f0-4faa-b8d1-9692ea54716d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:23:03.891458 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.891430    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btgkq\" (UniqueName: \"kubernetes.io/projected/567530ce-29f0-4faa-b8d1-9692ea54716d-kube-api-access-btgkq\") pod \"llmisvc-controller-manager-869d5dcc5d-m5ppb\" (UID: \"567530ce-29f0-4faa-b8d1-9692ea54716d\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:23:03.902971 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:03.902937    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:23:04.271486 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:23:04.271449    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod567530ce_29f0_4faa_b8d1_9692ea54716d.slice/crio-f22f50a3c55701ac9b1bff32ad70243ca2f0e83a9664ea2452887cf548ef368c WatchSource:0}: Error finding container f22f50a3c55701ac9b1bff32ad70243ca2f0e83a9664ea2452887cf548ef368c: Status 404 returned error can't find the container with id f22f50a3c55701ac9b1bff32ad70243ca2f0e83a9664ea2452887cf548ef368c
Nov 04 02:23:04.273287 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:04.273261    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"]
Nov 04 02:23:04.321098 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:04.321053    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb" event={"ID":"567530ce-29f0-4faa-b8d1-9692ea54716d","Type":"ContainerStarted","Data":"f22f50a3c55701ac9b1bff32ad70243ca2f0e83a9664ea2452887cf548ef368c"}
Nov 04 02:23:04.679162 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:04.679130    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d306eac1-1744-435f-bc38-0983ee8cf01a" path="/var/lib/kubelet/pods/d306eac1-1744-435f-bc38-0983ee8cf01a/volumes"
Nov 04 02:23:04.896859 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:04.896821    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:06.445044 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:06.445004    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:06.610443 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:06.610407    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:06.790611 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:06.790521    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:06.968729 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:06.968688    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:07.335606 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:07.335570    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb" event={"ID":"567530ce-29f0-4faa-b8d1-9692ea54716d","Type":"ContainerStarted","Data":"dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404"}
Nov 04 02:23:07.335819 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:07.335714    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:23:07.454679 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:07.454529    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb" podStartSLOduration=1.5460449440000001 podStartE2EDuration="4.454514968s" totalImagesPullingTime="2.908470024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:23:07.453987646 +0000 UTC m=+398.927524833" watchObservedRunningTime="2026-11-04 02:23:07.454514968 +0000 UTC m=+398.928052151"
Nov 04 02:23:10.173195 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:10.173159    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:10.373249 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:10.373212    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:10.544630 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:10.544537    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:10.612534 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:23:10.612492    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:23:10.726278 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:10.726239    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:10.902101 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:10.902068    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:11.080963 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:11.080927    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:11.256954 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:11.256874    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:11.437967 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:11.437933    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:14.137288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:14.137236    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:14.325089 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:14.325012    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:17.623446 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.623383    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"]
Nov 04 02:23:17.626929 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.626907    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:17.643950 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.643918    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/53d77ce1-83c0-4e7c-9249-ac9c047e8954-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:17.644114 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.643958    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwwtq\" (UniqueName: \"kubernetes.io/projected/53d77ce1-83c0-4e7c-9249-ac9c047e8954-kube-api-access-kwwtq\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:17.644114 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.644022    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53d77ce1-83c0-4e7c-9249-ac9c047e8954-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:17.644245 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.644203    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/53d77ce1-83c0-4e7c-9249-ac9c047e8954-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:17.681251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.681217    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Nov 04 02:23:17.681251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.681224    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Nov 04 02:23:17.681476 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.681396    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Nov 04 02:23:17.732872 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.732841    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-zrwdj\""
Nov 04 02:23:17.733987 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.733961    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"]
Nov 04 02:23:17.745145 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.745112    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53d77ce1-83c0-4e7c-9249-ac9c047e8954-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:17.745330 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.745233    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/53d77ce1-83c0-4e7c-9249-ac9c047e8954-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:17.745330 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.745310    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/53d77ce1-83c0-4e7c-9249-ac9c047e8954-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:17.745589 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:23:17.745560    5722 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found
Nov 04 02:23:17.745740 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.745716    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwwtq\" (UniqueName: \"kubernetes.io/projected/53d77ce1-83c0-4e7c-9249-ac9c047e8954-kube-api-access-kwwtq\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:17.745809 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:23:17.745772    5722 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53d77ce1-83c0-4e7c-9249-ac9c047e8954-tls-cert podName:53d77ce1-83c0-4e7c-9249-ac9c047e8954 nodeName:}" failed. No retries permitted until 2026-11-04 02:23:18.24574553 +0000 UTC m=+409.719282696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/53d77ce1-83c0-4e7c-9249-ac9c047e8954-tls-cert") pod "usage-logs-tenancy-proxy-9c5d49bcd-zbm8q" (UID: "53d77ce1-83c0-4e7c-9249-ac9c047e8954") : secret "usage-logs-tenancy-proxy-tls" not found
Nov 04 02:23:17.745890 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:23:17.745834    5722 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found
Nov 04 02:23:17.745949 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:23:17.745901    5722 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53d77ce1-83c0-4e7c-9249-ac9c047e8954-proxy-source podName:53d77ce1-83c0-4e7c-9249-ac9c047e8954 nodeName:}" failed. No retries permitted until 2026-11-04 02:23:18.24587486 +0000 UTC m=+409.719412034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/53d77ce1-83c0-4e7c-9249-ac9c047e8954-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-zbm8q" (UID: "53d77ce1-83c0-4e7c-9249-ac9c047e8954") : configmap "usage-tenancy-proxy-source" not found
Nov 04 02:23:17.746118 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.746099    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53d77ce1-83c0-4e7c-9249-ac9c047e8954-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:17.807487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.807454    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:17.809095 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:17.809068    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwwtq\" (UniqueName: \"kubernetes.io/projected/53d77ce1-83c0-4e7c-9249-ac9c047e8954-kube-api-access-kwwtq\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:18.087705 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:18.087572    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:18.250580 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:18.250539    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/53d77ce1-83c0-4e7c-9249-ac9c047e8954-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:18.250796 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:18.250605    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/53d77ce1-83c0-4e7c-9249-ac9c047e8954-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:18.251590 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:18.251570    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/53d77ce1-83c0-4e7c-9249-ac9c047e8954-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:18.253284 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:18.253256    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/53d77ce1-83c0-4e7c-9249-ac9c047e8954-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zbm8q\" (UID: \"53d77ce1-83c0-4e7c-9249-ac9c047e8954\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:18.540144 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:18.540099    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:18.909564 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:23:18.909505    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53d77ce1_83c0_4e7c_9249_ac9c047e8954.slice/crio-b714564810db604f8054d855f0634f0120f667d6c54c7e88dd612a943f275d54 WatchSource:0}: Error finding container b714564810db604f8054d855f0634f0120f667d6c54c7e88dd612a943f275d54: Status 404 returned error can't find the container with id b714564810db604f8054d855f0634f0120f667d6c54c7e88dd612a943f275d54
Nov 04 02:23:18.911244 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:18.911216    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"]
Nov 04 02:23:19.389151 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:19.389106    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q" event={"ID":"53d77ce1-83c0-4e7c-9249-ac9c047e8954","Type":"ContainerStarted","Data":"b714564810db604f8054d855f0634f0120f667d6c54c7e88dd612a943f275d54"}
Nov 04 02:23:37.479233 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:37.479140    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q" event={"ID":"53d77ce1-83c0-4e7c-9249-ac9c047e8954","Type":"ContainerStarted","Data":"7fc9497101fe6ae0a99f725c019099f3dcd849cff6391c6c4c024e56e221fd5f"}
Nov 04 02:23:37.479672 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:37.479303    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:37.601507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:37.601449    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q" podStartSLOduration=2.314110468 podStartE2EDuration="20.601433062s" totalImagesPullingTime="18.287322594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:23:37.59998911 +0000 UTC m=+429.073526292" watchObservedRunningTime="2026-11-04 02:23:37.601433062 +0000 UTC m=+429.074970243"
Nov 04 02:23:38.342369 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:38.342334    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:23:40.610016 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:23:40.609978    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:23:42.134956 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:42.134919    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:42.315855 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:42.315813    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:44.400466 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:44.400429    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:44.643759 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:44.643725    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:44.818536 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:44.818453    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:44.990575 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:44.990539    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:45.401668 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.401617    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-66c859f84f-422g5"]
Nov 04 02:23:45.406082 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.406060    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.496866 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.496823    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58087c70-ddd8-4cf5-a4ff-c8033efeb699-openshift-service-ca\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.496866 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.496874    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72d5k\" (UniqueName: \"kubernetes.io/projected/58087c70-ddd8-4cf5-a4ff-c8033efeb699-kube-api-access-72d5k\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.497135 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.497023    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-maas-api-tls\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.497135 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.497040    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-metrics-certs\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.511641 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.511602    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 04 02:23:45.511641 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.511602    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:23:45.511948 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.511637    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 04 02:23:45.511948 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.511721    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-plfvj\""
Nov 04 02:23:45.511948 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.511747    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:23:45.513028 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.513009    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-66c859f84f-422g5"]
Nov 04 02:23:45.598078 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.598042    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-maas-api-tls\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.598078 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.598079    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-metrics-certs\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.598320 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.598108    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58087c70-ddd8-4cf5-a4ff-c8033efeb699-openshift-service-ca\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.598320 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.598254    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72d5k\" (UniqueName: \"kubernetes.io/projected/58087c70-ddd8-4cf5-a4ff-c8033efeb699-kube-api-access-72d5k\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.598819 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.598800    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58087c70-ddd8-4cf5-a4ff-c8033efeb699-openshift-service-ca\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.600762 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.600741    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-metrics-certs\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.600875 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.600840    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-maas-api-tls\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.661587 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.661504    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72d5k\" (UniqueName: \"kubernetes.io/projected/58087c70-ddd8-4cf5-a4ff-c8033efeb699-kube-api-access-72d5k\") pod \"maas-api-66c859f84f-422g5\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") " pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:45.718802 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:45.718755    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:46.091406 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:23:46.091350    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58087c70_ddd8_4cf5_a4ff_c8033efeb699.slice/crio-6e6e84a3ca5c9c597c1d0c244f413b9efca140261282ffa6641d7726740ac72a WatchSource:0}: Error finding container 6e6e84a3ca5c9c597c1d0c244f413b9efca140261282ffa6641d7726740ac72a: Status 404 returned error can't find the container with id 6e6e84a3ca5c9c597c1d0c244f413b9efca140261282ffa6641d7726740ac72a
Nov 04 02:23:46.093416 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:46.093382    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-66c859f84f-422g5"]
Nov 04 02:23:46.520937 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:46.520900    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5" event={"ID":"58087c70-ddd8-4cf5-a4ff-c8033efeb699","Type":"ContainerStarted","Data":"6e6e84a3ca5c9c597c1d0c244f413b9efca140261282ffa6641d7726740ac72a"}
Nov 04 02:23:48.492817 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:48.492783    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zbm8q"
Nov 04 02:23:51.331193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:51.331149    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:52.423198 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:52.423158    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:52.548572 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:52.548530    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5" event={"ID":"58087c70-ddd8-4cf5-a4ff-c8033efeb699","Type":"ContainerStarted","Data":"9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15"}
Nov 04 02:23:52.548797 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:52.548685    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:52.669604 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:52.669549    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5" podStartSLOduration=1.655469963 podStartE2EDuration="7.669533768s" totalImagesPullingTime="6.014063805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:23:52.668976268 +0000 UTC m=+444.142513451" watchObservedRunningTime="2026-11-04 02:23:52.669533768 +0000 UTC m=+444.143070950"
Nov 04 02:23:58.558767 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:58.558739    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:23:58.757826 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:58.757783    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:58.930378 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:58.930347    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:59.126867 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:59.126835    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:23:59.364151 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:23:59.364059    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:24:04.791903 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:04.791866    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5hrdw"]
Nov 04 02:24:04.792453 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:04.792112    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw" podUID="ac256e79-e51b-4fa5-96a0-5a6be1f1b43f" containerName="authorino" containerID="cri-o://077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248" gracePeriod=30
Nov 04 02:24:05.571567 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:05.571532    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw"
Nov 04 02:24:05.617781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:05.617742    5722 generic.go:356] "Generic (PLEG): container finished" podID="ac256e79-e51b-4fa5-96a0-5a6be1f1b43f" containerID="077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248" exitCode=0
Nov 04 02:24:05.617953 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:05.617795    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw"
Nov 04 02:24:05.617953 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:05.617839    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw" event={"ID":"ac256e79-e51b-4fa5-96a0-5a6be1f1b43f","Type":"ContainerDied","Data":"077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248"}
Nov 04 02:24:05.617953 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:05.617886    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-5hrdw" event={"ID":"ac256e79-e51b-4fa5-96a0-5a6be1f1b43f","Type":"ContainerDied","Data":"04210f0c8d5ce47b66deb8c47c3060bb626e444506a087c3d762edfa52a70025"}
Nov 04 02:24:05.617953 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:05.617908    5722 scope.go:122] "RemoveContainer" containerID="077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248"
Nov 04 02:24:05.626449 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:05.626430    5722 scope.go:122] "RemoveContainer" containerID="077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248"
Nov 04 02:24:05.626763 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:24:05.626745    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248\": container with ID starting with 077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248 not found: ID does not exist" containerID="077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248"
Nov 04 02:24:05.626816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:05.626775    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248"} err="failed to get container status \"077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248\": rpc error: code = NotFound desc = could not find container \"077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248\": container with ID starting with 077410d11c271c473f3c4a85cbea70584ec559ca5a3d17ae355bf36c976d0248 not found: ID does not exist"
Nov 04 02:24:05.688998 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:05.688780    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac256e79-e51b-4fa5-96a0-5a6be1f1b43f-kube-api-access-5rltt\" (UniqueName: \"kubernetes.io/projected/ac256e79-e51b-4fa5-96a0-5a6be1f1b43f-kube-api-access-5rltt\") pod \"ac256e79-e51b-4fa5-96a0-5a6be1f1b43f\" (UID: \"ac256e79-e51b-4fa5-96a0-5a6be1f1b43f\") "
Nov 04 02:24:05.691975 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:05.691946    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac256e79-e51b-4fa5-96a0-5a6be1f1b43f-kube-api-access-5rltt" pod "ac256e79-e51b-4fa5-96a0-5a6be1f1b43f" (UID: "ac256e79-e51b-4fa5-96a0-5a6be1f1b43f"). InnerVolumeSpecName "kube-api-access-5rltt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:24:05.790774 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:05.790730    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rltt\" (UniqueName: \"kubernetes.io/projected/ac256e79-e51b-4fa5-96a0-5a6be1f1b43f-kube-api-access-5rltt\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:24:06.041775 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:06.041682    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5hrdw"]
Nov 04 02:24:06.046590 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:06.046561    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5hrdw"]
Nov 04 02:24:06.678928 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:06.678891    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac256e79-e51b-4fa5-96a0-5a6be1f1b43f" path="/var/lib/kubelet/pods/ac256e79-e51b-4fa5-96a0-5a6be1f1b43f/volumes"
Nov 04 02:24:08.795587 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:08.794604    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-66c859f84f-422g5"]
Nov 04 02:24:08.795587 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:08.794892    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5" podUID="58087c70-ddd8-4cf5-a4ff-c8033efeb699" containerName="maas-api" containerID="cri-o://9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15" gracePeriod=30
Nov 04 02:24:09.078895 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.078859    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:24:09.220174 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.220141    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-metrics-certs\" (UniqueName: \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-metrics-certs\") pod \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") "
Nov 04 02:24:09.220366 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.220232    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58087c70-ddd8-4cf5-a4ff-c8033efeb699-kube-api-access-72d5k\" (UniqueName: \"kubernetes.io/projected/58087c70-ddd8-4cf5-a4ff-c8033efeb699-kube-api-access-72d5k\") pod \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") "
Nov 04 02:24:09.220366 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.220273    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-maas-api-tls\") pod \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") "
Nov 04 02:24:09.220366 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.220336    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58087c70-ddd8-4cf5-a4ff-c8033efeb699-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58087c70-ddd8-4cf5-a4ff-c8033efeb699-openshift-service-ca\") pod \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\" (UID: \"58087c70-ddd8-4cf5-a4ff-c8033efeb699\") "
Nov 04 02:24:09.220940 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.220911    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58087c70-ddd8-4cf5-a4ff-c8033efeb699-openshift-service-ca" pod "58087c70-ddd8-4cf5-a4ff-c8033efeb699" (UID: "58087c70-ddd8-4cf5-a4ff-c8033efeb699"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:24:09.222958 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.222918    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-maas-api-tls" pod "58087c70-ddd8-4cf5-a4ff-c8033efeb699" (UID: "58087c70-ddd8-4cf5-a4ff-c8033efeb699"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:24:09.223075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.222975    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58087c70-ddd8-4cf5-a4ff-c8033efeb699-kube-api-access-72d5k" pod "58087c70-ddd8-4cf5-a4ff-c8033efeb699" (UID: "58087c70-ddd8-4cf5-a4ff-c8033efeb699"). InnerVolumeSpecName "kube-api-access-72d5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:24:09.223075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.223017    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-metrics-certs" pod "58087c70-ddd8-4cf5-a4ff-c8033efeb699" (UID: "58087c70-ddd8-4cf5-a4ff-c8033efeb699"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:24:09.321811 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.321709    5722 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-maas-api-tls\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:24:09.321811 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.321749    5722 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58087c70-ddd8-4cf5-a4ff-c8033efeb699-openshift-service-ca\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:24:09.321811 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.321762    5722 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58087c70-ddd8-4cf5-a4ff-c8033efeb699-metrics-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:24:09.321811 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.321774    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72d5k\" (UniqueName: \"kubernetes.io/projected/58087c70-ddd8-4cf5-a4ff-c8033efeb699-kube-api-access-72d5k\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:24:09.638487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.638449    5722 generic.go:356] "Generic (PLEG): container finished" podID="58087c70-ddd8-4cf5-a4ff-c8033efeb699" containerID="9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15" exitCode=0
Nov 04 02:24:09.638686 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.638503    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5"
Nov 04 02:24:09.638686 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.638531    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5" event={"ID":"58087c70-ddd8-4cf5-a4ff-c8033efeb699","Type":"ContainerDied","Data":"9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15"}
Nov 04 02:24:09.638686 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.638587    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66c859f84f-422g5" event={"ID":"58087c70-ddd8-4cf5-a4ff-c8033efeb699","Type":"ContainerDied","Data":"6e6e84a3ca5c9c597c1d0c244f413b9efca140261282ffa6641d7726740ac72a"}
Nov 04 02:24:09.638686 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.638613    5722 scope.go:122] "RemoveContainer" containerID="9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15"
Nov 04 02:24:09.648459 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.648431    5722 scope.go:122] "RemoveContainer" containerID="9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15"
Nov 04 02:24:09.648800 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:24:09.648777    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15\": container with ID starting with 9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15 not found: ID does not exist" containerID="9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15"
Nov 04 02:24:09.648882 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.648809    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15"} err="failed to get container status \"9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15\": rpc error: code = NotFound desc = could not find container \"9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15\": container with ID starting with 9d42ccc87f21e7794da20018db1b71d76af39d69d5021e7b509f2536bf23cb15 not found: ID does not exist"
Nov 04 02:24:09.806809 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.806776    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-66c859f84f-422g5"]
Nov 04 02:24:09.858112 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:09.858069    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-66c859f84f-422g5"]
Nov 04 02:24:10.609569 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:24:10.609530    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:24:10.679026 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:10.678991    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58087c70-ddd8-4cf5-a4ff-c8033efeb699" path="/var/lib/kubelet/pods/58087c70-ddd8-4cf5-a4ff-c8033efeb699/volumes"
Nov 04 02:24:18.756708 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:18.756644    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:24:18.929938 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:18.929897    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:24:25.855624 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:25.855584    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"]
Nov 04 02:24:25.856050 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:25.855935    5722 cpu_manager.go:414] "containerMap: removing container" podUID="ac256e79-e51b-4fa5-96a0-5a6be1f1b43f" containerName="authorino"
Nov 04 02:24:25.856050 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:25.855947    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac256e79-e51b-4fa5-96a0-5a6be1f1b43f" containerName="authorino"
Nov 04 02:24:25.856050 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:25.855956    5722 cpu_manager.go:414] "containerMap: removing container" podUID="58087c70-ddd8-4cf5-a4ff-c8033efeb699" containerName="maas-api"
Nov 04 02:24:25.856050 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:25.855961    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58087c70-ddd8-4cf5-a4ff-c8033efeb699" containerName="maas-api"
Nov 04 02:24:25.856050 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:25.856045    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac256e79-e51b-4fa5-96a0-5a6be1f1b43f" containerName="authorino"
Nov 04 02:24:25.856050 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:25.856053    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="58087c70-ddd8-4cf5-a4ff-c8033efeb699" containerName="maas-api"
Nov 04 02:24:25.864053 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:25.864030    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"
Nov 04 02:24:25.919948 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:25.919910    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"]
Nov 04 02:24:25.968339 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:25.968294    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5plz\" (UniqueName: \"kubernetes.io/projected/0a669c84-a538-413e-8da1-99d0aa4e0d66-kube-api-access-k5plz\") pod \"llmisvc-controller-manager-6466c554d8-z6pgx\" (UID: \"0a669c84-a538-413e-8da1-99d0aa4e0d66\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"
Nov 04 02:24:25.968339 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:25.968341    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a669c84-a538-413e-8da1-99d0aa4e0d66-cert\") pod \"llmisvc-controller-manager-6466c554d8-z6pgx\" (UID: \"0a669c84-a538-413e-8da1-99d0aa4e0d66\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"
Nov 04 02:24:26.069281 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:26.069232    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5plz\" (UniqueName: \"kubernetes.io/projected/0a669c84-a538-413e-8da1-99d0aa4e0d66-kube-api-access-k5plz\") pod \"llmisvc-controller-manager-6466c554d8-z6pgx\" (UID: \"0a669c84-a538-413e-8da1-99d0aa4e0d66\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"
Nov 04 02:24:26.069281 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:26.069285    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a669c84-a538-413e-8da1-99d0aa4e0d66-cert\") pod \"llmisvc-controller-manager-6466c554d8-z6pgx\" (UID: \"0a669c84-a538-413e-8da1-99d0aa4e0d66\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"
Nov 04 02:24:26.072041 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:26.072011    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a669c84-a538-413e-8da1-99d0aa4e0d66-cert\") pod \"llmisvc-controller-manager-6466c554d8-z6pgx\" (UID: \"0a669c84-a538-413e-8da1-99d0aa4e0d66\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"
Nov 04 02:24:26.132501 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:26.132461    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5plz\" (UniqueName: \"kubernetes.io/projected/0a669c84-a538-413e-8da1-99d0aa4e0d66-kube-api-access-k5plz\") pod \"llmisvc-controller-manager-6466c554d8-z6pgx\" (UID: \"0a669c84-a538-413e-8da1-99d0aa4e0d66\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"
Nov 04 02:24:26.175672 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:26.175614    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"
Nov 04 02:24:26.552358 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:24:26.552326    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a669c84_a538_413e_8da1_99d0aa4e0d66.slice/crio-12669b7bb8a48a3f57fbb49325102e1de2343c67d7585f44d9be0b5e7db2d814 WatchSource:0}: Error finding container 12669b7bb8a48a3f57fbb49325102e1de2343c67d7585f44d9be0b5e7db2d814: Status 404 returned error can't find the container with id 12669b7bb8a48a3f57fbb49325102e1de2343c67d7585f44d9be0b5e7db2d814
Nov 04 02:24:26.555039 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:26.555013    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"]
Nov 04 02:24:26.712999 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:26.712964    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx" event={"ID":"0a669c84-a538-413e-8da1-99d0aa4e0d66","Type":"ContainerStarted","Data":"12669b7bb8a48a3f57fbb49325102e1de2343c67d7585f44d9be0b5e7db2d814"}
Nov 04 02:24:27.718965 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:27.718930    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx" event={"ID":"0a669c84-a538-413e-8da1-99d0aa4e0d66","Type":"ContainerStarted","Data":"f3d4c1db52f5f0c6a198d3c723a622bad55c0d190f15047490afb91158487101"}
Nov 04 02:24:27.719358 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:27.719047    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"
Nov 04 02:24:27.837938 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:27.837820    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx" podStartSLOduration=2.042188226 podStartE2EDuration="2.837804056s" totalImagesPullingTime="795.61583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:24:27.837617208 +0000 UTC m=+479.311154391" watchObservedRunningTime="2026-11-04 02:24:27.837804056 +0000 UTC m=+479.311341236"
Nov 04 02:24:40.610796 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:24:40.610753    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:24:52.781391 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:52.781350    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:24:58.725442 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:58.725407    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z6pgx"
Nov 04 02:24:58.896310 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:58.896273    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"]
Nov 04 02:24:58.896535 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:58.896512    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb" podUID="567530ce-29f0-4faa-b8d1-9692ea54716d" containerName="manager" containerID="cri-o://dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404" gracePeriod=30
Nov 04 02:24:59.151445 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.151413    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:24:59.165510 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.165486    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/567530ce-29f0-4faa-b8d1-9692ea54716d-kube-api-access-btgkq\" (UniqueName: \"kubernetes.io/projected/567530ce-29f0-4faa-b8d1-9692ea54716d-kube-api-access-btgkq\") pod \"567530ce-29f0-4faa-b8d1-9692ea54716d\" (UID: \"567530ce-29f0-4faa-b8d1-9692ea54716d\") "
Nov 04 02:24:59.167902 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.167877    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/567530ce-29f0-4faa-b8d1-9692ea54716d-kube-api-access-btgkq" pod "567530ce-29f0-4faa-b8d1-9692ea54716d" (UID: "567530ce-29f0-4faa-b8d1-9692ea54716d"). InnerVolumeSpecName "kube-api-access-btgkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:24:59.266725 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.266618    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/567530ce-29f0-4faa-b8d1-9692ea54716d-cert\" (UniqueName: \"kubernetes.io/secret/567530ce-29f0-4faa-b8d1-9692ea54716d-cert\") pod \"567530ce-29f0-4faa-b8d1-9692ea54716d\" (UID: \"567530ce-29f0-4faa-b8d1-9692ea54716d\") "
Nov 04 02:24:59.266891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.266861    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btgkq\" (UniqueName: \"kubernetes.io/projected/567530ce-29f0-4faa-b8d1-9692ea54716d-kube-api-access-btgkq\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:24:59.269066 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.269034    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/567530ce-29f0-4faa-b8d1-9692ea54716d-cert" pod "567530ce-29f0-4faa-b8d1-9692ea54716d" (UID: "567530ce-29f0-4faa-b8d1-9692ea54716d"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:24:59.367272 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.367233    5722 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/567530ce-29f0-4faa-b8d1-9692ea54716d-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:24:59.863015 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.862979    5722 generic.go:356] "Generic (PLEG): container finished" podID="567530ce-29f0-4faa-b8d1-9692ea54716d" containerID="dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404" exitCode=0
Nov 04 02:24:59.863483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.863033    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb" event={"ID":"567530ce-29f0-4faa-b8d1-9692ea54716d","Type":"ContainerDied","Data":"dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404"}
Nov 04 02:24:59.863483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.863036    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"
Nov 04 02:24:59.863483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.863099    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb" event={"ID":"567530ce-29f0-4faa-b8d1-9692ea54716d","Type":"ContainerDied","Data":"f22f50a3c55701ac9b1bff32ad70243ca2f0e83a9664ea2452887cf548ef368c"}
Nov 04 02:24:59.863483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.863121    5722 scope.go:122] "RemoveContainer" containerID="dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404"
Nov 04 02:24:59.871960 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.871941    5722 scope.go:122] "RemoveContainer" containerID="dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404"
Nov 04 02:24:59.872228 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:24:59.872212    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404\": container with ID starting with dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404 not found: ID does not exist" containerID="dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404"
Nov 04 02:24:59.872298 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:24:59.872236    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404"} err="failed to get container status \"dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404\": rpc error: code = NotFound desc = could not find container \"dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404\": container with ID starting with dbc092854b61c002baabc754ee6e85eee14e2c665426aa8bc042e646acfba404 not found: ID does not exist"
Nov 04 02:25:00.031022 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:00.030988    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"]
Nov 04 02:25:00.082416 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:00.082377    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-m5ppb"]
Nov 04 02:25:00.372070 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:00.372018    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:00.553006 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:00.552976    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:00.679927 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:00.679844    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="567530ce-29f0-4faa-b8d1-9692ea54716d" path="/var/lib/kubelet/pods/567530ce-29f0-4faa-b8d1-9692ea54716d/volumes"
Nov 04 02:25:07.268443 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:07.268371    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:07.434026 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:07.433922    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:10.610919 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:25:10.610875    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:25:32.019851 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:32.019811    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:32.593589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:32.593557    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:34.027932 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:34.027894    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:34.201958 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:34.201923    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:40.609001 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:25:40.608925    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:25:40.814601 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:40.814456    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:46.691351 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:46.691302    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:50.418780 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:50.418747    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:53.125675 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:53.125629    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:53.430840 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:53.430725    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:54.263091 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:54.263054    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:57.446521 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:57.446472    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:25:58.515544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:25:58.515489    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:01.772772 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:01.772723    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:01.940721 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:01.940681    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:02.123057 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:02.122992    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:05.312793 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:05.312756    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:08.844498 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:08.844432    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:09.401323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.401288    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"]
Nov 04 02:26:09.401623 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.401611    5722 cpu_manager.go:414] "containerMap: removing container" podUID="567530ce-29f0-4faa-b8d1-9692ea54716d" containerName="manager"
Nov 04 02:26:09.401706 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.401624    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="567530ce-29f0-4faa-b8d1-9692ea54716d" containerName="manager"
Nov 04 02:26:09.401769 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.401759    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="567530ce-29f0-4faa-b8d1-9692ea54716d" containerName="manager"
Nov 04 02:26:09.404874 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.404852    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.458827 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.458788    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gflvh\""
Nov 04 02:26:09.490466 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.490427    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.490634 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.490485    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bc54b7-153f-4641-9b43-4cef75875231-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.490634 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.490588    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bc54b7-153f-4641-9b43-4cef75875231-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.490634 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.490621    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.490836 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.490650    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.490836 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.490785    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.490939 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.490843    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.490939 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.490881    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97qrc\" (UniqueName: \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-kube-api-access-97qrc\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.491007 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.490943    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.511738 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.511694    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"]
Nov 04 02:26:09.592151 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592112    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592151 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592159    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592444 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592190    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592444 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592309    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97qrc\" (UniqueName: \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-kube-api-access-97qrc\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592444 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592353    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592444 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592396    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592650 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592455    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bc54b7-153f-4641-9b43-4cef75875231-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592650 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592499    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bc54b7-153f-4641-9b43-4cef75875231-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592650 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592526    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592650 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592621    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592870 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592642    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592870 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592777    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.592976 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.592907    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.593167 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.593136    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bc54b7-153f-4641-9b43-4cef75875231-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.594915 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.594892    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.595420 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.595401    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bc54b7-153f-4641-9b43-4cef75875231-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.655177 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.655104    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.655177 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.655169    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97qrc\" (UniqueName: \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-kube-api-access-97qrc\") pod \"maas-default-gateway-openshift-default-fd4b99879-24gct\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:09.718179 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:09.718135    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:10.136945 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:26:10.136909    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07bc54b7_153f_4641_9b43_4cef75875231.slice/crio-eba81cc89235c914c63f2cd68fc61543e9a160236473c013cfd889865c979583 WatchSource:0}: Error finding container eba81cc89235c914c63f2cd68fc61543e9a160236473c013cfd889865c979583: Status 404 returned error can't find the container with id eba81cc89235c914c63f2cd68fc61543e9a160236473c013cfd889865c979583
Nov 04 02:26:10.138631 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:10.138604    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"]
Nov 04 02:26:10.174552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:10.174506    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" event={"ID":"07bc54b7-153f-4641-9b43-4cef75875231","Type":"ContainerStarted","Data":"eba81cc89235c914c63f2cd68fc61543e9a160236473c013cfd889865c979583"}
Nov 04 02:26:10.610415 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:26:10.610300    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:26:14.437674 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:14.437629    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:26:14.438026 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:14.437727    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:26:14.438026 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:14.437764    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:26:15.200503 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:15.200465    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" event={"ID":"07bc54b7-153f-4641-9b43-4cef75875231","Type":"ContainerStarted","Data":"d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06"}
Nov 04 02:26:15.719204 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:15.719158    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:15.720756 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:15.720732    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-24gct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Nov 04 02:26:15.720879 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:15.720782    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" podUID="07bc54b7-153f-4641-9b43-4cef75875231" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Nov 04 02:26:16.719315 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:16.719278    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-24gct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Nov 04 02:26:16.719865 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:16.719340    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" podUID="07bc54b7-153f-4641-9b43-4cef75875231" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Nov 04 02:26:17.718870 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:17.718829    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-24gct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Nov 04 02:26:17.719058 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:17.718894    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" podUID="07bc54b7-153f-4641-9b43-4cef75875231" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Nov 04 02:26:18.719259 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:18.719224    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-24gct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Nov 04 02:26:18.719703 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:18.719280    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" podUID="07bc54b7-153f-4641-9b43-4cef75875231" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Nov 04 02:26:19.719368 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:19.719325    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-24gct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Nov 04 02:26:19.719832 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:19.719380    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" podUID="07bc54b7-153f-4641-9b43-4cef75875231" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Nov 04 02:26:20.719448 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:20.719407    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-24gct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Nov 04 02:26:20.720004 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:20.719471    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" podUID="07bc54b7-153f-4641-9b43-4cef75875231" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Nov 04 02:26:21.718765 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:21.718722    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-24gct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Nov 04 02:26:21.718956 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:21.718797    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" podUID="07bc54b7-153f-4641-9b43-4cef75875231" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Nov 04 02:26:23.212125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:23.212080    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:23.212619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:23.212487    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:23.213540 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:23.213516    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:26:23.388402 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:23.388327    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" podStartSLOduration=10.09173978 podStartE2EDuration="14.388313363s" totalImagesPullingTime="4.296573583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:26:15.376973741 +0000 UTC m=+586.850510924" watchObservedRunningTime="2026-11-04 02:26:23.388313363 +0000 UTC m=+594.861850640"
Nov 04 02:26:24.526456 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.526417    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"]
Nov 04 02:26:24.530390 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.530367    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.651435 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.651394    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.651640 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.651517    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.651640 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.651555    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.651640 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.651628    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6kwx\" (UniqueName: \"kubernetes.io/projected/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-kube-api-access-v6kwx\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.651851 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.651698    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.651851 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.651752    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.651851 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.651785    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.651851 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.651813    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.651989 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.651853    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.739621 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.739585    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"]
Nov 04 02:26:24.753320 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.753280    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6kwx\" (UniqueName: \"kubernetes.io/projected/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-kube-api-access-v6kwx\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.753524 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.753339    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.753524 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.753377    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.753524 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.753405    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.753524 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.753431    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.753524 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.753454    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.753524 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.753481    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.753877 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.753592    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.753877 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.753625    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.754123 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.754050    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.754547 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.754523    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.754633 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.754524    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.754858 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.754834    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.754916 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.754842    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.756441 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.756413    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.756937 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.756914    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.816592 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.816512    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.816819 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.816790    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6kwx\" (UniqueName: \"kubernetes.io/projected/bde9bff4-3d54-471d-ae04-e7fa835fb4e1-kube-api-access-v6kwx\") pod \"maas-default-gateway-openshift-default-fd4b99879-7r6mg\" (UID: \"bde9bff4-3d54-471d-ae04-e7fa835fb4e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:24.844452 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:24.844418    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:25.271861 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:26:25.271808    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde9bff4_3d54_471d_ae04_e7fa835fb4e1.slice/crio-ef09ec354483c697487492ae120c0f81bca9839d302e07c2ca5a4815278ba209 WatchSource:0}: Error finding container ef09ec354483c697487492ae120c0f81bca9839d302e07c2ca5a4815278ba209: Status 404 returned error can't find the container with id ef09ec354483c697487492ae120c0f81bca9839d302e07c2ca5a4815278ba209
Nov 04 02:26:25.272540 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:25.272514    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"]
Nov 04 02:26:25.275613 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:25.275577    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:26:25.275718 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:25.275673    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:26:25.275758 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:25.275720    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:26:26.248920 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:26.248883    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" event={"ID":"bde9bff4-3d54-471d-ae04-e7fa835fb4e1","Type":"ContainerStarted","Data":"9069981f909cde8ebf731ce9f6be027544592340d0fea0f753ee40d18a56a3e6"}
Nov 04 02:26:26.249360 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:26.248941    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" event={"ID":"bde9bff4-3d54-471d-ae04-e7fa835fb4e1","Type":"ContainerStarted","Data":"ef09ec354483c697487492ae120c0f81bca9839d302e07c2ca5a4815278ba209"}
Nov 04 02:26:26.426402 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:26.426339    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" podStartSLOduration=2.42632401 podStartE2EDuration="2.42632401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:26:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:26:26.425498669 +0000 UTC m=+597.899035853" watchObservedRunningTime="2026-11-04 02:26:26.42632401 +0000 UTC m=+597.899861191"
Nov 04 02:26:26.845442 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:26.845408    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:26.847055 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:26.847033    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-7r6mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 04 02:26:26.847122 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:26.847083    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" podUID="bde9bff4-3d54-471d-ae04-e7fa835fb4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 04 02:26:27.845130 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:27.845093    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-7r6mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 04 02:26:27.845553 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:27.845154    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" podUID="bde9bff4-3d54-471d-ae04-e7fa835fb4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 04 02:26:28.722568 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:28.722534    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:26:28.724447 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:28.724415    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:26:28.728825 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:28.728799    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:26:28.731392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:28.731369    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:26:28.845097 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:28.845059    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-7r6mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 04 02:26:28.845298 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:28.845119    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" podUID="bde9bff4-3d54-471d-ae04-e7fa835fb4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 04 02:26:29.845706 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:29.845644    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-7r6mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 04 02:26:29.846133 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:29.845739    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" podUID="bde9bff4-3d54-471d-ae04-e7fa835fb4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 04 02:26:30.845061 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:30.845021    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-7r6mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 04 02:26:30.845228 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:30.845073    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" podUID="bde9bff4-3d54-471d-ae04-e7fa835fb4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 04 02:26:31.845091 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:31.845045    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-7r6mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 04 02:26:31.845510 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:31.845120    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" podUID="bde9bff4-3d54-471d-ae04-e7fa835fb4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 04 02:26:32.845117 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:32.845074    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-7r6mg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Nov 04 02:26:32.845497 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:32.845135    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" podUID="bde9bff4-3d54-471d-ae04-e7fa835fb4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Nov 04 02:26:33.949351 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:33.949319    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:33.950056 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:33.950031    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:33.951130 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:33.951110    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg"
Nov 04 02:26:38.461013 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:38.460979    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:38.630199 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:38.630161    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:39.965350 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:39.965316    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:40.158686 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:40.158626    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:40.611111 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:26:40.611069    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:26:46.070116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:46.070072    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:46.247469 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:46.247428    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:26:53.485910 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:26:53.485873    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:03.517095 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:03.517044    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:10.611130 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:27:10.611038    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:27:18.931733 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:18.931687    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:19.098891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:19.098856    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:19.279412 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:19.279330    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:19.606781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:19.606678    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:19.983414 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:19.983375    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:20.157294 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:20.157254    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:20.330507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:20.330413    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:20.629962 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:20.629914    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:21.178377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:21.178339    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:22.549551 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:22.549506    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:22.760061 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:22.760019    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:24.031829 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:24.031775    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:24.221916 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:24.221875    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:24.403753 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:24.403723    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:24.858456 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:24.858366    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:25.136373 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:25.136335    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:25.325108 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:25.325050    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:25.591819 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:25.591712    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:25.815172 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:25.815138    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:25.992800 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:25.992765    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:26.688882 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:26.688845    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:26.924769 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:26.924716    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:27.233720 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:27.233686    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:27.811957 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:27.811915    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:28.001602 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:28.001573    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:28.202693 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:28.202624    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:28.376009 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:28.375965    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:31.028730 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:31.028689    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:31.208390 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:31.208335    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:31.382504 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:31.382470    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:31.553778 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:31.553741    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:33.075546 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:33.075501    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:33.254937 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:33.254899    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:35.569117 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:35.569087    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:35.746755 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:35.746722    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:36.524687 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:36.524622    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:36.818989 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:36.818887    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:37.015053 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:37.015015    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:37.205245 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:37.205088    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:37.419845 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:37.419816    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:37.594224 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:37.594137    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:38.217091 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.217058    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:38.391256 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.391220    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:38.578953 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.578868    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"]
Nov 04 02:27:38.582629 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.582609    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:27:38.636433 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.636402    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-2ba6b8\""
Nov 04 02:27:38.687782 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.687753    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-2ba6b8-dockercfg-rw8t9\""
Nov 04 02:27:38.689769 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.689582    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"]
Nov 04 02:27:38.694509 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.694473    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw\" (UID: \"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:27:38.694724 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.694646    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zndb\" (UniqueName: \"kubernetes.io/projected/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-kube-api-access-6zndb\") pod \"payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw\" (UID: \"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:27:38.788797 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.788760    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"]
Nov 04 02:27:38.792260 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.792240    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:27:38.795290 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.795264    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zndb\" (UniqueName: \"kubernetes.io/projected/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-kube-api-access-6zndb\") pod \"payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw\" (UID: \"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:27:38.795374 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.795335    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw\" (UID: \"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:27:38.796178 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.796156    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw\" (UID: \"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:27:38.863768 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.863555    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"]
Nov 04 02:27:38.868980 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.868954    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zndb\" (UniqueName: \"kubernetes.io/projected/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-kube-api-access-6zndb\") pod \"payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw\" (UID: \"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:27:38.896013 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.895977    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhqks\" (UniqueName: \"kubernetes.io/projected/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-kube-api-access-jhqks\") pod \"payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k\" (UID: \"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:27:38.896199 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.896053    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k\" (UID: \"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:27:38.896199 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.896065    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:27:38.997572 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.997527    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k\" (UID: \"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:27:38.997788 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.997631    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhqks\" (UniqueName: \"kubernetes.io/projected/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-kube-api-access-jhqks\") pod \"payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k\" (UID: \"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:27:38.998410 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:38.998389    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k\" (UID: \"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:27:39.061276 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:39.061241    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhqks\" (UniqueName: \"kubernetes.io/projected/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-kube-api-access-jhqks\") pod \"payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k\" (UID: \"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:27:39.105205 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:39.105164    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:27:39.263986 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:27:39.263949    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528302b1_eeb6_4a0b_8f8b_03ce2a1ba4d8.slice/crio-c2b060d3f3ee7228c0b594a798cfecda80d7213fdf873e33064308464e979d5c WatchSource:0}: Error finding container c2b060d3f3ee7228c0b594a798cfecda80d7213fdf873e33064308464e979d5c: Status 404 returned error can't find the container with id c2b060d3f3ee7228c0b594a798cfecda80d7213fdf873e33064308464e979d5c
Nov 04 02:27:39.265922 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:39.265898    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"]
Nov 04 02:27:39.266165 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:39.266150    5722 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:27:39.474725 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:27:39.474690    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39fdbf5d_c4a1_4a07_a9c2_f6f4f7a44c3a.slice/crio-93ac7258d87bfd15460a34492afde520467281a254277e8adcf0170c97ee3594 WatchSource:0}: Error finding container 93ac7258d87bfd15460a34492afde520467281a254277e8adcf0170c97ee3594: Status 404 returned error can't find the container with id 93ac7258d87bfd15460a34492afde520467281a254277e8adcf0170c97ee3594
Nov 04 02:27:39.476705 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:39.476590    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"]
Nov 04 02:27:39.597420 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:39.597378    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw" event={"ID":"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8","Type":"ContainerStarted","Data":"c2b060d3f3ee7228c0b594a798cfecda80d7213fdf873e33064308464e979d5c"}
Nov 04 02:27:39.598639 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:39.598606    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k" event={"ID":"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a","Type":"ContainerStarted","Data":"93ac7258d87bfd15460a34492afde520467281a254277e8adcf0170c97ee3594"}
Nov 04 02:27:40.613588 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:27:40.613548    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:27:42.616530 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:42.616488    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k" event={"ID":"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a","Type":"ContainerStarted","Data":"0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe"}
Nov 04 02:27:42.617105 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:42.616599    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:27:42.618244 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:42.618213    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw" event={"ID":"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8","Type":"ContainerStarted","Data":"1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3"}
Nov 04 02:27:42.618377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:42.618343    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:27:42.735945 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:42.735822    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k" podStartSLOduration=1.810974912 podStartE2EDuration="4.735808198s" totalImagesPullingTime="2.924833286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:42.735110273 +0000 UTC m=+674.208647479" watchObservedRunningTime="2026-11-04 02:27:42.735808198 +0000 UTC m=+674.209345376"
Nov 04 02:27:42.857465 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:42.857401    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw" podStartSLOduration=1.732266248 podStartE2EDuration="4.857382692s" totalImagesPullingTime="3.125116444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:42.853721993 +0000 UTC m=+674.327259177" watchObservedRunningTime="2026-11-04 02:27:42.857382692 +0000 UTC m=+674.330919873"
Nov 04 02:27:43.182922 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:43.182870    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:43.429121 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:43.429067    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:43.597412 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:43.597331    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:45.528855 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:45.528797    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:45.749477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:45.749438    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:45.916451 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:45.916409    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"]
Nov 04 02:27:45.920494 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:45.920460    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:27:46.025884 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.025826    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-a18c43-dockercfg-gvsmq\""
Nov 04 02:27:46.026148 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.025903    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-a18c43\""
Nov 04 02:27:46.027326 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.027304    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"]
Nov 04 02:27:46.066851 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.066810    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55h5b\" (UniqueName: \"kubernetes.io/projected/ba446fbb-6854-4e0a-b266-f8c561fa50fd-kube-api-access-55h5b\") pod \"payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4\" (UID: \"ba446fbb-6854-4e0a-b266-f8c561fa50fd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:27:46.066851 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.066857    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba446fbb-6854-4e0a-b266-f8c561fa50fd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4\" (UID: \"ba446fbb-6854-4e0a-b266-f8c561fa50fd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:27:46.078593 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.078555    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"]
Nov 04 02:27:46.082186 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.082158    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:27:46.150231 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.150189    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"]
Nov 04 02:27:46.168275 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.168148    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55h5b\" (UniqueName: \"kubernetes.io/projected/ba446fbb-6854-4e0a-b266-f8c561fa50fd-kube-api-access-55h5b\") pod \"payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4\" (UID: \"ba446fbb-6854-4e0a-b266-f8c561fa50fd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:27:46.168275 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.168205    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba446fbb-6854-4e0a-b266-f8c561fa50fd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4\" (UID: \"ba446fbb-6854-4e0a-b266-f8c561fa50fd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:27:46.169029 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.169008    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba446fbb-6854-4e0a-b266-f8c561fa50fd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4\" (UID: \"ba446fbb-6854-4e0a-b266-f8c561fa50fd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:27:46.232174 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.232141    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55h5b\" (UniqueName: \"kubernetes.io/projected/ba446fbb-6854-4e0a-b266-f8c561fa50fd-kube-api-access-55h5b\") pod \"payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4\" (UID: \"ba446fbb-6854-4e0a-b266-f8c561fa50fd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:27:46.234877 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.234848    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:27:46.269774 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.269714    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa754e81-71f0-4010-96ea-f4d5bccc33ac-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd\" (UID: \"aa754e81-71f0-4010-96ea-f4d5bccc33ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:27:46.270004 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.269911    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfb56\" (UniqueName: \"kubernetes.io/projected/aa754e81-71f0-4010-96ea-f4d5bccc33ac-kube-api-access-xfb56\") pod \"payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd\" (UID: \"aa754e81-71f0-4010-96ea-f4d5bccc33ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:27:46.371139 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.371102    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa754e81-71f0-4010-96ea-f4d5bccc33ac-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd\" (UID: \"aa754e81-71f0-4010-96ea-f4d5bccc33ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:27:46.371359 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.371168    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfb56\" (UniqueName: \"kubernetes.io/projected/aa754e81-71f0-4010-96ea-f4d5bccc33ac-kube-api-access-xfb56\") pod \"payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd\" (UID: \"aa754e81-71f0-4010-96ea-f4d5bccc33ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:27:46.371923 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.371882    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa754e81-71f0-4010-96ea-f4d5bccc33ac-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd\" (UID: \"aa754e81-71f0-4010-96ea-f4d5bccc33ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:27:46.434475 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.434357    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfb56\" (UniqueName: \"kubernetes.io/projected/aa754e81-71f0-4010-96ea-f4d5bccc33ac-kube-api-access-xfb56\") pod \"payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd\" (UID: \"aa754e81-71f0-4010-96ea-f4d5bccc33ac\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:27:46.448085 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.448049    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:27:46.610723 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:27:46.610684    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba446fbb_6854_4e0a_b266_f8c561fa50fd.slice/crio-7f8471db983eff02b6f680c20ea00591bb8276b36a32c941a6eacab6f7847c87 WatchSource:0}: Error finding container 7f8471db983eff02b6f680c20ea00591bb8276b36a32c941a6eacab6f7847c87: Status 404 returned error can't find the container with id 7f8471db983eff02b6f680c20ea00591bb8276b36a32c941a6eacab6f7847c87
Nov 04 02:27:46.613272 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.613246    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"]
Nov 04 02:27:46.640639 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.640606    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4" event={"ID":"ba446fbb-6854-4e0a-b266-f8c561fa50fd","Type":"ContainerStarted","Data":"7f8471db983eff02b6f680c20ea00591bb8276b36a32c941a6eacab6f7847c87"}
Nov 04 02:27:46.820267 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:27:46.820230    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa754e81_71f0_4010_96ea_f4d5bccc33ac.slice/crio-f3c979c0d4d79f0dd35470dd0e7ba7273667de12cc305fd5773ec9811d62b6d4 WatchSource:0}: Error finding container f3c979c0d4d79f0dd35470dd0e7ba7273667de12cc305fd5773ec9811d62b6d4: Status 404 returned error can't find the container with id f3c979c0d4d79f0dd35470dd0e7ba7273667de12cc305fd5773ec9811d62b6d4
Nov 04 02:27:46.822556 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:46.822531    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"]
Nov 04 02:27:47.646536 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:47.646495    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4" event={"ID":"ba446fbb-6854-4e0a-b266-f8c561fa50fd","Type":"ContainerStarted","Data":"284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b"}
Nov 04 02:27:47.647035 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:47.646620    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:27:47.648155 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:47.648129    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd" event={"ID":"aa754e81-71f0-4010-96ea-f4d5bccc33ac","Type":"ContainerStarted","Data":"f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4"}
Nov 04 02:27:47.648263 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:47.648170    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd" event={"ID":"aa754e81-71f0-4010-96ea-f4d5bccc33ac","Type":"ContainerStarted","Data":"f3c979c0d4d79f0dd35470dd0e7ba7273667de12cc305fd5773ec9811d62b6d4"}
Nov 04 02:27:47.648263 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:47.648255    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:27:47.766139 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:47.766081    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4" podStartSLOduration=2.766067575 podStartE2EDuration="2.766067575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:47.76477751 +0000 UTC m=+679.238314692" watchObservedRunningTime="2026-11-04 02:27:47.766067575 +0000 UTC m=+679.239604756"
Nov 04 02:27:47.887575 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:47.887512    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd" podStartSLOduration=1.887496944 podStartE2EDuration="1.887496944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:47.88594667 +0000 UTC m=+679.359483856" watchObservedRunningTime="2026-11-04 02:27:47.887496944 +0000 UTC m=+679.361034125"
Nov 04 02:27:48.821003 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:48.820929    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:53.626186 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:53.626158    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:27:53.626711 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:53.626316    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:27:53.856197 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:53.855970    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:53.963269 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:53.963178    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"]
Nov 04 02:27:53.967035 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:53.967010    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.021374 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.021324    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:27:54.021797 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.021452    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 04 02:27:54.021797 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.021448    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:27:54.021797 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.021450    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-plfvj\""
Nov 04 02:27:54.021797 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.021498    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-a18c43-serving-cert\""
Nov 04 02:27:54.027294 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.027259    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"]
Nov 04 02:27:54.050612 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.050572    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-maas-api-tls\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.050813 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.050644    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmc6m\" (UniqueName: \"kubernetes.io/projected/7036e465-2346-4f87-9040-5025d4d786f4-kube-api-access-lmc6m\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.050858 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.050832    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7036e465-2346-4f87-9040-5025d4d786f4-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.050904 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.050888    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-metrics-certs\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.151713 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.151648    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-metrics-certs\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.151926 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.151727    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-maas-api-tls\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.151926 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.151757    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmc6m\" (UniqueName: \"kubernetes.io/projected/7036e465-2346-4f87-9040-5025d4d786f4-kube-api-access-lmc6m\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.151926 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.151799    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7036e465-2346-4f87-9040-5025d4d786f4-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.151926 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:27:54.151894    5722 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-serving-cert: secret "maas-api-e2e-worker-w1-a18c43-serving-cert" not found
Nov 04 02:27:54.152222 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:27:54.151977    5722 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-maas-api-tls podName:7036e465-2346-4f87-9040-5025d4d786f4 nodeName:}" failed. No retries permitted until 2026-11-04 02:27:54.651954142 +0000 UTC m=+686.125491302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-maas-api-tls") pod "maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8" (UID: "7036e465-2346-4f87-9040-5025d4d786f4") : secret "maas-api-e2e-worker-w1-a18c43-serving-cert" not found
Nov 04 02:27:54.152446 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.152427    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7036e465-2346-4f87-9040-5025d4d786f4-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.154400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.154379    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-metrics-certs\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.197612 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.197567    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:54.215924 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.215853    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmc6m\" (UniqueName: \"kubernetes.io/projected/7036e465-2346-4f87-9040-5025d4d786f4-kube-api-access-lmc6m\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.387274 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.387236    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:54.579028 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.578938    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:54.657163 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.657125    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-maas-api-tls\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.660028 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.660002    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-maas-api-tls\") pod \"maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:54.883717 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:54.883647    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:55.257300 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:27:55.257261    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7036e465_2346_4f87_9040_5025d4d786f4.slice/crio-551fa3ad34bb9603d6c79e8d3ac20e64521f090c17b149f20e973943a763f3d8 WatchSource:0}: Error finding container 551fa3ad34bb9603d6c79e8d3ac20e64521f090c17b149f20e973943a763f3d8: Status 404 returned error can't find the container with id 551fa3ad34bb9603d6c79e8d3ac20e64521f090c17b149f20e973943a763f3d8
Nov 04 02:27:55.259179 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:55.259152    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"]
Nov 04 02:27:55.687031 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:55.686986    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8" event={"ID":"7036e465-2346-4f87-9040-5025d4d786f4","Type":"ContainerStarted","Data":"551fa3ad34bb9603d6c79e8d3ac20e64521f090c17b149f20e973943a763f3d8"}
Nov 04 02:27:56.693004 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:56.692960    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8" event={"ID":"7036e465-2346-4f87-9040-5025d4d786f4","Type":"ContainerStarted","Data":"f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be"}
Nov 04 02:27:56.693418 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:56.693057    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:27:56.814397 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:56.814340    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8" podStartSLOduration=2.856555281 podStartE2EDuration="3.814322483s" totalImagesPullingTime="957.767202ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:56.813339966 +0000 UTC m=+688.286877145" watchObservedRunningTime="2026-11-04 02:27:56.814322483 +0000 UTC m=+688.287859664"
Nov 04 02:27:58.656466 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:58.656434    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:27:58.656900 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:58.656504    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:27:59.697628 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:59.697585    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:27:59.877209 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:27:59.877168    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:00.215148 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:00.215060    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:02.703341 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:02.703303    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:28:05.284082 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:05.284040    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:10.611093 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:28:10.611052    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:28:10.694241 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:10.694200    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:15.356310 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:15.356273    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:16.000805 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:16.000768    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:16.177285 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:16.177241    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:16.405627 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:16.405584    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:18.856406 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:18.856370    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:20.632190 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:20.632152    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:21.233538 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:21.233499    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:21.426330 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:21.426292    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:21.603602 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:21.603506    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:22.274846 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:22.274803    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:24.652176 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:24.652133    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:25.266111 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:25.266076    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:25.451295 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:25.451254    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:28.179584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:28.179544    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:33.577089 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:33.577052    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:37.790613 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:37.790532    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:38.459525 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:38.459488    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:38.633321 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:38.633265    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:39.384031 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:39.383995    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:40.612555 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:28:40.612516    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:28:42.012348 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.012298    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"]
Nov 04 02:28:42.015827 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.015806    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.121149 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.121109    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-1e4f1e\"/\"openshift-service-ca.crt\""
Nov 04 02:28:42.121149 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.121109    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-1e4f1e\"/\"kube-root-ca.crt\""
Nov 04 02:28:42.121405 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.121157    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-1e4f1e\"/\"default-dockercfg-r8j7p\""
Nov 04 02:28:42.121405 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.121279    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-1e4f1e\"/\"simulator-w2-1e4f1e-kserve-self-signed-certs\""
Nov 04 02:28:42.122615 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.122592    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"]
Nov 04 02:28:42.122999 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.122979    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bzgg\" (UniqueName: \"kubernetes.io/projected/040a0d41-ab1b-4057-aea0-dda9cecf3f21-kube-api-access-7bzgg\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.123038 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.123012    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-home\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.123038 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.123033    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-model-cache\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.123112 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.123099    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tls-certs\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.123224 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.123209    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-dshm\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.123261 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.123247    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tmp-dir\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.131433 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.131397    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:42.223732 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.223690    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-dshm\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.223732 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.223736    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tmp-dir\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.224013 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.223801    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bzgg\" (UniqueName: \"kubernetes.io/projected/040a0d41-ab1b-4057-aea0-dda9cecf3f21-kube-api-access-7bzgg\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.224013 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.223822    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-home\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.224013 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.223846    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-model-cache\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.224013 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.223890    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tls-certs\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.224277 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.224252    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tmp-dir\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.224387 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.224309    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-home\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.224387 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.224319    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-model-cache\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.227039 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.226999    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-dshm\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.227264 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.227245    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tls-certs\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.289503 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.289419    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bzgg\" (UniqueName: \"kubernetes.io/projected/040a0d41-ab1b-4057-aea0-dda9cecf3f21-kube-api-access-7bzgg\") pod \"simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") " pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.339722 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.339672    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:42.721999 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:28:42.721968    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod040a0d41_ab1b_4057_aea0_dda9cecf3f21.slice/crio-7d82e874fe9083439b8ef74219729ba78f20ceb441629d843e0c2e4e6bb9b84f WatchSource:0}: Error finding container 7d82e874fe9083439b8ef74219729ba78f20ceb441629d843e0c2e4e6bb9b84f: Status 404 returned error can't find the container with id 7d82e874fe9083439b8ef74219729ba78f20ceb441629d843e0c2e4e6bb9b84f
Nov 04 02:28:42.723990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.723954    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"]
Nov 04 02:28:42.913198 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:42.913162    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn" event={"ID":"040a0d41-ab1b-4057-aea0-dda9cecf3f21","Type":"ContainerStarted","Data":"7d82e874fe9083439b8ef74219729ba78f20ceb441629d843e0c2e4e6bb9b84f"}
Nov 04 02:28:43.002459 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:43.002370    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:43.658967 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:43.658923    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:43.842797 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:43.842753    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:44.929253 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:44.929211    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn" event={"ID":"040a0d41-ab1b-4057-aea0-dda9cecf3f21","Type":"ContainerStarted","Data":"166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02"}
Nov 04 02:28:45.049920 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.049852    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn" podStartSLOduration=2.467040711 podStartE2EDuration="4.049833008s" totalImagesPullingTime="1.582792297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:28:45.048761424 +0000 UTC m=+736.522298605" watchObservedRunningTime="2026-11-04 02:28:45.049833008 +0000 UTC m=+736.523370195"
Nov 04 02:28:45.111075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.111036    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:45.340612 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.340525    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:45.433965 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.433929    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"]
Nov 04 02:28:45.437596 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.437574    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.459927 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.459887    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slbn6\" (UniqueName: \"kubernetes.io/projected/4c6334f2-998f-43bb-8342-ac444013c6b3-kube-api-access-slbn6\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.460102 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.459938    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-model-cache\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.460102 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.459996    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c6334f2-998f-43bb-8342-ac444013c6b3-tls-certs\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.460177 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.460125    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-home\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.460210 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.460176    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-dshm\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.460251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.460221    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-tmp-dir\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.491468 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.491431    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-ab53c1\"/\"default-dockercfg-z9nv6\""
Nov 04 02:28:45.496120 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.495882    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-ab53c1\"/\"simulator-w4-ab53c1-kserve-self-signed-certs\""
Nov 04 02:28:45.542698 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.542644    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-ab53c1\"/\"openshift-service-ca.crt\""
Nov 04 02:28:45.542897 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.542720    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-ab53c1\"/\"kube-root-ca.crt\""
Nov 04 02:28:45.544025 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.544002    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"]
Nov 04 02:28:45.549885 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.549855    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:45.560764 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.560719    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-home\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.560764 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.560769    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-dshm\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.560996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.560805    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-tmp-dir\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.560996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.560872    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slbn6\" (UniqueName: \"kubernetes.io/projected/4c6334f2-998f-43bb-8342-ac444013c6b3-kube-api-access-slbn6\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.560996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.560895    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-model-cache\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.560996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.560916    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c6334f2-998f-43bb-8342-ac444013c6b3-tls-certs\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.561231 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.561201    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-home\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.561472 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.561449    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-tmp-dir\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.561593 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.561540    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-model-cache\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.563604 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.563582    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-dshm\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.564054 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.564033    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c6334f2-998f-43bb-8342-ac444013c6b3-tls-certs\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.624071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.624035    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slbn6\" (UniqueName: \"kubernetes.io/projected/4c6334f2-998f-43bb-8342-ac444013c6b3-kube-api-access-slbn6\") pod \"simulator-w4-ab53c1-kserve-5f8f499966-524nc\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") " pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:45.750394 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:45.750349    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:46.131334 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:28:46.131299    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c6334f2_998f_43bb_8342_ac444013c6b3.slice/crio-8d9d9c28f59fcfd77e2759ac557135384171afd7a103def93dae6d202e8e106e WatchSource:0}: Error finding container 8d9d9c28f59fcfd77e2759ac557135384171afd7a103def93dae6d202e8e106e: Status 404 returned error can't find the container with id 8d9d9c28f59fcfd77e2759ac557135384171afd7a103def93dae6d202e8e106e
Nov 04 02:28:46.134129 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:46.134100    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"]
Nov 04 02:28:46.940318 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:46.940276    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc" event={"ID":"4c6334f2-998f-43bb-8342-ac444013c6b3","Type":"ContainerStarted","Data":"02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5"}
Nov 04 02:28:46.940509 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:46.940328    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc" event={"ID":"4c6334f2-998f-43bb-8342-ac444013c6b3","Type":"ContainerStarted","Data":"8d9d9c28f59fcfd77e2759ac557135384171afd7a103def93dae6d202e8e106e"}
Nov 04 02:28:47.061172 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:47.061119    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc" podStartSLOduration=2.061106197 podStartE2EDuration="2.061106197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:28:47.060010366 +0000 UTC m=+738.533547549" watchObservedRunningTime="2026-11-04 02:28:47.061106197 +0000 UTC m=+738.534643380"
Nov 04 02:28:47.751379 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:47.751334    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:50.490859 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:50.490822    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:52.339879 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:52.339830    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:52.353012 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:52.352983    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:52.502850 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:52.502806    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:52.979934 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:52.979900    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:28:54.205056 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:54.204976    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:54.476207 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:54.476105    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:55.750886 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:55.750845    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:55.764096 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:55.764058    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:28:55.901175 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:55.901119    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:28:55.999867 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:28:55.997775    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:29:01.395075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:01.395033    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:06.791982 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:06.791941    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:10.610348 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:29:10.610305    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:29:12.169877 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:12.169841    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:17.187429 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:17.187393    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:17.595634 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:17.595547    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:20.097047 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.097004    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"]
Nov 04 02:29:20.100933 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.100909    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.158982 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.158948    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-2ba6b8\"/\"kube-root-ca.crt\""
Nov 04 02:29:20.202022 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.201985    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-model-cache\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.202022 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.202030    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-tmp-dir\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.202288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.202049    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-home\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.202288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.202177    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-dshm\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.202288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.202234    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8510d5a9-b444-4d2f-8a07-e0790770a68c-tls-certs\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.202288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.202269    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bns8s\" (UniqueName: \"kubernetes.io/projected/8510d5a9-b444-4d2f-8a07-e0790770a68c-kube-api-access-bns8s\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.206286 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.206265    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2ba6b8\"/\"default-dockercfg-qxp8p\""
Nov 04 02:29:20.206286 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.206267    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-2ba6b8\"/\"openshift-service-ca.crt\""
Nov 04 02:29:20.206419 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.206323    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2ba6b8\"/\"simulator-w0-2ba6b8-kserve-self-signed-certs\""
Nov 04 02:29:20.207944 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.207920    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"]
Nov 04 02:29:20.219911 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.219880    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:20.303102 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.303064    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-model-cache\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.303102 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.303107    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-tmp-dir\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.303371 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.303136    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-home\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.303371 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.303166    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-dshm\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.303371 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.303194    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8510d5a9-b444-4d2f-8a07-e0790770a68c-tls-certs\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.303371 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.303226    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bns8s\" (UniqueName: \"kubernetes.io/projected/8510d5a9-b444-4d2f-8a07-e0790770a68c-kube-api-access-bns8s\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.303595 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.303575    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-model-cache\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.303689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.303620    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-tmp-dir\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.303689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.303633    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-home\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.306009 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.305973    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-dshm\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.306172 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.306151    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8510d5a9-b444-4d2f-8a07-e0790770a68c-tls-certs\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.370554 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.370513    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bns8s\" (UniqueName: \"kubernetes.io/projected/8510d5a9-b444-4d2f-8a07-e0790770a68c-kube-api-access-bns8s\") pod \"simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") " pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.412323 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.412276    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:20.789062 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:29:20.788797    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8510d5a9_b444_4d2f_8a07_e0790770a68c.slice/crio-dc5cb23bafb897f42679180998605798cceca325fd28954087930034cc26ae37 WatchSource:0}: Error finding container dc5cb23bafb897f42679180998605798cceca325fd28954087930034cc26ae37: Status 404 returned error can't find the container with id dc5cb23bafb897f42679180998605798cceca325fd28954087930034cc26ae37
Nov 04 02:29:20.790565 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:20.790540    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"]
Nov 04 02:29:21.106574 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:21.106472    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf" event={"ID":"8510d5a9-b444-4d2f-8a07-e0790770a68c","Type":"ContainerStarted","Data":"502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c"}
Nov 04 02:29:21.106574 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:21.106521    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf" event={"ID":"8510d5a9-b444-4d2f-8a07-e0790770a68c","Type":"ContainerStarted","Data":"dc5cb23bafb897f42679180998605798cceca325fd28954087930034cc26ae37"}
Nov 04 02:29:21.227169 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:21.227117    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf" podStartSLOduration=1.227102088 podStartE2EDuration="1.227102088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:29:21.226431081 +0000 UTC m=+772.699968262" watchObservedRunningTime="2026-11-04 02:29:21.227102088 +0000 UTC m=+772.700639269"
Nov 04 02:29:21.413147 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:21.413098    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:22.983220 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:22.983182    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:28.387330 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:28.387293    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:30.412518 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:30.412478    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:30.425562 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:30.425531    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:31.164784 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:31.164754    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:29:32.796442 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:32.796405    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:33.867591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:33.867554    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:38.473328 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:38.473271    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:39.289148 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:39.289071    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:40.610643 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:29:40.610594    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:29:44.665214 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:44.665184    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:49.995798 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:49.995762    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:54.555421 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:54.555390    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:55.374249 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:55.374194    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:56.771924 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.771885    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"]
Nov 04 02:29:56.775551 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.775534    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.861225 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.861185    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-dshm\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.861225 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.861228    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbm4f\" (UniqueName: \"kubernetes.io/projected/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-kube-api-access-bbm4f\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.861483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.861254    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-model-cache\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.861483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.861338    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tmp-dir\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.861597 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.861510    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tls-certs\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.861597 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.861580    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-home\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.880803 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.880775    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-ab53c1\"/\"premium-w4-ab53c1-kserve-self-signed-certs\""
Nov 04 02:29:56.882247 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.882222    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"]
Nov 04 02:29:56.883766 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.883743    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:29:56.962605 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.962574    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-dshm\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.962823 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.962610    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbm4f\" (UniqueName: \"kubernetes.io/projected/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-kube-api-access-bbm4f\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.962823 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.962637    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-model-cache\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.962823 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.962672    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tmp-dir\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.962823 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.962715    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tls-certs\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.962823 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.962772    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-home\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.963174 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.963147    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tmp-dir\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.963243 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.963181    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-model-cache\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.963243 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.963195    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-home\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.965246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.965225    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-dshm\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:56.965576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:56.965551    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tls-certs\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:57.025869 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:57.025795    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbm4f\" (UniqueName: \"kubernetes.io/projected/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-kube-api-access-bbm4f\") pod \"premium-w4-ab53c1-kserve-699646b667-gzrcm\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") " pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:57.086622 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:57.086583    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:29:57.489734 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:29:57.489633    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb95a5b9c_ce7e_4b47_87e5_5f4bf2ede552.slice/crio-5132f5e51fe37ef73266d3d65c6d45411e75f8f2c94e5500749d0be39b334697 WatchSource:0}: Error finding container 5132f5e51fe37ef73266d3d65c6d45411e75f8f2c94e5500749d0be39b334697: Status 404 returned error can't find the container with id 5132f5e51fe37ef73266d3d65c6d45411e75f8f2c94e5500749d0be39b334697
Nov 04 02:29:57.491231 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:57.491210    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"]
Nov 04 02:29:58.286174 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:58.286135    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm" event={"ID":"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552","Type":"ContainerStarted","Data":"d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f"}
Nov 04 02:29:58.286566 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:58.286184    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm" event={"ID":"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552","Type":"ContainerStarted","Data":"5132f5e51fe37ef73266d3d65c6d45411e75f8f2c94e5500749d0be39b334697"}
Nov 04 02:29:58.406845 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:58.406773    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm" podStartSLOduration=2.406756982 podStartE2EDuration="2.406756982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:29:58.405988859 +0000 UTC m=+809.879526041" watchObservedRunningTime="2026-11-04 02:29:58.406756982 +0000 UTC m=+809.880294164"
Nov 04 02:29:59.086776 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:29:59.086742    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:30:00.177229 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.177191    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"]
Nov 04 02:30:00.180858 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.180829    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"]
Nov 04 02:30:00.181017 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.180958    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"
Nov 04 02:30:00.184604 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.184579    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"
Nov 04 02:30:00.235447 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.235422    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:30:00.282478 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.282445    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"]
Nov 04 02:30:00.288264 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.288232    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"]
Nov 04 02:30:00.297529 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.297502    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h\" (UID: \"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"
Nov 04 02:30:00.297798 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.297677    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79kkx\" (UniqueName: \"kubernetes.io/projected/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-kube-api-access-79kkx\") pod \"maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h\" (UID: \"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"
Nov 04 02:30:00.297798 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.297733    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895990-x4tnm\" (UID: \"82a7ba8a-8013-4bb7-b881-e644cc7b72ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"
Nov 04 02:30:00.297798 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.297771    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzxl4\" (UniqueName: \"kubernetes.io/projected/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-kube-api-access-kzxl4\") pod \"maas-api-key-cleanup-29895990-x4tnm\" (UID: \"82a7ba8a-8013-4bb7-b881-e644cc7b72ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"
Nov 04 02:30:00.399113 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.399075    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895990-x4tnm\" (UID: \"82a7ba8a-8013-4bb7-b881-e644cc7b72ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"
Nov 04 02:30:00.399321 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.399120    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzxl4\" (UniqueName: \"kubernetes.io/projected/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-kube-api-access-kzxl4\") pod \"maas-api-key-cleanup-29895990-x4tnm\" (UID: \"82a7ba8a-8013-4bb7-b881-e644cc7b72ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"
Nov 04 02:30:00.399321 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.399203    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h\" (UID: \"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"
Nov 04 02:30:00.399321 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.399306    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79kkx\" (UniqueName: \"kubernetes.io/projected/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-kube-api-access-79kkx\") pod \"maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h\" (UID: \"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"
Nov 04 02:30:00.399848 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.399827    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895990-x4tnm\" (UID: \"82a7ba8a-8013-4bb7-b881-e644cc7b72ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"
Nov 04 02:30:00.399924 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.399858    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h\" (UID: \"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"
Nov 04 02:30:00.462465 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.462386    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzxl4\" (UniqueName: \"kubernetes.io/projected/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-kube-api-access-kzxl4\") pod \"maas-api-key-cleanup-29895990-x4tnm\" (UID: \"82a7ba8a-8013-4bb7-b881-e644cc7b72ca\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"
Nov 04 02:30:00.462465 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.462395    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79kkx\" (UniqueName: \"kubernetes.io/projected/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-kube-api-access-79kkx\") pod \"maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h\" (UID: \"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"
Nov 04 02:30:00.515608 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.515571    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"
Nov 04 02:30:00.521798 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.521769    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"
Nov 04 02:30:00.791136 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.791060    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:00.891174 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:30:00.891144    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a7ba8a_8013_4bb7_b881_e644cc7b72ca.slice/crio-702a4be7751d9d08beffd95f62aca5a9b7af28ec4aa52950bac049a5d3e9e1b6 WatchSource:0}: Error finding container 702a4be7751d9d08beffd95f62aca5a9b7af28ec4aa52950bac049a5d3e9e1b6: Status 404 returned error can't find the container with id 702a4be7751d9d08beffd95f62aca5a9b7af28ec4aa52950bac049a5d3e9e1b6
Nov 04 02:30:00.894146 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.894121    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"]
Nov 04 02:30:00.938078 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:30:00.938036    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e99fa5_7315_4674_b8dd_3e3f5b2e5b98.slice/crio-d3a714f20a2dde14b86c0eba6eb72679f35cf15b7caaf0ef098be9467728e4d8 WatchSource:0}: Error finding container d3a714f20a2dde14b86c0eba6eb72679f35cf15b7caaf0ef098be9467728e4d8: Status 404 returned error can't find the container with id d3a714f20a2dde14b86c0eba6eb72679f35cf15b7caaf0ef098be9467728e4d8
Nov 04 02:30:00.940873 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:00.940836    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"]
Nov 04 02:30:01.302370 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:01.302322    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm" event={"ID":"82a7ba8a-8013-4bb7-b881-e644cc7b72ca","Type":"ContainerStarted","Data":"702a4be7751d9d08beffd95f62aca5a9b7af28ec4aa52950bac049a5d3e9e1b6"}
Nov 04 02:30:01.303615 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:01.303593    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" event={"ID":"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98","Type":"ContainerStarted","Data":"d3a714f20a2dde14b86c0eba6eb72679f35cf15b7caaf0ef098be9467728e4d8"}
Nov 04 02:30:04.857632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:04.856771    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"]
Nov 04 02:30:04.863138 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:04.863110    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:04.969166 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:04.969137    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-a18c43\"/\"openshift-service-ca.crt\""
Nov 04 02:30:04.969166 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:04.969138    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-a18c43\"/\"kube-root-ca.crt\""
Nov 04 02:30:04.969430 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:04.969315    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-a18c43\"/\"premium-w1-a18c43-kserve-self-signed-certs\""
Nov 04 02:30:04.969430 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:04.969409    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-a18c43\"/\"default-dockercfg-zbmrg\""
Nov 04 02:30:04.971612 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:04.971585    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"]
Nov 04 02:30:04.973828 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:04.973806    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:05.041922 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.041884    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6qqg\" (UniqueName: \"kubernetes.io/projected/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-kube-api-access-z6qqg\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.042130 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.041957    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-dshm\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.042130 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.042015    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tls-certs\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.042240 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.042146    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tmp-dir\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.042240 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.042218    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-model-cache\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.042314 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.042254    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-home\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.144377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.143728    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-dshm\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.144377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.143784    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tls-certs\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.144377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.143838    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tmp-dir\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.144377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.143877    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-model-cache\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.144377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.143909    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-home\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.144377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.143993    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6qqg\" (UniqueName: \"kubernetes.io/projected/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-kube-api-access-z6qqg\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.144377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.144247    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tmp-dir\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.144377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.144347    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-model-cache\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.145130 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.144541    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-home\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.159799 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.159740    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tls-certs\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.168992 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.168901    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-dshm\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.209203 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.209127    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6qqg\" (UniqueName: \"kubernetes.io/projected/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-kube-api-access-z6qqg\") pod \"premium-w1-a18c43-kserve-6c9f9c4b7-skvsw\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") " pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.409561 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.409447    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"]
Nov 04 02:30:05.418289 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.417865    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.475948 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.475911    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-1e4f1e-openshift-default-dockercfg-rnr9f\""
Nov 04 02:30:05.481157 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.481117    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:05.514182 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.514144    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"]
Nov 04 02:30:05.552591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.552240    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.552591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.552281    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.552591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.552306    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.552591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.552360    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.552591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.552411    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94x89\" (UniqueName: \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-kube-api-access-94x89\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.552591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.552450    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.552591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.552473    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.552591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.552548    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.552591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.552595    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.653887 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.653851    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.653887 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.653887    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.654109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.653914    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.654109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.653964    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.654109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.654024    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94x89\" (UniqueName: \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-kube-api-access-94x89\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.654109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.654058    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.654109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.654083    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.654305 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.654140    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.654305 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.654170    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.654305 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.654259    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.654618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.654592    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.654776 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.654757    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.655008 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.654809    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.655008 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.654935    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.656599 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.656577    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.657262 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.657239    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.717604 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.717519    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.717807 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.717789    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94x89\" (UniqueName: \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-kube-api-access-94x89\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.740828 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.740808    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:05.875750 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:05.875717    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"]
Nov 04 02:30:05.963150 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:30:05.963111    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3c7933f_6883_4ccc_8fa3_d33c5b896f7a.slice/crio-e1bdbffa21baa3b8ee71ee73ef5a19c05332a81017d414a60b30fd73b9c7973e WatchSource:0}: Error finding container e1bdbffa21baa3b8ee71ee73ef5a19c05332a81017d414a60b30fd73b9c7973e: Status 404 returned error can't find the container with id e1bdbffa21baa3b8ee71ee73ef5a19c05332a81017d414a60b30fd73b9c7973e
Nov 04 02:30:06.122184 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:30:06.122128    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab09ed0d_6616_4ca0_87b0_c200dcdd5920.slice/crio-72e2c4edc23f1a9cf667e8985e7926384a9e71265d50b0c3014786e6a9386f04 WatchSource:0}: Error finding container 72e2c4edc23f1a9cf667e8985e7926384a9e71265d50b0c3014786e6a9386f04: Status 404 returned error can't find the container with id 72e2c4edc23f1a9cf667e8985e7926384a9e71265d50b0c3014786e6a9386f04
Nov 04 02:30:06.123427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.123400    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"]
Nov 04 02:30:06.124952 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.124915    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:30:06.125052 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.125016    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:30:06.125097 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.125060    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:30:06.301226 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.301148    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:06.340737 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.340703    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" event={"ID":"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98","Type":"ContainerStarted","Data":"dc93792b7c486525d84384e17f37e1e37cb6c20805bc74452a2fd29dbb599101"}
Nov 04 02:30:06.342370 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.342344    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5" event={"ID":"ab09ed0d-6616-4ca0-87b0-c200dcdd5920","Type":"ContainerStarted","Data":"aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b"}
Nov 04 02:30:06.342520 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.342383    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5" event={"ID":"ab09ed0d-6616-4ca0-87b0-c200dcdd5920","Type":"ContainerStarted","Data":"72e2c4edc23f1a9cf667e8985e7926384a9e71265d50b0c3014786e6a9386f04"}
Nov 04 02:30:06.344015 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.343989    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw" event={"ID":"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a","Type":"ContainerStarted","Data":"54c3734c18d27a42b875bf4d1cd21852fe4482c395d649c05d46f358b9977875"}
Nov 04 02:30:06.344136 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.344025    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw" event={"ID":"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a","Type":"ContainerStarted","Data":"e1bdbffa21baa3b8ee71ee73ef5a19c05332a81017d414a60b30fd73b9c7973e"}
Nov 04 02:30:06.459973 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.459915    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" podStartSLOduration=1.65873636 podStartE2EDuration="6.45989786s" totalImagesPullingTime="4.8011615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:30:06.458609348 +0000 UTC m=+817.932146529" watchObservedRunningTime="2026-11-04 02:30:06.45989786 +0000 UTC m=+817.933435043"
Nov 04 02:30:06.481429 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.481402    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:06.708713 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.708626    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5" podStartSLOduration=1.7074893420000001 podStartE2EDuration="1.707489342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:30:06.706881564 +0000 UTC m=+818.180418746" watchObservedRunningTime="2026-11-04 02:30:06.707489342 +0000 UTC m=+818.181026526"
Nov 04 02:30:06.710338 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.710293    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw" podStartSLOduration=2.710275428 podStartE2EDuration="2.710275428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:30:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:30:06.580216487 +0000 UTC m=+818.053753667" watchObservedRunningTime="2026-11-04 02:30:06.710275428 +0000 UTC m=+818.183812611"
Nov 04 02:30:06.741368 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:06.741336    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:07.086990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:07.086952    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:30:07.100564 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:07.100538    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:30:07.350423 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:07.350301    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm" event={"ID":"82a7ba8a-8013-4bb7-b881-e644cc7b72ca","Type":"ContainerStarted","Data":"a94d2935c4e3788e3c6d01f46af9962284b948ee2b6322e94cc10881197ce43c"}
Nov 04 02:30:07.351841 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:07.351805    5722 generic.go:356] "Generic (PLEG): container finished" podID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerID="dc93792b7c486525d84384e17f37e1e37cb6c20805bc74452a2fd29dbb599101" exitCode=60
Nov 04 02:30:07.351944 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:07.351887    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" event={"ID":"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98","Type":"ContainerDied","Data":"dc93792b7c486525d84384e17f37e1e37cb6c20805bc74452a2fd29dbb599101"}
Nov 04 02:30:07.352111 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:07.352094    5722 scope.go:122] "RemoveContainer" containerID="dc93792b7c486525d84384e17f37e1e37cb6c20805bc74452a2fd29dbb599101"
Nov 04 02:30:07.391974 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:07.391942    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:30:07.479973 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:07.477397    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm" podStartSLOduration=1.9718417590000001 podStartE2EDuration="7.477378976s" totalImagesPullingTime="5.505537217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:30:07.477066621 +0000 UTC m=+818.950603803" watchObservedRunningTime="2026-11-04 02:30:07.477378976 +0000 UTC m=+818.950916159"
Nov 04 02:30:07.743100 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:07.743067    5722 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Nov 04 02:30:07.743278 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:07.743136    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5" podUID="ab09ed0d-6616-4ca0-87b0-c200dcdd5920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Nov 04 02:30:08.359523 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:08.359477    5722 generic.go:356] "Generic (PLEG): container finished" podID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerID="a94d2935c4e3788e3c6d01f46af9962284b948ee2b6322e94cc10881197ce43c" exitCode=60
Nov 04 02:30:08.359964 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:08.359561    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm" event={"ID":"82a7ba8a-8013-4bb7-b881-e644cc7b72ca","Type":"ContainerDied","Data":"a94d2935c4e3788e3c6d01f46af9962284b948ee2b6322e94cc10881197ce43c"}
Nov 04 02:30:08.359964 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:08.359845    5722 scope.go:122] "RemoveContainer" containerID="a94d2935c4e3788e3c6d01f46af9962284b948ee2b6322e94cc10881197ce43c"
Nov 04 02:30:08.377958 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:08.377932    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" event={"ID":"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98","Type":"ContainerStarted","Data":"458c07c1636c2646bc7f54d921cb37def949ca047014b8f178add71a103dafa7"}
Nov 04 02:30:08.742042 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:08.742004    5722 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Nov 04 02:30:08.742155 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:08.742055    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5" podUID="ab09ed0d-6616-4ca0-87b0-c200dcdd5920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Nov 04 02:30:09.390455 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:09.390415    5722 generic.go:356] "Generic (PLEG): container finished" podID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerID="77db4e7ae4fedf0afbe7a7d47ecbd3e0013cbed623b76f516a6296312479636a" exitCode=60
Nov 04 02:30:09.390908 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:09.390457    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm" event={"ID":"82a7ba8a-8013-4bb7-b881-e644cc7b72ca","Type":"ContainerDied","Data":"77db4e7ae4fedf0afbe7a7d47ecbd3e0013cbed623b76f516a6296312479636a"}
Nov 04 02:30:09.390908 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:09.390515    5722 scope.go:122] "RemoveContainer" containerID="a94d2935c4e3788e3c6d01f46af9962284b948ee2b6322e94cc10881197ce43c"
Nov 04 02:30:09.390908 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:09.390791    5722 scope.go:122] "RemoveContainer" containerID="77db4e7ae4fedf0afbe7a7d47ecbd3e0013cbed623b76f516a6296312479636a"
Nov 04 02:30:09.391143 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:30:09.391070    5722 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895990-x4tnm_odh-ai-gateway-infra(82a7ba8a-8013-4bb7-b881-e644cc7b72ca)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca"
Nov 04 02:30:09.392431 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:09.392410    5722 generic.go:356] "Generic (PLEG): container finished" podID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerID="458c07c1636c2646bc7f54d921cb37def949ca047014b8f178add71a103dafa7" exitCode=60
Nov 04 02:30:09.392512 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:09.392486    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" event={"ID":"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98","Type":"ContainerDied","Data":"458c07c1636c2646bc7f54d921cb37def949ca047014b8f178add71a103dafa7"}
Nov 04 02:30:09.392692 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:09.392678    5722 scope.go:122] "RemoveContainer" containerID="458c07c1636c2646bc7f54d921cb37def949ca047014b8f178add71a103dafa7"
Nov 04 02:30:09.392906 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:30:09.392890    5722 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h_odh-ai-gateway-infra(e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98"
Nov 04 02:30:09.428004 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:09.427984    5722 scope.go:122] "RemoveContainer" containerID="dc93792b7c486525d84384e17f37e1e37cb6c20805bc74452a2fd29dbb599101"
Nov 04 02:30:09.741369 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:09.741336    5722 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Nov 04 02:30:09.741548 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:09.741388    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5" podUID="ab09ed0d-6616-4ca0-87b0-c200dcdd5920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Nov 04 02:30:10.398974 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:10.398942    5722 scope.go:122] "RemoveContainer" containerID="77db4e7ae4fedf0afbe7a7d47ecbd3e0013cbed623b76f516a6296312479636a"
Nov 04 02:30:10.399436 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:30:10.399207    5722 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895990-x4tnm_odh-ai-gateway-infra(82a7ba8a-8013-4bb7-b881-e644cc7b72ca)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca"
Nov 04 02:30:10.400498 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:10.400479    5722 scope.go:122] "RemoveContainer" containerID="458c07c1636c2646bc7f54d921cb37def949ca047014b8f178add71a103dafa7"
Nov 04 02:30:10.400704 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:30:10.400687    5722 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h_odh-ai-gateway-infra(e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98"
Nov 04 02:30:10.612995 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:30:10.612949    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:30:10.741799 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:10.741720    5722 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Nov 04 02:30:10.741799 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:10.741772    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5" podUID="ab09ed0d-6616-4ca0-87b0-c200dcdd5920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Nov 04 02:30:11.691622 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:11.691575    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:11.741387 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:11.741349    5722 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Nov 04 02:30:11.741560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:11.741399    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5" podUID="ab09ed0d-6616-4ca0-87b0-c200dcdd5920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Nov 04 02:30:12.901867 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:12.901837    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:12.902348 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:12.902327    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:12.903145 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:12.903120    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:30:15.481682 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:15.481616    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:15.495511 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:15.495486    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:16.450141 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:16.450107    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:30:17.070498 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:17.070465    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:21.673719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:21.673684    5722 scope.go:122] "RemoveContainer" containerID="77db4e7ae4fedf0afbe7a7d47ecbd3e0013cbed623b76f516a6296312479636a"
Nov 04 02:30:21.674210 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:21.673776    5722 scope.go:122] "RemoveContainer" containerID="458c07c1636c2646bc7f54d921cb37def949ca047014b8f178add71a103dafa7"
Nov 04 02:30:22.212180 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:22.212146    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:22.471571 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:22.471532    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm" event={"ID":"82a7ba8a-8013-4bb7-b881-e644cc7b72ca","Type":"ContainerStarted","Data":"48b375b452b7b046e5e21045ac31672a5a6fe4fd534ce4ce21906e0307b6f6eb"}
Nov 04 02:30:22.473843 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:22.473810    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" event={"ID":"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98","Type":"ContainerStarted","Data":"fe5a4d377e66fa3fb705f9598d84b61c005fc7400f18be6cbdb8daf1dc81ffd1"}
Nov 04 02:30:22.491424 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:22.491387    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:23.480409 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:23.480372    5722 generic.go:356] "Generic (PLEG): container finished" podID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerID="48b375b452b7b046e5e21045ac31672a5a6fe4fd534ce4ce21906e0307b6f6eb" exitCode=60
Nov 04 02:30:23.480908 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:23.480444    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm" event={"ID":"82a7ba8a-8013-4bb7-b881-e644cc7b72ca","Type":"ContainerDied","Data":"48b375b452b7b046e5e21045ac31672a5a6fe4fd534ce4ce21906e0307b6f6eb"}
Nov 04 02:30:23.480908 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:23.480513    5722 scope.go:122] "RemoveContainer" containerID="77db4e7ae4fedf0afbe7a7d47ecbd3e0013cbed623b76f516a6296312479636a"
Nov 04 02:30:23.480908 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:23.480881    5722 scope.go:122] "RemoveContainer" containerID="48b375b452b7b046e5e21045ac31672a5a6fe4fd534ce4ce21906e0307b6f6eb"
Nov 04 02:30:23.481194 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:30:23.481170    5722 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29895990-x4tnm_odh-ai-gateway-infra(82a7ba8a-8013-4bb7-b881-e644cc7b72ca)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca"
Nov 04 02:30:23.482681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:23.482643    5722 generic.go:356] "Generic (PLEG): container finished" podID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerID="fe5a4d377e66fa3fb705f9598d84b61c005fc7400f18be6cbdb8daf1dc81ffd1" exitCode=60
Nov 04 02:30:23.482783 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:23.482695    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" event={"ID":"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98","Type":"ContainerDied","Data":"fe5a4d377e66fa3fb705f9598d84b61c005fc7400f18be6cbdb8daf1dc81ffd1"}
Nov 04 02:30:23.482998 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:23.482985    5722 scope.go:122] "RemoveContainer" containerID="fe5a4d377e66fa3fb705f9598d84b61c005fc7400f18be6cbdb8daf1dc81ffd1"
Nov 04 02:30:23.483201 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:30:23.483186    5722 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h_odh-ai-gateway-infra(e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98"
Nov 04 02:30:23.492357 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:23.492326    5722 scope.go:122] "RemoveContainer" containerID="458c07c1636c2646bc7f54d921cb37def949ca047014b8f178add71a103dafa7"
Nov 04 02:30:23.600958 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:23.600926    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"]
Nov 04 02:30:23.717490 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:23.717387    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"]
Nov 04 02:30:24.646775 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.646752    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"
Nov 04 02:30:24.682936 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.682913    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"
Nov 04 02:30:24.752475 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.752375    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-maas-api-service-ca\") pod \"82a7ba8a-8013-4bb7-b881-e644cc7b72ca\" (UID: \"82a7ba8a-8013-4bb7-b881-e644cc7b72ca\") "
Nov 04 02:30:24.752475 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.752437    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-kube-api-access-79kkx\" (UniqueName: \"kubernetes.io/projected/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-kube-api-access-79kkx\") pod \"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98\" (UID: \"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98\") "
Nov 04 02:30:24.752736 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.752532    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-kube-api-access-kzxl4\" (UniqueName: \"kubernetes.io/projected/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-kube-api-access-kzxl4\") pod \"82a7ba8a-8013-4bb7-b881-e644cc7b72ca\" (UID: \"82a7ba8a-8013-4bb7-b881-e644cc7b72ca\") "
Nov 04 02:30:24.752736 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.752570    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-maas-api-service-ca\") pod \"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98\" (UID: \"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98\") "
Nov 04 02:30:24.753145 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.753119    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-maas-api-service-ca" pod "82a7ba8a-8013-4bb7-b881-e644cc7b72ca" (UID: "82a7ba8a-8013-4bb7-b881-e644cc7b72ca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:30:24.753288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.753123    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-maas-api-service-ca" pod "e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" (UID: "e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:30:24.754909 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.754888    5722 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-maas-api-service-ca\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:24.755053 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.755038    5722 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-maas-api-service-ca\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:24.756164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.756142    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-kube-api-access-kzxl4" pod "82a7ba8a-8013-4bb7-b881-e644cc7b72ca" (UID: "82a7ba8a-8013-4bb7-b881-e644cc7b72ca"). InnerVolumeSpecName "kube-api-access-kzxl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:30:24.756251 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.756170    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-kube-api-access-79kkx" pod "e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" (UID: "e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98"). InnerVolumeSpecName "kube-api-access-79kkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:30:24.855897 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.855858    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79kkx\" (UniqueName: \"kubernetes.io/projected/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98-kube-api-access-79kkx\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:24.855897 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:24.855896    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzxl4\" (UniqueName: \"kubernetes.io/projected/82a7ba8a-8013-4bb7-b881-e644cc7b72ca-kube-api-access-kzxl4\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:25.498348 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:25.498321    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"
Nov 04 02:30:25.498691 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:25.498330    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm" event={"ID":"82a7ba8a-8013-4bb7-b881-e644cc7b72ca","Type":"ContainerDied","Data":"702a4be7751d9d08beffd95f62aca5a9b7af28ec4aa52950bac049a5d3e9e1b6"}
Nov 04 02:30:25.498806 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:25.498727    5722 scope.go:122] "RemoveContainer" containerID="48b375b452b7b046e5e21045ac31672a5a6fe4fd534ce4ce21906e0307b6f6eb"
Nov 04 02:30:25.500352 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:25.500136    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"
Nov 04 02:30:25.500352 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:25.500184    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h" event={"ID":"e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98","Type":"ContainerDied","Data":"d3a714f20a2dde14b86c0eba6eb72679f35cf15b7caaf0ef098be9467728e4d8"}
Nov 04 02:30:25.512789 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:25.512766    5722 scope.go:122] "RemoveContainer" containerID="fe5a4d377e66fa3fb705f9598d84b61c005fc7400f18be6cbdb8daf1dc81ffd1"
Nov 04 02:30:25.673336 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:25.673303    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"]
Nov 04 02:30:25.679228 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:25.679202    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895990-x4tnm"]
Nov 04 02:30:25.790580 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:25.790509    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"]
Nov 04 02:30:25.794706 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:25.794678    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-6c403f-29895990-mj72h"]
Nov 04 02:30:26.679432 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:26.679398    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" path="/var/lib/kubelet/pods/82a7ba8a-8013-4bb7-b881-e644cc7b72ca/volumes"
Nov 04 02:30:26.679834 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:26.679802    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" path="/var/lib/kubelet/pods/e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98/volumes"
Nov 04 02:30:27.895372 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:27.895328    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:33.279171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:33.279143    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:38.720915 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:38.720877    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:40.608109 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:30:40.608071    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:30:44.077379 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.077347    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:44.207650 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.207608    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"]
Nov 04 02:30:44.208082 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208062    5722 cpu_manager.go:414] "containerMap: removing container" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerName="cleanup"
Nov 04 02:30:44.208171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208084    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerName="cleanup"
Nov 04 02:30:44.208171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208101    5722 cpu_manager.go:414] "containerMap: removing container" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerName="cleanup"
Nov 04 02:30:44.208171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208108    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerName="cleanup"
Nov 04 02:30:44.208171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208117    5722 cpu_manager.go:414] "containerMap: removing container" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerName="cleanup"
Nov 04 02:30:44.208171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208124    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerName="cleanup"
Nov 04 02:30:44.208171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208136    5722 cpu_manager.go:414] "containerMap: removing container" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerName="cleanup"
Nov 04 02:30:44.208171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208144    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerName="cleanup"
Nov 04 02:30:44.208528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208187    5722 cpu_manager.go:414] "containerMap: removing container" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerName="cleanup"
Nov 04 02:30:44.208528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208195    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerName="cleanup"
Nov 04 02:30:44.208528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208307    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerName="cleanup"
Nov 04 02:30:44.208528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208324    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerName="cleanup"
Nov 04 02:30:44.208528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208332    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerName="cleanup"
Nov 04 02:30:44.208528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.208352    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerName="cleanup"
Nov 04 02:30:44.211552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.211532    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.265487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.265463    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-a18c43-openshift-default-dockercfg-4h4hv\""
Nov 04 02:30:44.318972 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.318945    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"]
Nov 04 02:30:44.346141 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.346072    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.346141 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.346102    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.346141 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.346123    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sghw\" (UniqueName: \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-kube-api-access-4sghw\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.346365 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.346197    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.346365 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.346326    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.346443 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.346370    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.346443 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.346412    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.346443 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.346429    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55cfec76-aee9-46aa-ab04-d4a19030adc7-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.346560 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.346454    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.447552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.447525    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.447742 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.447560    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.447742 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.447581    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55cfec76-aee9-46aa-ab04-d4a19030adc7-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.447742 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.447609    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.447742 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.447702    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.447742 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.447726    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.447996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.447758    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sghw\" (UniqueName: \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-kube-api-access-4sghw\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.447996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.447784    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.447996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.447821    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.448147 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.448032    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.448275 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.448241    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.448438 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.448416    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.448508 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.448445    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55cfec76-aee9-46aa-ab04-d4a19030adc7-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.448508 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.448474    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.450748 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.450726    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.451077 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.451056    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.510515 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.510487    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.510642 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.510546    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sghw\" (UniqueName: \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-kube-api-access-4sghw\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.524391 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.524372    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:44.942733 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:30:44.942689    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55cfec76_aee9_46aa_ab04_d4a19030adc7.slice/crio-713ee127a4b94a014890116c0b59fd741e3855d21558041812c6283c0f479b52 WatchSource:0}: Error finding container 713ee127a4b94a014890116c0b59fd741e3855d21558041812c6283c0f479b52: Status 404 returned error can't find the container with id 713ee127a4b94a014890116c0b59fd741e3855d21558041812c6283c0f479b52
Nov 04 02:30:44.945262 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.945230    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:30:44.945375 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.945291    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"]
Nov 04 02:30:44.945375 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.945310    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:30:44.945375 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:44.945354    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:30:45.596617 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:45.596574    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" event={"ID":"55cfec76-aee9-46aa-ab04-d4a19030adc7","Type":"ContainerStarted","Data":"6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56"}
Nov 04 02:30:45.597032 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:45.596689    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" event={"ID":"55cfec76-aee9-46aa-ab04-d4a19030adc7","Type":"ContainerStarted","Data":"713ee127a4b94a014890116c0b59fd741e3855d21558041812c6283c0f479b52"}
Nov 04 02:30:45.720502 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:45.720447    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" podStartSLOduration=1.7204331370000001 podStartE2EDuration="1.720433137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:30:45.718971995 +0000 UTC m=+857.192509178" watchObservedRunningTime="2026-11-04 02:30:45.720433137 +0000 UTC m=+857.193970319"
Nov 04 02:30:46.525469 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:46.525433    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:46.527193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:46.527166    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:30:46.527332 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:46.527224    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" podUID="55cfec76-aee9-46aa-ab04-d4a19030adc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Nov 04 02:30:47.525624 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:47.525589    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:30:47.526040 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:47.525676    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" podUID="55cfec76-aee9-46aa-ab04-d4a19030adc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Nov 04 02:30:48.525106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:48.525072    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:30:48.525293 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:48.525127    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" podUID="55cfec76-aee9-46aa-ab04-d4a19030adc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Nov 04 02:30:49.479682 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:49.479558    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:49.525070 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:49.525034    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:30:49.525238 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:49.525101    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" podUID="55cfec76-aee9-46aa-ab04-d4a19030adc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Nov 04 02:30:50.525674 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:50.525628    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:30:50.526075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:50.525717    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" podUID="55cfec76-aee9-46aa-ab04-d4a19030adc7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Nov 04 02:30:51.655242 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:51.655139    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:51.655701 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:51.655444    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:51.656375 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:51.656344    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:30:54.197781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.197746    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"]
Nov 04 02:30:54.198267 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.198227    5722 cpu_manager.go:414] "containerMap: removing container" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerName="cleanup"
Nov 04 02:30:54.198267 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.198240    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerName="cleanup"
Nov 04 02:30:54.198343 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.198309    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0e99fa5-7315-4674-b8dd-3e3f5b2e5b98" containerName="cleanup"
Nov 04 02:30:54.198343 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.198318    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="82a7ba8a-8013-4bb7-b881-e644cc7b72ca" containerName="cleanup"
Nov 04 02:30:54.201610 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.201592    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.255857 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.255822    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-2ba6b8-openshift-default-dockercfg-n895s\""
Nov 04 02:30:54.268321 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.268276    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-credential-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.268525 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.268346    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-data\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.268525 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.268371    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-podinfo\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.268525 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.268471    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-envoy\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.268733 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.268530    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-certs\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.268733 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.268562    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01707330-73cd-4eda-9501-0ec7b2a9389e-istiod-ca-cert\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.268733 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.268586    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-token\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.268733 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.268602    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsjlj\" (UniqueName: \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-kube-api-access-vsjlj\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.268733 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.268672    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.308858 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.308821    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"]
Nov 04 02:30:54.370092 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370056    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-credential-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370305 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370131    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-data\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370305 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370158    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-podinfo\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370305 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370195    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-envoy\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370305 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370231    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-certs\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370305 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370263    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01707330-73cd-4eda-9501-0ec7b2a9389e-istiod-ca-cert\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370305 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370292    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-token\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370642 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370315    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjlj\" (UniqueName: \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-kube-api-access-vsjlj\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370642 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370393    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370642 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370526    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-credential-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370642 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370538    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-data\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370872 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370796    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.370872 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.370823    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-certs\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.371127 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.371109    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01707330-73cd-4eda-9501-0ec7b2a9389e-istiod-ca-cert\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.372772 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.372743    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-envoy\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.372979 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.372960    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-podinfo\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.433175 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.433145    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-token\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.433331 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.433212    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsjlj\" (UniqueName: \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-kube-api-access-vsjlj\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.514370 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.514281    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:54.844294 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.844211    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:54.935900 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.935869    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"]
Nov 04 02:30:54.936359 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:30:54.936327    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01707330_73cd_4eda_9501_0ec7b2a9389e.slice/crio-c7c51b46991c430089afc2113668da5112a8784c59900033e6a57a5cefc554da WatchSource:0}: Error finding container c7c51b46991c430089afc2113668da5112a8784c59900033e6a57a5cefc554da: Status 404 returned error can't find the container with id c7c51b46991c430089afc2113668da5112a8784c59900033e6a57a5cefc554da
Nov 04 02:30:54.938903 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.938867    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:30:54.938996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.938933    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:30:54.938996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:54.938958    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:30:55.015584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:55.015554    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:30:55.648106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:55.648069    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" event={"ID":"01707330-73cd-4eda-9501-0ec7b2a9389e","Type":"ContainerStarted","Data":"87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb"}
Nov 04 02:30:55.648542 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:55.648126    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" event={"ID":"01707330-73cd-4eda-9501-0ec7b2a9389e","Type":"ContainerStarted","Data":"c7c51b46991c430089afc2113668da5112a8784c59900033e6a57a5cefc554da"}
Nov 04 02:30:55.778682 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:55.773480    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" podStartSLOduration=1.773460301 podStartE2EDuration="1.773460301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:30:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:30:55.772214811 +0000 UTC m=+867.245751993" watchObservedRunningTime="2026-11-04 02:30:55.773460301 +0000 UTC m=+867.246997485"
Nov 04 02:30:56.514640 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:56.514601    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:30:56.516425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:56.516398    5722 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Nov 04 02:30:56.516557 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:56.516456    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" podUID="01707330-73cd-4eda-9501-0ec7b2a9389e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Nov 04 02:30:57.515243 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:57.515204    5722 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Nov 04 02:30:57.515650 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:57.515293    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" podUID="01707330-73cd-4eda-9501-0ec7b2a9389e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Nov 04 02:30:58.515060 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:58.515024    5722 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Nov 04 02:30:58.515266 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:58.515087    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" podUID="01707330-73cd-4eda-9501-0ec7b2a9389e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Nov 04 02:30:59.514934 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:59.514899    5722 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Nov 04 02:30:59.515124 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:30:59.514956    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" podUID="01707330-73cd-4eda-9501-0ec7b2a9389e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Nov 04 02:31:00.443768 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:00.443727    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:00.515325 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:00.515292    5722 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Nov 04 02:31:00.515507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:00.515347    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" podUID="01707330-73cd-4eda-9501-0ec7b2a9389e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Nov 04 02:31:01.702912 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:01.702879    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:31:01.703815 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:01.703797    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:31:01.704425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:01.704403    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:31:05.387839 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.387803    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"]
Nov 04 02:31:05.391875 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.391853    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.482322 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.482286    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.482494 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.482332    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1575ff3a-a763-4ecb-a536-9c5f82651aed-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.482494 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.482449    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khjlg\" (UniqueName: \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-kube-api-access-khjlg\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.482583 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.482501    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.482630 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.482610    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.482703 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.482684    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.482778 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.482766    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.482816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.482801    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.482865 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.482820    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.496837 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.496808    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-ab53c1-openshift-default-dockercfg-xpzps\""
Nov 04 02:31:05.498682 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.498641    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"]
Nov 04 02:31:05.583707 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.583634    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.583707 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.583714    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.583973 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.583734    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.583973 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.583754    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1575ff3a-a763-4ecb-a536-9c5f82651aed-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.583973 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.583790    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khjlg\" (UniqueName: \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-kube-api-access-khjlg\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.583973 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.583823    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.583973 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.583868    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.583973 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.583936    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.584272 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.583993    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.584272 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.584130    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.584272 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.584199    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.584432 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.584358    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.584432 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.584400    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.584617 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.584589    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1575ff3a-a763-4ecb-a536-9c5f82651aed-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.586451 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.586428    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.586575 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.586557    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.646976 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.646904    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.646976 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.646939    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khjlg\" (UniqueName: \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-kube-api-access-khjlg\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.705613 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.705575    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:05.802374 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:05.802301    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:06.124845 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:31:06.124815    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1575ff3a_a763_4ecb_a536_9c5f82651aed.slice/crio-5c665886fe25d5e9452843f7c11bfeced63f1ab20397099ffbec5656417cc1d1 WatchSource:0}: Error finding container 5c665886fe25d5e9452843f7c11bfeced63f1ab20397099ffbec5656417cc1d1: Status 404 returned error can't find the container with id 5c665886fe25d5e9452843f7c11bfeced63f1ab20397099ffbec5656417cc1d1
Nov 04 02:31:06.127923 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:06.127880    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:31:06.128031 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:06.127928    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"]
Nov 04 02:31:06.128031 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:06.127961    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:31:06.128031 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:06.127996    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:31:06.725804 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:06.725766    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" event={"ID":"1575ff3a-a763-4ecb-a536-9c5f82651aed","Type":"ContainerStarted","Data":"356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da"}
Nov 04 02:31:06.726205 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:06.725822    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" event={"ID":"1575ff3a-a763-4ecb-a536-9c5f82651aed","Type":"ContainerStarted","Data":"5c665886fe25d5e9452843f7c11bfeced63f1ab20397099ffbec5656417cc1d1"}
Nov 04 02:31:06.855517 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:06.855462    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" podStartSLOduration=1.855446809 podStartE2EDuration="1.855446809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:31:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:31:06.854014262 +0000 UTC m=+878.327551444" watchObservedRunningTime="2026-11-04 02:31:06.855446809 +0000 UTC m=+878.328983991"
Nov 04 02:31:07.706790 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:07.706760    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:07.708287 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:07.708266    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 02:31:07.708365 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:07.708315    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" podUID="1575ff3a-a763-4ecb-a536-9c5f82651aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 02:31:08.706866 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:08.706833    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 02:31:08.707267 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:08.706887    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" podUID="1575ff3a-a763-4ecb-a536-9c5f82651aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 02:31:09.705999 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:09.705965    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 02:31:09.706198 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:09.706024    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" podUID="1575ff3a-a763-4ecb-a536-9c5f82651aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 02:31:10.611130 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:31:10.611094    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:31:10.706062 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:10.706027    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 02:31:10.706244 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:10.706077    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" podUID="1575ff3a-a763-4ecb-a536-9c5f82651aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 02:31:11.282681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:11.282216    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:11.705952 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:11.705916    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Nov 04 02:31:11.706401 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:11.705967    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" podUID="1575ff3a-a763-4ecb-a536-9c5f82651aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Nov 04 02:31:12.832335 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:12.832301    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:12.833357 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:12.833332    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:12.834269 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:12.834249    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:31:14.025496 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:14.025466    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:16.681305 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:16.681276    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:22.092417 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:22.092378    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:27.481406 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:27.481375    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:28.757957 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:28.757922    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:31:28.762032 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:28.762010    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:31:28.762478 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:28.762460    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:31:28.766580 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:28.766563    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:31:32.933217 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:32.933186    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:38.279418 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:38.279343    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:40.608355 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:31:40.608303    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:31:41.894725 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:41.894694    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"]
Nov 04 02:31:41.895186 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:41.894928    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" podUID="07bc54b7-153f-4641-9b43-4cef75875231" containerName="istio-proxy" containerID="cri-o://d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06" gracePeriod=30
Nov 04 02:31:43.731843 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:43.731814    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:47.152273 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.152249    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:31:47.200015 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.199952    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-data\") pod \"07bc54b7-153f-4641-9b43-4cef75875231\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") "
Nov 04 02:31:47.200015 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.200009    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-credential-socket\") pod \"07bc54b7-153f-4641-9b43-4cef75875231\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") "
Nov 04 02:31:47.200201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.200053    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/07bc54b7-153f-4641-9b43-4cef75875231-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bc54b7-153f-4641-9b43-4cef75875231-istio-podinfo\") pod \"07bc54b7-153f-4641-9b43-4cef75875231\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") "
Nov 04 02:31:47.200201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.200110    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-kube-api-access-97qrc\" (UniqueName: \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-kube-api-access-97qrc\") pod \"07bc54b7-153f-4641-9b43-4cef75875231\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") "
Nov 04 02:31:47.200201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.200147    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-envoy\") pod \"07bc54b7-153f-4641-9b43-4cef75875231\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") "
Nov 04 02:31:47.200359 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.200184    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-data" pod "07bc54b7-153f-4641-9b43-4cef75875231" (UID: "07bc54b7-153f-4641-9b43-4cef75875231"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:31:47.200359 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.200207    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-istio-token\" (UniqueName: \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-istio-token\") pod \"07bc54b7-153f-4641-9b43-4cef75875231\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") "
Nov 04 02:31:47.200359 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.200260    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-credential-socket" pod "07bc54b7-153f-4641-9b43-4cef75875231" (UID: "07bc54b7-153f-4641-9b43-4cef75875231"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:31:47.200830 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.200274    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-socket\") pod \"07bc54b7-153f-4641-9b43-4cef75875231\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") "
Nov 04 02:31:47.200972 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.200928    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-socket" pod "07bc54b7-153f-4641-9b43-4cef75875231" (UID: "07bc54b7-153f-4641-9b43-4cef75875231"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:31:47.201032 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.200738    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07bc54b7-153f-4641-9b43-4cef75875231-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bc54b7-153f-4641-9b43-4cef75875231-istiod-ca-cert\") pod \"07bc54b7-153f-4641-9b43-4cef75875231\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") "
Nov 04 02:31:47.201089 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.201046    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-certs\") pod \"07bc54b7-153f-4641-9b43-4cef75875231\" (UID: \"07bc54b7-153f-4641-9b43-4cef75875231\") "
Nov 04 02:31:47.201089 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.201069    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07bc54b7-153f-4641-9b43-4cef75875231-istiod-ca-cert" pod "07bc54b7-153f-4641-9b43-4cef75875231" (UID: "07bc54b7-153f-4641-9b43-4cef75875231"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:31:47.202740 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.201568    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-certs" pod "07bc54b7-153f-4641-9b43-4cef75875231" (UID: "07bc54b7-153f-4641-9b43-4cef75875231"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:31:47.202740 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.201813    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.202740 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.201833    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bc54b7-153f-4641-9b43-4cef75875231-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.202740 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.201850    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.202740 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.201865    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.202740 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.201884    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.202740 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.203169    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-envoy" pod "07bc54b7-153f-4641-9b43-4cef75875231" (UID: "07bc54b7-153f-4641-9b43-4cef75875231"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:31:47.203877 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.203546    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-istio-token" pod "07bc54b7-153f-4641-9b43-4cef75875231" (UID: "07bc54b7-153f-4641-9b43-4cef75875231"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:31:47.203942 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.203886    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-kube-api-access-97qrc" pod "07bc54b7-153f-4641-9b43-4cef75875231" (UID: "07bc54b7-153f-4641-9b43-4cef75875231"). InnerVolumeSpecName "kube-api-access-97qrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:31:47.211398 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.211203    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07bc54b7-153f-4641-9b43-4cef75875231-istio-podinfo" pod "07bc54b7-153f-4641-9b43-4cef75875231" (UID: "07bc54b7-153f-4641-9b43-4cef75875231"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:31:47.303189 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.303164    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97qrc\" (UniqueName: \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-kube-api-access-97qrc\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.303189 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.303187    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bc54b7-153f-4641-9b43-4cef75875231-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.303319 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.303197    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bc54b7-153f-4641-9b43-4cef75875231-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.303319 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.303206    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bc54b7-153f-4641-9b43-4cef75875231-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.924988 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.924953    5722 generic.go:356] "Generic (PLEG): container finished" podID="07bc54b7-153f-4641-9b43-4cef75875231" containerID="d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06" exitCode=0
Nov 04 02:31:47.925164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.925007    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"
Nov 04 02:31:47.925164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.925019    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" event={"ID":"07bc54b7-153f-4641-9b43-4cef75875231","Type":"ContainerDied","Data":"d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06"}
Nov 04 02:31:47.925164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.925059    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct" event={"ID":"07bc54b7-153f-4641-9b43-4cef75875231","Type":"ContainerDied","Data":"eba81cc89235c914c63f2cd68fc61543e9a160236473c013cfd889865c979583"}
Nov 04 02:31:47.925164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.925080    5722 scope.go:122] "RemoveContainer" containerID="d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06"
Nov 04 02:31:47.934522 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.934505    5722 scope.go:122] "RemoveContainer" containerID="d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06"
Nov 04 02:31:47.934839 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:31:47.934817    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06\": container with ID starting with d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06 not found: ID does not exist" containerID="d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06"
Nov 04 02:31:47.934890 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:47.934848    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06"} err="failed to get container status \"d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06\": rpc error: code = NotFound desc = could not find container \"d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06\": container with ID starting with d472107221d767d74a709ad45b7eb1ab24b622ac3a2ca6456918a106b834fa06 not found: ID does not exist"
Nov 04 02:31:48.145764 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:48.145733    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"]
Nov 04 02:31:48.196765 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:48.196700    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-24gct"]
Nov 04 02:31:48.648075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:48.648044    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:48.681077 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:48.681052    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07bc54b7-153f-4641-9b43-4cef75875231" path="/var/lib/kubelet/pods/07bc54b7-153f-4641-9b43-4cef75875231/volumes"
Nov 04 02:31:49.105426 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:49.105338    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:49.331192 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:49.331152    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:49.650714 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:49.650636    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:54.147119 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:54.147039    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:54.337850 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:54.337812    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:54.510986 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:54.510894    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:54.734729 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:54.734697    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:55.283735 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:55.283688    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:57.527423 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:57.527388    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:57.696719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:57.696692    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:31:59.895137 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:31:59.895105    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:00.587273 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:00.587244    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:05.986250 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:05.986215    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:10.609378 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:32:10.609343    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:32:11.327681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:11.327638    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:13.184479 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:13.184439    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:13.457881 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:13.457789    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:14.120761 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:14.120722    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:14.389344 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:14.389263    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:16.873431 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:16.873404    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:19.281252 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:19.281213    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:19.472941 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:19.472912    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:19.651581 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:19.651548    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:22.455259 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.455224    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"]
Nov 04 02:32:22.455650 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.455637    5722 cpu_manager.go:414] "containerMap: removing container" podUID="07bc54b7-153f-4641-9b43-4cef75875231" containerName="istio-proxy"
Nov 04 02:32:22.455720 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.455650    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07bc54b7-153f-4641-9b43-4cef75875231" containerName="istio-proxy"
Nov 04 02:32:22.455759 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.455740    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="07bc54b7-153f-4641-9b43-4cef75875231" containerName="istio-proxy"
Nov 04 02:32:22.458856 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.458836    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.564088 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.564056    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-dshm\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.564245 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.564117    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-1e4f1e\"/\"distinct-2-w2-1e4f1e-kserve-self-signed-certs\""
Nov 04 02:32:22.564245 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.564170    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-model-cache\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.564245 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.564228    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tmp-dir\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.564368 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.564289    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4rj2\" (UniqueName: \"kubernetes.io/projected/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-kube-api-access-p4rj2\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.564368 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.564321    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-home\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.564368 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.564352    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tls-certs\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.565784 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.565765    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"]
Nov 04 02:32:22.578563 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.578539    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:22.665089 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.665066    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-dshm\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.665246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.665113    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-model-cache\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.665246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.665139    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tmp-dir\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.665246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.665174    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4rj2\" (UniqueName: \"kubernetes.io/projected/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-kube-api-access-p4rj2\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.665246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.665207    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-home\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.665246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.665228    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tls-certs\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.665609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.665585    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-model-cache\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.665708 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.665612    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tmp-dir\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.665708 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.665642    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-home\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.667531 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.667512    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-dshm\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.667812 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.667793    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tls-certs\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.728393 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.728317    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4rj2\" (UniqueName: \"kubernetes.io/projected/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-kube-api-access-p4rj2\") pod \"distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.770390 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.770352    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:22.786731 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.786684    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:22.989720 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:22.989627    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:23.145193 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:32:23.145162    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f1c2fdd_9af7_439d_a5e7_09c3e02de2cd.slice/crio-92fcba9161a1c1d10aa132d6417fe9e95049c69f70aa1e5ea2d59561ddf984e1 WatchSource:0}: Error finding container 92fcba9161a1c1d10aa132d6417fe9e95049c69f70aa1e5ea2d59561ddf984e1: Status 404 returned error can't find the container with id 92fcba9161a1c1d10aa132d6417fe9e95049c69f70aa1e5ea2d59561ddf984e1
Nov 04 02:32:23.148738 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:23.148593    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"]
Nov 04 02:32:23.160402 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:23.155029    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9" event={"ID":"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd","Type":"ContainerStarted","Data":"92fcba9161a1c1d10aa132d6417fe9e95049c69f70aa1e5ea2d59561ddf984e1"}
Nov 04 02:32:24.162635 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:24.162263    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9" event={"ID":"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd","Type":"ContainerStarted","Data":"94e4f6bf594bedd23beee95232beb8372c67c3c1715b822f0d4d0bca329bd08d"}
Nov 04 02:32:24.285262 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:24.285210    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9" podStartSLOduration=2.285197376 podStartE2EDuration="2.285197376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:32:24.284047027 +0000 UTC m=+955.757584221" watchObservedRunningTime="2026-11-04 02:32:24.285197376 +0000 UTC m=+955.758734558"
Nov 04 02:32:24.771411 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:24.771373    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:28.054860 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:28.054824    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:28.242617 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:28.242583    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:28.412589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:28.412537    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:32.770942 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:32.770909    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:32.783801 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:32.783775    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:33.216613 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:33.216581    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:32:33.575636 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:33.575555    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:38.891297 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:38.891262    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:39.067804 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:39.067779    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:40.609370 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:32:40.609332    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:32:44.388618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:44.388586    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:49.809772 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:49.809732    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:55.278611 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:55.278567    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:32:55.631349 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:32:55.631318    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:00.593063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:00.593014    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:00.784768 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:00.784723    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:00.956267 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:00.956233    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:02.271545 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:02.271513    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:03.009346 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:03.009290    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:03.337601 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:03.337480    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:05.614581 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.614549    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"]
Nov 04 02:33:05.618132 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.618115    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.690372 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.690338    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-dshm\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.690558 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.690386    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tmp-dir\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.690558 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.690506    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-home\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.690558 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.690547    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tls-certs\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.690939 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.690617    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-model-cache\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.690939 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.690785    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5748\" (UniqueName: \"kubernetes.io/projected/eb3afbda-5e20-44ab-b70a-7f9663a330bc-kube-api-access-b5748\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.722953 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.722924    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-a18c43\"/\"distinct-2-w1-a18c43-kserve-self-signed-certs\""
Nov 04 02:33:05.725725 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.725702    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"]
Nov 04 02:33:05.739267 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.739234    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:05.791840 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.791813    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-home\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.791941 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.791846    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tls-certs\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.791941 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.791881    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-model-cache\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.792058 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.791955    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5748\" (UniqueName: \"kubernetes.io/projected/eb3afbda-5e20-44ab-b70a-7f9663a330bc-kube-api-access-b5748\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.792058 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.792006    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-dshm\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.792058 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.792047    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tmp-dir\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.792285 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.792266    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-home\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.792396 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.792309    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tmp-dir\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.792860 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.792834    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-model-cache\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.828507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.809515    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tls-certs\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.836899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.836851    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-dshm\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.855291 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.855257    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5748\" (UniqueName: \"kubernetes.io/projected/eb3afbda-5e20-44ab-b70a-7f9663a330bc-kube-api-access-b5748\") pod \"distinct-2-w1-a18c43-kserve-648566d6d5-2msnk\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:05.929714 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:05.929677    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:06.202285 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:06.202207    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:06.312310 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:33:06.312251    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb3afbda_5e20_44ab_b70a_7f9663a330bc.slice/crio-eea0d91244979b3439deb73228228bb3e0ac40c5a262ce2b169702c361e52686 WatchSource:0}: Error finding container eea0d91244979b3439deb73228228bb3e0ac40c5a262ce2b169702c361e52686: Status 404 returned error can't find the container with id eea0d91244979b3439deb73228228bb3e0ac40c5a262ce2b169702c361e52686
Nov 04 02:33:06.314867 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:06.314841    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"]
Nov 04 02:33:06.370377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:06.370338    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk" event={"ID":"eb3afbda-5e20-44ab-b70a-7f9663a330bc","Type":"ContainerStarted","Data":"eea0d91244979b3439deb73228228bb3e0ac40c5a262ce2b169702c361e52686"}
Nov 04 02:33:07.376850 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:07.376764    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk" event={"ID":"eb3afbda-5e20-44ab-b70a-7f9663a330bc","Type":"ContainerStarted","Data":"30f91665715dd7585ef1491770b465702261e84dcbcdc03c5f10d112cd1beb92"}
Nov 04 02:33:07.496065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:07.496009    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk" podStartSLOduration=2.495995261 podStartE2EDuration="2.495995261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:07.494754768 +0000 UTC m=+998.968291949" watchObservedRunningTime="2026-11-04 02:33:07.495995261 +0000 UTC m=+998.969532443"
Nov 04 02:33:07.897225 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:07.897182    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:07.930187 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:07.930155    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:08.081030 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:08.081003    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:10.608901 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:33:10.608862    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:33:11.216299 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:11.216264    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:11.398856 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:11.398826    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:12.427458 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:12.427424    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:15.930137 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:15.930094    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:15.942563 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:15.942537    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:16.437344 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:16.437316    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:33:17.816883 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:17.816841    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:20.868608 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:20.868570    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:22.228255 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.228224    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:22.723550 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.723513    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"]
Nov 04 02:33:22.727238 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.727220    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.775929 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.775898    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-podinfo\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.776116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.775970    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-data\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.776116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.776000    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-envoy\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.776116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.776023    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-credential-socket\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.776116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.776047    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-certs\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.776116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.776085    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vttp2\" (UniqueName: \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-kube-api-access-vttp2\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.776116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.776121    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istiod-ca-cert\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.776440 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.776201    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-socket\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.776440 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.776298    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-token\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.807514 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.807486    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-ab61a8-openshift-default-dockercfg-p8jbm\""
Nov 04 02:33:22.835759 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.835724    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"]
Nov 04 02:33:22.853087 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.853054    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:22.884288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.884247    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-podinfo\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.885148 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.885116    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-data\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.885343 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.885323    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-envoy\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.885469 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.885454    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-credential-socket\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.885591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.885574    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-certs\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.885787 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.885760    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vttp2\" (UniqueName: \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-kube-api-access-vttp2\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.889765 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.889738    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istiod-ca-cert\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.890041 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.890021    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-socket\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.890245 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.890225    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-token\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.890674 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.888398    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-data\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.900684 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.891439    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istiod-ca-cert\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.900915 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.888850    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-certs\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.901023 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.888623    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-credential-socket\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.901115 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.897088    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-socket\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.901204 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.898080    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-envoy\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.906075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.906048    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-podinfo\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.953348 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.953316    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-token\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:22.953541 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:22.953316    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vttp2\" (UniqueName: \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-kube-api-access-vttp2\") pod \"e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") " pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:23.041902 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:23.041815    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:23.260693 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:23.260641    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:23.466447 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:23.466413    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"]
Nov 04 02:33:23.495686 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:33:23.495020    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cba5dab_703a_4dc2_b3d3_c7e43ddfb5c2.slice/crio-3c02e6fa39beda0c78c9b3fdea78ca9794ef57d520e76c37317205face68da1e WatchSource:0}: Error finding container 3c02e6fa39beda0c78c9b3fdea78ca9794ef57d520e76c37317205face68da1e: Status 404 returned error can't find the container with id 3c02e6fa39beda0c78c9b3fdea78ca9794ef57d520e76c37317205face68da1e
Nov 04 02:33:23.498467 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:23.498434    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:33:23.498595 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:23.498502    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:33:23.498595 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:23.498529    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:33:23.507603 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:23.507579    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:24.471996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:24.471956    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" event={"ID":"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2","Type":"ContainerStarted","Data":"a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2"}
Nov 04 02:33:24.472420 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:24.472013    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" event={"ID":"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2","Type":"ContainerStarted","Data":"3c02e6fa39beda0c78c9b3fdea78ca9794ef57d520e76c37317205face68da1e"}
Nov 04 02:33:24.594703 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:24.594621    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" podStartSLOduration=2.594604183 podStartE2EDuration="2.594604183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:24.594358513 +0000 UTC m=+1016.067895689" watchObservedRunningTime="2026-11-04 02:33:24.594604183 +0000 UTC m=+1016.068141362"
Nov 04 02:33:25.042575 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:25.042541    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:25.047888 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:25.047864    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:25.248425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:25.248397    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:25.429015 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:25.428991    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:25.477011 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:25.476985    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:25.478118 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:25.478093    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:33:27.593857 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:27.593830    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:27.821877 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:27.821842    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:28.033409 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:28.033380    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:29.315161 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:29.315131    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:31.003711 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:31.003675    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:31.179468 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:31.179434    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:34.891442 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:34.891407    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:40.277989 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:40.277952    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:40.561482 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:40.561395    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:40.609642 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:33:40.609607    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:33:40.737442 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:40.737410    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:43.818037 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:43.818006    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:43.997220 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:43.997182    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:44.026294 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.026265    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"]
Nov 04 02:33:44.029899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.029881    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.114976 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.114888    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-tmp-dir\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.114976 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.114951    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653b3986-bd80-4a1f-998c-0f49d561fcd3-tls-certs\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.115172 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.114977    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-dshm\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.115172 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.115016    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-home\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.115172 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.115053    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftftp\" (UniqueName: \"kubernetes.io/projected/653b3986-bd80-4a1f-998c-0f49d561fcd3-kube-api-access-ftftp\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.115172 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.115087    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-model-cache\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.134938 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.134913    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-ab53c1\"/\"distinct-2-w4-ab53c1-kserve-self-signed-certs\""
Nov 04 02:33:44.136806 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.136785    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"]
Nov 04 02:33:44.178031 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.177957    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:44.220594 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.220551    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-tmp-dir\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.220837 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.220636    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653b3986-bd80-4a1f-998c-0f49d561fcd3-tls-certs\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.220837 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.220688    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-dshm\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.220837 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.220743    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-home\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.220837 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.220791    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftftp\" (UniqueName: \"kubernetes.io/projected/653b3986-bd80-4a1f-998c-0f49d561fcd3-kube-api-access-ftftp\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.220837 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.220830    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-model-cache\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.221351 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.221321    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-model-cache\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.221564 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.221547    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-tmp-dir\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.222229 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.222207    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-home\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.225475 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.225142    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-dshm\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.225475 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.225346    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653b3986-bd80-4a1f-998c-0f49d561fcd3-tls-certs\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.288081 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.288051    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftftp\" (UniqueName: \"kubernetes.io/projected/653b3986-bd80-4a1f-998c-0f49d561fcd3-kube-api-access-ftftp\") pod \"distinct-2-w4-ab53c1-kserve-846c658f7-vcklz\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.341713 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.341674    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:44.777911 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:33:44.777882    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod653b3986_bd80_4a1f_998c_0f49d561fcd3.slice/crio-c2fce1fde2235cdc2a32fb51c19886c8e809ffb0c98101bf1295c6cd609bdeb4 WatchSource:0}: Error finding container c2fce1fde2235cdc2a32fb51c19886c8e809ffb0c98101bf1295c6cd609bdeb4: Status 404 returned error can't find the container with id c2fce1fde2235cdc2a32fb51c19886c8e809ffb0c98101bf1295c6cd609bdeb4
Nov 04 02:33:44.781067 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:44.781047    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"]
Nov 04 02:33:45.568433 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.568398    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"]
Nov 04 02:33:45.572064 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.572043    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.597027 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.597001    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz" event={"ID":"653b3986-bd80-4a1f-998c-0f49d561fcd3","Type":"ContainerStarted","Data":"76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501"}
Nov 04 02:33:45.597155 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.597037    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz" event={"ID":"653b3986-bd80-4a1f-998c-0f49d561fcd3","Type":"ContainerStarted","Data":"c2fce1fde2235cdc2a32fb51c19886c8e809ffb0c98101bf1295c6cd609bdeb4"}
Nov 04 02:33:45.635625 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.635600    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.635752 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.635674    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.635802 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.635779    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.635854 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.635835    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.635888 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.635873    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.635985 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.635970    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.636027 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.635998    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7745z\" (UniqueName: \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-kube-api-access-7745z\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.636117 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.636104    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.636151 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.636132    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.700373 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.700330    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"]
Nov 04 02:33:45.732529 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.732496    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:45.747951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.745713    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.747951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.745787    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.747951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.745838    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.747951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.745937    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.747951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.746047    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.747951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.746104    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.747951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.746161    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.747951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.746289    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.747951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.746340    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7745z\" (UniqueName: \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-kube-api-access-7745z\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.747951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.747247    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.747951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.747500    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.754792 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.754757    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.756288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.755347    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.760149 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.760122    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.760259 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.760238    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.760860 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.760841    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.808911 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.808882    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7745z\" (UniqueName: \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-kube-api-access-7745z\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.822688 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.822617    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:45.878619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.878566    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz" podStartSLOduration=2.878553765 podStartE2EDuration="2.878553765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:45.876918691 +0000 UTC m=+1037.350455874" watchObservedRunningTime="2026-11-04 02:33:45.878553765 +0000 UTC m=+1037.352090993"
Nov 04 02:33:45.884554 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:45.884532    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:46.303484 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:33:46.303450    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a26874_2087_4dd3_ae6e_b0f4f51afce3.slice/crio-326b64ea49cfc2b4e3072d4104bb72aad3a7da213dd85be6e64a8b0495cb5fa4 WatchSource:0}: Error finding container 326b64ea49cfc2b4e3072d4104bb72aad3a7da213dd85be6e64a8b0495cb5fa4: Status 404 returned error can't find the container with id 326b64ea49cfc2b4e3072d4104bb72aad3a7da213dd85be6e64a8b0495cb5fa4
Nov 04 02:33:46.306850 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:46.306815    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:33:46.306950 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:46.306894    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:33:46.306950 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:46.306926    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:33:46.308312 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:46.308286    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"]
Nov 04 02:33:46.342338 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:46.342312    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:46.605365 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:46.605267    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" event={"ID":"d2a26874-2087-4dd3-ae6e-b0f4f51afce3","Type":"ContainerStarted","Data":"774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2"}
Nov 04 02:33:46.605365 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:46.605326    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" event={"ID":"d2a26874-2087-4dd3-ae6e-b0f4f51afce3","Type":"ContainerStarted","Data":"326b64ea49cfc2b4e3072d4104bb72aad3a7da213dd85be6e64a8b0495cb5fa4"}
Nov 04 02:33:46.729132 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:46.729069    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" podStartSLOduration=1.729051246 podStartE2EDuration="1.729051246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:46.728117366 +0000 UTC m=+1038.201654547" watchObservedRunningTime="2026-11-04 02:33:46.729051246 +0000 UTC m=+1038.202588429"
Nov 04 02:33:46.886682 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:46.884754    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:47.886455 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:47.886424    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 04 02:33:47.886859 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:47.886478    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" podUID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 04 02:33:48.886025 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:48.885990    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 04 02:33:48.886208 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:48.886043    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" podUID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 04 02:33:49.887099 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:49.887056    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 04 02:33:49.887591 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:49.887119    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" podUID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 04 02:33:50.886088 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:50.886050    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 04 02:33:50.886254 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:50.886117    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" podUID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 04 02:33:51.008221 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:51.008181    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:51.195256 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:51.195162    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:51.373182 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:51.373134    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:51.887127 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:51.887093    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 04 02:33:51.887409 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:51.887383    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" podUID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 04 02:33:52.829884 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:52.829851    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:52.885115 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:52.885077    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Nov 04 02:33:52.885279 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:52.885142    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" podUID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Nov 04 02:33:53.006863 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:53.006824    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:53.902135 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:53.902101    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:53.902744 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:53.902717    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:53.903908 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:53.903884    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:33:54.342139 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:54.342058    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:54.359605 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:54.359318    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:54.659024 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:54.658998    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:33:55.584893 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:55.584859    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:55.982078 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:55.982036    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:56.352127 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:56.352041    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:56.862742 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:56.862694    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:57.749797 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:57.749764    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:58.958187 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:58.958129    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:33:59.273081 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:33:59.272998    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:02.413239 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:02.413203    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:03.606055 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:03.606019    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:03.774638 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:03.774603    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:03.950861 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:03.950830    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:07.865855 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:07.865810    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:08.043325 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:08.043294    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:08.318453 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:08.318376    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:10.608547 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:34:10.608505    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:34:10.669684 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:10.666716    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:10.849303 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:10.849270    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:13.900357 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:13.900310    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:19.337289 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:19.337258    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:19.511264 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:19.511234    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:19.726926 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:19.726894    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:20.017225 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.017138    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:20.182997 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.182965    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:20.393558 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.393526    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"]
Nov 04 02:34:20.396885 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.396868    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.489857 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.489828    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.490005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.489861    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8547\" (UniqueName: \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-kube-api-access-s8547\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.490005 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.489884    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.490100 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.490001    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3686444-55af-44b0-9a1d-277230d371a3-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.490100 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.490050    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.490100 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.490075    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.490257 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.490190    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3686444-55af-44b0-9a1d-277230d371a3-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.490257 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.490226    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.490364 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.490328    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.504182 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.504157    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"]
Nov 04 02:34:20.591386 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.591354    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3686444-55af-44b0-9a1d-277230d371a3-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.591541 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.591406    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.591541 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.591430    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.591541 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.591465    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3686444-55af-44b0-9a1d-277230d371a3-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.591541 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.591482    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.591812 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.591622    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.591812 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.591736    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.591812 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.591768    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8547\" (UniqueName: \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-kube-api-access-s8547\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.591812 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.591805    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.592016 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.591875    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.592016 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.591904    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.592112 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.592086    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.592178 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.592138    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.592178 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.592139    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3686444-55af-44b0-9a1d-277230d371a3-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.594204 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.594176    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.594310 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.594218    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3686444-55af-44b0-9a1d-277230d371a3-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.655053 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.654984    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8547\" (UniqueName: \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-kube-api-access-s8547\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.655482 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.655461    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:20.709322 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:20.709293    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:21.134156 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:34:21.134126    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3686444_55af_44b0_9a1d_277230d371a3.slice/crio-df20c3075fa49d1d753417a1ed3445dfe523474a14fc688299287d94cd64e0ee WatchSource:0}: Error finding container df20c3075fa49d1d753417a1ed3445dfe523474a14fc688299287d94cd64e0ee: Status 404 returned error can't find the container with id df20c3075fa49d1d753417a1ed3445dfe523474a14fc688299287d94cd64e0ee
Nov 04 02:34:21.137140 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:21.137102    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:34:21.137248 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:21.137191    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:34:21.137248 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:21.137231    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"]
Nov 04 02:34:21.137319 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:21.137233    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:34:21.838260 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:21.838229    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" event={"ID":"c3686444-55af-44b0-9a1d-277230d371a3","Type":"ContainerStarted","Data":"721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b"}
Nov 04 02:34:21.838670 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:21.838278    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" event={"ID":"c3686444-55af-44b0-9a1d-277230d371a3","Type":"ContainerStarted","Data":"df20c3075fa49d1d753417a1ed3445dfe523474a14fc688299287d94cd64e0ee"}
Nov 04 02:34:21.988021 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:21.987952    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" podStartSLOduration=1.987927439 podStartE2EDuration="1.987927439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:21.977157045 +0000 UTC m=+1073.450694230" watchObservedRunningTime="2026-11-04 02:34:21.987927439 +0000 UTC m=+1073.461464623"
Nov 04 02:34:22.531696 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.531064    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-xjq4v-74j97"]
Nov 04 02:34:22.624332 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.624299    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.624799 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.624768    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-xjq4v-74j97"]
Nov 04 02:34:22.709997 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.709968    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:22.711452 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.711429    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 02:34:22.711570 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.711474    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" podUID="c3686444-55af-44b0-9a1d-277230d371a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 02:34:22.737244 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.737223    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5gtz2\""
Nov 04 02:34:22.745601 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.745572    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpz59\" (UniqueName: \"kubernetes.io/projected/cb45a256-d8c5-4c00-9b11-b22a4948acd6-kube-api-access-qpz59\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.745727 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.745617    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-trusted-ca-bundle\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.745771 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.745727    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-service-ca-bundle\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.745856 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.745837    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cb45a256-d8c5-4c00-9b11-b22a4948acd6-archives-path\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.846678 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.846578    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cb45a256-d8c5-4c00-9b11-b22a4948acd6-archives-path\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.847141 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.846755    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpz59\" (UniqueName: \"kubernetes.io/projected/cb45a256-d8c5-4c00-9b11-b22a4948acd6-kube-api-access-qpz59\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.847141 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.846794    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-trusted-ca-bundle\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.847141 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.846833    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-service-ca-bundle\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.847141 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.846981    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cb45a256-d8c5-4c00-9b11-b22a4948acd6-archives-path\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.847550 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.847526    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-service-ca-bundle\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.847687 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.847644    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-trusted-ca-bundle\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.913746 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.913703    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpz59\" (UniqueName: \"kubernetes.io/projected/cb45a256-d8c5-4c00-9b11-b22a4948acd6-kube-api-access-qpz59\") pod \"periodic-gathering-xjq4v-74j97\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") " pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:22.942533 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:22.942496    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:34:23.355933 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:34:23.355881    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb45a256_d8c5_4c00_9b11_b22a4948acd6.slice/crio-175348ce311477dc2e16cf27630ceeb70b642f26d4a56ee983bbadaf9a94f761 WatchSource:0}: Error finding container 175348ce311477dc2e16cf27630ceeb70b642f26d4a56ee983bbadaf9a94f761: Status 404 returned error can't find the container with id 175348ce311477dc2e16cf27630ceeb70b642f26d4a56ee983bbadaf9a94f761
Nov 04 02:34:23.358453 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:23.358423    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-xjq4v-74j97"]
Nov 04 02:34:23.709783 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:23.709751    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 02:34:23.709958 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:23.709814    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" podUID="c3686444-55af-44b0-9a1d-277230d371a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 02:34:23.851475 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:23.851438    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xjq4v-74j97" event={"ID":"cb45a256-d8c5-4c00-9b11-b22a4948acd6","Type":"ContainerStarted","Data":"e14cdef774988d48474c8a954d471f4d1ffe2c4dbcaee173aa5b21a1b1f476d1"}
Nov 04 02:34:23.851934 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:23.851498    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xjq4v-74j97" event={"ID":"cb45a256-d8c5-4c00-9b11-b22a4948acd6","Type":"ContainerStarted","Data":"175348ce311477dc2e16cf27630ceeb70b642f26d4a56ee983bbadaf9a94f761"}
Nov 04 02:34:23.971924 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:23.971800    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-xjq4v-74j97" podStartSLOduration=1.971779314 podStartE2EDuration="1.971779314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:23.969925798 +0000 UTC m=+1075.443462985" watchObservedRunningTime="2026-11-04 02:34:23.971779314 +0000 UTC m=+1075.445316498"
Nov 04 02:34:24.710441 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:24.710408    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 02:34:24.710594 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:24.710463    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" podUID="c3686444-55af-44b0-9a1d-277230d371a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 02:34:24.959597 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:24.959556    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:25.711486 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:25.711422    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 02:34:25.711702 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:25.711484    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" podUID="c3686444-55af-44b0-9a1d-277230d371a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 02:34:26.710564 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:26.710536    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 02:34:26.710994 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:26.710881    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" podUID="c3686444-55af-44b0-9a1d-277230d371a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 02:34:27.709863 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:27.709830    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Nov 04 02:34:27.710046 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:27.709880    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" podUID="c3686444-55af-44b0-9a1d-277230d371a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Nov 04 02:34:28.215713 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.215678    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"]
Nov 04 02:34:28.220866 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.220837    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.341955 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.341918    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"]
Nov 04 02:34:28.356314 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.356275    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm8t7\" (UniqueName: \"kubernetes.io/projected/19ed5670-9c9e-45f9-a9bd-e1f273e50527-kube-api-access-bm8t7\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.356487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.356359    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.356487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.356411    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.356618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.356509    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.356618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.356538    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.356618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.356579    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.356805 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.356633    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.356805 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.356718    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.356805 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.356784    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458068 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458036    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458225 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458082    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458225 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458129    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458225 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458180    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458401 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458224    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458401 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458282    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458401 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458325    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm8t7\" (UniqueName: \"kubernetes.io/projected/19ed5670-9c9e-45f9-a9bd-e1f273e50527-kube-api-access-bm8t7\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458401 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458377    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458611 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458425    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458611 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458461    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458611 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458477    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458611 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458540    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.458830 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.458730    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.459219 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.459192    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.461022 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.460993    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.461307 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.461284    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.520988 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.520917    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ed5670-9c9e-45f9-a9bd-e1f273e50527-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.521303 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.521280    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm8t7\" (UniqueName: \"kubernetes.io/projected/19ed5670-9c9e-45f9-a9bd-e1f273e50527-kube-api-access-bm8t7\") pod \"maas-default-gateway-openshift-default-fd4b99879-c8n4k\" (UID: \"19ed5670-9c9e-45f9-a9bd-e1f273e50527\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.539673 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.539636    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:28.714711 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.714650    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:28.714986 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.714962    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:28.715705 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.715690    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:34:28.996302 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.996279    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"]
Nov 04 02:34:28.999160 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.999128    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:34:28.999277 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.999203    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:34:28.999277 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:28.999247    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:34:29.917461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:29.917427    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k" event={"ID":"19ed5670-9c9e-45f9-a9bd-e1f273e50527","Type":"ContainerStarted","Data":"f4f13bcb9173339a466170357d644f9057d2dd08a20f2254bfeeb24ee23672f1"}
Nov 04 02:34:29.917926 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:29.917495    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k" event={"ID":"19ed5670-9c9e-45f9-a9bd-e1f273e50527","Type":"ContainerStarted","Data":"7967255a33ce62085f4def6b2ec596e5136d3e4a1cc07df6d51d055858833822"}
Nov 04 02:34:30.144996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:30.144941    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k" podStartSLOduration=2.144926215 podStartE2EDuration="2.144926215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:30.091968095 +0000 UTC m=+1081.565505301" watchObservedRunningTime="2026-11-04 02:34:30.144926215 +0000 UTC m=+1081.618463397"
Nov 04 02:34:30.490828 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:30.490792    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:30.546825 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:30.546792    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:30.549128 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:30.549089    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-c8n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 02:34:30.549290 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:30.549163    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k" podUID="19ed5670-9c9e-45f9-a9bd-e1f273e50527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 02:34:31.540001 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:31.539966    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-c8n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 02:34:31.540422 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:31.540017    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k" podUID="19ed5670-9c9e-45f9-a9bd-e1f273e50527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 02:34:32.539976 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:32.539943    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-c8n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 02:34:32.540189 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:32.540001    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k" podUID="19ed5670-9c9e-45f9-a9bd-e1f273e50527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 02:34:33.540711 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:33.540643    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-c8n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 02:34:33.541182 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:33.540740    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k" podUID="19ed5670-9c9e-45f9-a9bd-e1f273e50527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 02:34:34.540463 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:34.540432    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-c8n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 02:34:34.540635 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:34.540482    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k" podUID="19ed5670-9c9e-45f9-a9bd-e1f273e50527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 02:34:35.395169 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.395140    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"]
Nov 04 02:34:35.399575 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.399550    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.439672 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.439624    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.439816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.439680    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.439816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.439764    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8491d004-87be-458d-a69f-3a6a48f595f8-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.439901 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.439886    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.440013 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.439995    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8491d004-87be-458d-a69f-3a6a48f595f8-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.440157 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.440135    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.440215 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.440175    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.440215 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.440197    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.440309 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.440218    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtj96\" (UniqueName: \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-kube-api-access-mtj96\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.507564 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.507533    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"]
Nov 04 02:34:35.540300 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.540267    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-c8n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 02:34:35.540444 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.540335    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k" podUID="19ed5670-9c9e-45f9-a9bd-e1f273e50527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 02:34:35.540936 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.540912    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.540976 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.540950    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.540976 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.540967    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.541172 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.541155    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtj96\" (UniqueName: \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-kube-api-access-mtj96\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.541226 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.541204    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.541284 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.541260    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.541336 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.541301    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8491d004-87be-458d-a69f-3a6a48f595f8-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.541391 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.541348    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.541391 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.541373    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.541500 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.541434    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.541500 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.541446    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8491d004-87be-458d-a69f-3a6a48f595f8-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.541704 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.541648    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.542204 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.542096    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8491d004-87be-458d-a69f-3a6a48f595f8-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.542204 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.542257    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.543454 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.543429    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.544001 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.543983    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8491d004-87be-458d-a69f-3a6a48f595f8-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.603642 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.603610    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.603809 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.603791    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtj96\" (UniqueName: \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-kube-api-access-mtj96\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:35.714979 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:35.714909    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:36.024800 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:36.024723    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:36.147608 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:34:36.147580    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8491d004_87be_458d_a69f_3a6a48f595f8.slice/crio-fa3e8bf8d437254ce0f3826e55f453a743a372bec6148468939fb83748205166 WatchSource:0}: Error finding container fa3e8bf8d437254ce0f3826e55f453a743a372bec6148468939fb83748205166: Status 404 returned error can't find the container with id fa3e8bf8d437254ce0f3826e55f453a743a372bec6148468939fb83748205166
Nov 04 02:34:36.150404 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:36.150368    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:34:36.150506 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:36.150459    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:34:36.150568 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:36.150505    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:34:36.151042 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:36.151006    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"]
Nov 04 02:34:36.418731 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:36.418691    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:36.540545 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:36.540510    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-c8n4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Nov 04 02:34:36.540727 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:36.540570    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k" podUID="19ed5670-9c9e-45f9-a9bd-e1f273e50527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Nov 04 02:34:36.599637 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:36.599602    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:36.983681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:36.983496    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" event={"ID":"8491d004-87be-458d-a69f-3a6a48f595f8","Type":"ContainerStarted","Data":"f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2"}
Nov 04 02:34:36.983681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:36.983565    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" event={"ID":"8491d004-87be-458d-a69f-3a6a48f595f8","Type":"ContainerStarted","Data":"fa3e8bf8d437254ce0f3826e55f453a743a372bec6148468939fb83748205166"}
Nov 04 02:34:37.109762 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:37.109635    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" podStartSLOduration=2.109618925 podStartE2EDuration="2.109618925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:37.108206556 +0000 UTC m=+1088.581743738" watchObservedRunningTime="2026-11-04 02:34:37.109618925 +0000 UTC m=+1088.583156106"
Nov 04 02:34:37.715275 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:37.715228    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:37.716955 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:37.716930    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 04 02:34:37.717077 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:37.716974    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" podUID="8491d004-87be-458d-a69f-3a6a48f595f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 04 02:34:38.108978 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:38.108891    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:38.294689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:38.294302    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:38.432702 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:38.432027    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:38.433895 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:38.433058    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:38.434176 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:38.434156    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k"
Nov 04 02:34:38.716008 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:38.715935    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 04 02:34:38.716008 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:38.715997    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" podUID="8491d004-87be-458d-a69f-3a6a48f595f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 04 02:34:39.715425 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:39.715395    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 04 02:34:39.715608 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:39.715448    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" podUID="8491d004-87be-458d-a69f-3a6a48f595f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 04 02:34:40.020771 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:40.020648    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:40.611600 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:34:40.611566    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:34:40.716161 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:40.716134    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 04 02:34:40.716417 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:40.716384    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" podUID="8491d004-87be-458d-a69f-3a6a48f595f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 04 02:34:41.487343 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:41.487303    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:41.715406 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:41.715369    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 04 02:34:41.715576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:41.715424    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" podUID="8491d004-87be-458d-a69f-3a6a48f595f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 04 02:34:42.715465 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:42.715430    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Nov 04 02:34:42.715892 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:42.715494    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" podUID="8491d004-87be-458d-a69f-3a6a48f595f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Nov 04 02:34:43.719834 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:43.719801    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:43.720224 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:43.720174    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:43.720843 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:43.720827    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:34:44.951938 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:44.951903    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"]
Nov 04 02:34:45.003309 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:45.003279    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"]
Nov 04 02:34:45.088216 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:45.088179    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:46.892574 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:46.892541    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:51.373681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:51.369485    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:52.315190 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:52.315122    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:54.481798 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:54.481759    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-c8n4k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 02:34:54.482517 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:54.482482    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-c8n4k" podUID="19ed5670-9c9e-45f9-a9bd-e1f273e50527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:34:54.977312 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:54.977224    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:56.393186 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:56.393136    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:56.572980 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:56.572930    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:57.035288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:57.035241    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:57.277592 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:57.277543    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:58.231100 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:58.231066    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:58.405160 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:58.405117    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:58.690592 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:58.690555    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:58.954852 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:58.954720    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:34:59.973079 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:34:59.973034    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk" podUID="eb3afbda-5e20-44ab-b70a-7f9663a330bc" containerName="main" containerID="cri-o://30f91665715dd7585ef1491770b465702261e84dcbcdc03c5f10d112cd1beb92" gracePeriod=45
Nov 04 02:35:00.023542 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.023501    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw" podUID="b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" containerName="main" containerID="cri-o://54c3734c18d27a42b875bf4d1cd21852fe4482c395d649c05d46f358b9977875" gracePeriod=45
Nov 04 02:35:00.268546 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.268227    5722 generic.go:356] "Generic (PLEG): container finished" podID="b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" containerID="54c3734c18d27a42b875bf4d1cd21852fe4482c395d649c05d46f358b9977875" exitCode=0
Nov 04 02:35:00.268546 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.268444    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw" event={"ID":"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a","Type":"ContainerDied","Data":"54c3734c18d27a42b875bf4d1cd21852fe4482c395d649c05d46f358b9977875"}
Nov 04 02:35:00.270897 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.270814    5722 generic.go:356] "Generic (PLEG): container finished" podID="eb3afbda-5e20-44ab-b70a-7f9663a330bc" containerID="30f91665715dd7585ef1491770b465702261e84dcbcdc03c5f10d112cd1beb92" exitCode=0
Nov 04 02:35:00.270897 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.270856    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk" event={"ID":"eb3afbda-5e20-44ab-b70a-7f9663a330bc","Type":"ContainerDied","Data":"30f91665715dd7585ef1491770b465702261e84dcbcdc03c5f10d112cd1beb92"}
Nov 04 02:35:00.317867 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.317846    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:35:00.319564 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.319547    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:35:00.428449 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.428423    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tmp-dir\") pod \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") "
Nov 04 02:35:00.428604 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.428462    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-home\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-home\") pod \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") "
Nov 04 02:35:00.428604 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.428501    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tls-certs\" (UniqueName: \"kubernetes.io/secret/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tls-certs\") pod \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") "
Nov 04 02:35:00.428604 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.428529    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-dshm\") pod \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") "
Nov 04 02:35:00.428604 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.428572    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-model-cache\") pod \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") "
Nov 04 02:35:00.428604 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.428600    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tmp-dir\") pod \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") "
Nov 04 02:35:00.428873 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.428636    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tls-certs\") pod \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") "
Nov 04 02:35:00.428873 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.428691    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tmp-dir" pod "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" (UID: "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.428873 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.428783    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-home" pod "eb3afbda-5e20-44ab-b70a-7f9663a330bc" (UID: "eb3afbda-5e20-44ab-b70a-7f9663a330bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.429030 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.428973    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-kube-api-access-z6qqg\" (UniqueName: \"kubernetes.io/projected/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-kube-api-access-z6qqg\") pod \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") "
Nov 04 02:35:00.429030 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.428977    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tmp-dir" pod "eb3afbda-5e20-44ab-b70a-7f9663a330bc" (UID: "eb3afbda-5e20-44ab-b70a-7f9663a330bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.429030 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429016    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb3afbda-5e20-44ab-b70a-7f9663a330bc-kube-api-access-b5748\" (UniqueName: \"kubernetes.io/projected/eb3afbda-5e20-44ab-b70a-7f9663a330bc-kube-api-access-b5748\") pod \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") "
Nov 04 02:35:00.429255 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429028    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-model-cache" pod "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" (UID: "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.429255 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429047    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-home\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-home\") pod \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\" (UID: \"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a\") "
Nov 04 02:35:00.429255 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429127    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-model-cache\") pod \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") "
Nov 04 02:35:00.429255 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429233    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-dshm\") pod \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\" (UID: \"eb3afbda-5e20-44ab-b70a-7f9663a330bc\") "
Nov 04 02:35:00.429537 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429456    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-home" pod "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" (UID: "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.429537 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429500    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-model-cache" pod "eb3afbda-5e20-44ab-b70a-7f9663a330bc" (UID: "eb3afbda-5e20-44ab-b70a-7f9663a330bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.429742 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429722    5722 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-home\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.429820 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429747    5722 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-model-cache\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.429820 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429761    5722 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tmp-dir\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.429820 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429775    5722 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-home\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.429820 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429788    5722 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-model-cache\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.429820 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.429801    5722 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tmp-dir\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.431034 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.431007    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-dshm" pod "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" (UID: "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.431592 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.431570    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tls-certs" pod "eb3afbda-5e20-44ab-b70a-7f9663a330bc" (UID: "eb3afbda-5e20-44ab-b70a-7f9663a330bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:35:00.431728 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.431599    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb3afbda-5e20-44ab-b70a-7f9663a330bc-kube-api-access-b5748" pod "eb3afbda-5e20-44ab-b70a-7f9663a330bc" (UID: "eb3afbda-5e20-44ab-b70a-7f9663a330bc"). InnerVolumeSpecName "kube-api-access-b5748". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:00.431728 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.431651    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-kube-api-access-z6qqg" pod "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" (UID: "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a"). InnerVolumeSpecName "kube-api-access-z6qqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:00.431850 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.431807    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tls-certs" pod "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" (UID: "b3c7933f-6883-4ccc-8fa3-d33c5b896f7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:35:00.432046 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.432012    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-dshm" pod "eb3afbda-5e20-44ab-b70a-7f9663a330bc" (UID: "eb3afbda-5e20-44ab-b70a-7f9663a330bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.531196 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.531109    5722 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb3afbda-5e20-44ab-b70a-7f9663a330bc-dshm\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.531196 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.531142    5722 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-tls-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.531196 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.531154    5722 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-dshm\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.531196 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.531166    5722 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb3afbda-5e20-44ab-b70a-7f9663a330bc-tls-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.531196 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.531180    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6qqg\" (UniqueName: \"kubernetes.io/projected/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a-kube-api-access-z6qqg\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.531196 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.531194    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5748\" (UniqueName: \"kubernetes.io/projected/eb3afbda-5e20-44ab-b70a-7f9663a330bc-kube-api-access-b5748\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.945837 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:00.945787    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"]
Nov 04 02:35:01.057682 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.052979    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"]
Nov 04 02:35:01.280916 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.280831    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"
Nov 04 02:35:01.281082 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.280826    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk" event={"ID":"eb3afbda-5e20-44ab-b70a-7f9663a330bc","Type":"ContainerDied","Data":"eea0d91244979b3439deb73228228bb3e0ac40c5a262ce2b169702c361e52686"}
Nov 04 02:35:01.281082 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.281010    5722 scope.go:122] "RemoveContainer" containerID="30f91665715dd7585ef1491770b465702261e84dcbcdc03c5f10d112cd1beb92"
Nov 04 02:35:01.282908 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.282887    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"
Nov 04 02:35:01.283456 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.283429    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw" event={"ID":"b3c7933f-6883-4ccc-8fa3-d33c5b896f7a","Type":"ContainerDied","Data":"e1bdbffa21baa3b8ee71ee73ef5a19c05332a81017d414a60b30fd73b9c7973e"}
Nov 04 02:35:01.285749 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.285720    5722 generic.go:356] "Generic (PLEG): container finished" podID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerID="a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2" exitCode=0
Nov 04 02:35:01.285919 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.285801    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" event={"ID":"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2","Type":"ContainerDied","Data":"a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2"}
Nov 04 02:35:01.286546 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.286526    5722 scope.go:122] "RemoveContainer" containerID="a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2"
Nov 04 02:35:01.288089 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.288062    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:01.288188 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.288145    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:01.288254 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.288194    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:01.293623 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.293608    5722 scope.go:122] "RemoveContainer" containerID="54c3734c18d27a42b875bf4d1cd21852fe4482c395d649c05d46f358b9977875"
Nov 04 02:35:01.339034 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.339008    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:01.552753 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.549737    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:01.552753 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.549956    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"]
Nov 04 02:35:01.556260 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.555601    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-2-w1-a18c43-kserve-648566d6d5-2msnk"]
Nov 04 02:35:01.611120 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.611079    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"]
Nov 04 02:35:01.613129 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.613101    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/premium-w1-a18c43-kserve-6c9f9c4b7-skvsw"]
Nov 04 02:35:01.729683 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:01.726103    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:02.294705 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:02.294644    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" event={"ID":"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2","Type":"ContainerStarted","Data":"42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21"}
Nov 04 02:35:02.716690 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:02.710378    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" path="/var/lib/kubelet/pods/b3c7933f-6883-4ccc-8fa3-d33c5b896f7a/volumes"
Nov 04 02:35:02.716690 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:02.711020    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eb3afbda-5e20-44ab-b70a-7f9663a330bc" path="/var/lib/kubelet/pods/eb3afbda-5e20-44ab-b70a-7f9663a330bc/volumes"
Nov 04 02:35:03.042403 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:03.042312    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:35:03.042542 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:03.042504    5722 patch_prober.go:29] interesting pod/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 04 02:35:03.042603 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:03.042561    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 04 02:35:04.015527 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:04.015493    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:04.042892 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:04.042859    5722 patch_prober.go:29] interesting pod/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 04 02:35:04.043038 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:04.042911    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 04 02:35:04.486202 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:04.486167    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:04.905776 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:04.905721    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:05.044137 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.044063    5722 patch_prober.go:29] interesting pod/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 04 02:35:05.047588 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.047545    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 04 02:35:05.097701 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.097646    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:05.300614 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.300530    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"]
Nov 04 02:35:05.302152 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.302131    5722 cpu_manager.go:414] "containerMap: removing container" podUID="eb3afbda-5e20-44ab-b70a-7f9663a330bc" containerName="main"
Nov 04 02:35:05.302309 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.302293    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eb3afbda-5e20-44ab-b70a-7f9663a330bc" containerName="main"
Nov 04 02:35:05.302410 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.302399    5722 cpu_manager.go:414] "containerMap: removing container" podUID="b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" containerName="main"
Nov 04 02:35:05.302491 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.302480    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" containerName="main"
Nov 04 02:35:05.305963 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.305944    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="eb3afbda-5e20-44ab-b70a-7f9663a330bc" containerName="main"
Nov 04 02:35:05.306097 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.306085    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3c7933f-6883-4ccc-8fa3-d33c5b896f7a" containerName="main"
Nov 04 02:35:05.309712 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.309692    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:35:05.378513 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.378457    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"]
Nov 04 02:35:05.412022 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.411990    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-b-3353a6-dockercfg-dn8mq\""
Nov 04 02:35:05.412362 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.412335    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-b-3353a6\""
Nov 04 02:35:05.461489 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.461447    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5271739-1351-45dc-bded-ea6bfac45443-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c\" (UID: \"b5271739-1351-45dc-bded-ea6bfac45443\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:35:05.463258 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.463229    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ghw6\" (UniqueName: \"kubernetes.io/projected/b5271739-1351-45dc-bded-ea6bfac45443-kube-api-access-9ghw6\") pod \"payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c\" (UID: \"b5271739-1351-45dc-bded-ea6bfac45443\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:35:05.486894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.486852    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"]
Nov 04 02:35:05.527885 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.527857    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"]
Nov 04 02:35:05.528355 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.528189    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:35:05.579644 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.579259    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb5tg\" (UniqueName: \"kubernetes.io/projected/2b5b8b62-db61-4485-aa7a-7c9f38406211-kube-api-access-sb5tg\") pod \"payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78\" (UID: \"2b5b8b62-db61-4485-aa7a-7c9f38406211\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:35:05.580117 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.580095    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5271739-1351-45dc-bded-ea6bfac45443-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c\" (UID: \"b5271739-1351-45dc-bded-ea6bfac45443\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:35:05.581197 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.581176    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ghw6\" (UniqueName: \"kubernetes.io/projected/b5271739-1351-45dc-bded-ea6bfac45443-kube-api-access-9ghw6\") pod \"payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c\" (UID: \"b5271739-1351-45dc-bded-ea6bfac45443\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:35:05.581681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.581094    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5271739-1351-45dc-bded-ea6bfac45443-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c\" (UID: \"b5271739-1351-45dc-bded-ea6bfac45443\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:35:05.581877 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.581857    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b5b8b62-db61-4485-aa7a-7c9f38406211-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78\" (UID: \"2b5b8b62-db61-4485-aa7a-7c9f38406211\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:35:05.644279 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.644258    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ghw6\" (UniqueName: \"kubernetes.io/projected/b5271739-1351-45dc-bded-ea6bfac45443-kube-api-access-9ghw6\") pod \"payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c\" (UID: \"b5271739-1351-45dc-bded-ea6bfac45443\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:35:05.685686 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.685264    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b5b8b62-db61-4485-aa7a-7c9f38406211-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78\" (UID: \"2b5b8b62-db61-4485-aa7a-7c9f38406211\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:35:05.685902 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.685875    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb5tg\" (UniqueName: \"kubernetes.io/projected/2b5b8b62-db61-4485-aa7a-7c9f38406211-kube-api-access-sb5tg\") pod \"payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78\" (UID: \"2b5b8b62-db61-4485-aa7a-7c9f38406211\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:35:05.686518 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.686500    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b5b8b62-db61-4485-aa7a-7c9f38406211-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78\" (UID: \"2b5b8b62-db61-4485-aa7a-7c9f38406211\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:35:05.748302 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.748276    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb5tg\" (UniqueName: \"kubernetes.io/projected/2b5b8b62-db61-4485-aa7a-7c9f38406211-kube-api-access-sb5tg\") pod \"payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78\" (UID: \"2b5b8b62-db61-4485-aa7a-7c9f38406211\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:35:05.842781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.842706    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:35:05.922878 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.922850    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:35:05.946779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:05.946539    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd" podUID="aa754e81-71f0-4010-96ea-f4d5bccc33ac" containerName="payload-processing" containerID="cri-o://f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4" gracePeriod=25
Nov 04 02:35:06.042467 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:06.042430    5722 patch_prober.go:29] interesting pod/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 04 02:35:06.042596 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:06.042513    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 04 02:35:06.053951 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:06.053876    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4" podUID="ba446fbb-6854-4e0a-b266-f8c561fa50fd" containerName="payload-pre-processing" containerID="cri-o://284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b" gracePeriod=25
Nov 04 02:35:06.242789 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:06.242765    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"]
Nov 04 02:35:06.327952 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:06.327923    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78" event={"ID":"2b5b8b62-db61-4485-aa7a-7c9f38406211","Type":"ContainerStarted","Data":"baf5c156fe8ad3d370556acac92ac1e25600ba1a2fc6eb9ada120a8d745a2365"}
Nov 04 02:35:06.342042 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:35:06.342014    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5271739_1351_45dc_bded_ea6bfac45443.slice/crio-d11fd9386ad6c5678e4065e9ce55311db310631f02fed6b96da810b0363bd2ce WatchSource:0}: Error finding container d11fd9386ad6c5678e4065e9ce55311db310631f02fed6b96da810b0363bd2ce: Status 404 returned error can't find the container with id d11fd9386ad6c5678e4065e9ce55311db310631f02fed6b96da810b0363bd2ce
Nov 04 02:35:06.345673 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:06.345630    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"]
Nov 04 02:35:07.042229 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:07.042197    5722 patch_prober.go:29] interesting pod/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Nov 04 02:35:07.042434 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:07.042255    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Nov 04 02:35:07.335270 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:07.335178    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78" event={"ID":"2b5b8b62-db61-4485-aa7a-7c9f38406211","Type":"ContainerStarted","Data":"6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e"}
Nov 04 02:35:07.335696 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:07.335333    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:35:07.336792 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:07.336767    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c" event={"ID":"b5271739-1351-45dc-bded-ea6bfac45443","Type":"ContainerStarted","Data":"90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3"}
Nov 04 02:35:07.336903 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:07.336806    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c" event={"ID":"b5271739-1351-45dc-bded-ea6bfac45443","Type":"ContainerStarted","Data":"d11fd9386ad6c5678e4065e9ce55311db310631f02fed6b96da810b0363bd2ce"}
Nov 04 02:35:07.336903 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:07.336828    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:35:07.455718 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:07.455626    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78" podStartSLOduration=2.4556106939999998 podStartE2EDuration="2.455610694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:35:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:07.45500685 +0000 UTC m=+1118.928544033" watchObservedRunningTime="2026-11-04 02:35:07.455610694 +0000 UTC m=+1118.929147888"
Nov 04 02:35:07.589983 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:07.589516    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c" podStartSLOduration=2.589496886 podStartE2EDuration="2.589496886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:35:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:07.588182267 +0000 UTC m=+1119.061719451" watchObservedRunningTime="2026-11-04 02:35:07.589496886 +0000 UTC m=+1119.063034070"
Nov 04 02:35:08.046406 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:08.046369    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:35:08.046787 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:08.046765    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:35:08.047483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:08.047463    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:35:08.654744 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:08.654705    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd" podUID="aa754e81-71f0-4010-96ea-f4d5bccc33ac" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:35:08.655116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:08.654791    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4" podUID="ba446fbb-6854-4e0a-b266-f8c561fa50fd" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:35:09.884173 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:09.884137    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:10.609805 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:35:10.609770    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:35:13.566422 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.566392    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"]
Nov 04 02:35:13.570012 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.569996    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.677771 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.677736    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"]
Nov 04 02:35:13.684753 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.684727    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.684914 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.684757    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.684914 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.684776    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46833101-49be-437f-8ad5-3d332bdb85e0-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.684914 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.684800    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.685077 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.684938    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.685077 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.684977    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46833101-49be-437f-8ad5-3d332bdb85e0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.685157 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.685129    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.685204 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.685154    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwcsc\" (UniqueName: \"kubernetes.io/projected/46833101-49be-437f-8ad5-3d332bdb85e0-kube-api-access-pwcsc\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.685248 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.685223    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46833101-49be-437f-8ad5-3d332bdb85e0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.786578 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.786538    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.786766 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.786618    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.786766 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.786744    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46833101-49be-437f-8ad5-3d332bdb85e0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.787584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.786942    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.787584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.786971    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcsc\" (UniqueName: \"kubernetes.io/projected/46833101-49be-437f-8ad5-3d332bdb85e0-kube-api-access-pwcsc\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.787584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.787008    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.787584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.787047    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46833101-49be-437f-8ad5-3d332bdb85e0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.787584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.787058    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.787584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.787122    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.787584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.787150    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.787584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.787176    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46833101-49be-437f-8ad5-3d332bdb85e0-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.787584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.787444    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46833101-49be-437f-8ad5-3d332bdb85e0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.788232 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.787751    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.788443 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.788419    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.789835 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.789809    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46833101-49be-437f-8ad5-3d332bdb85e0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.789924 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.789883    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46833101-49be-437f-8ad5-3d332bdb85e0-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.850426 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.850359    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46833101-49be-437f-8ad5-3d332bdb85e0-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.851026 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.851007    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwcsc\" (UniqueName: \"kubernetes.io/projected/46833101-49be-437f-8ad5-3d332bdb85e0-kube-api-access-pwcsc\") pod \"maas-default-gateway-openshift-default-fd4b99879-wpdjn\" (UID: \"46833101-49be-437f-8ad5-3d332bdb85e0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:13.883413 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:13.883389    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:14.303491 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:35:14.303462    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46833101_49be_437f_8ad5_3d332bdb85e0.slice/crio-49fdc86b6380ae60c13fe153a6e690d66a69bb001d110e7e66cb56b2a44a914b WatchSource:0}: Error finding container 49fdc86b6380ae60c13fe153a6e690d66a69bb001d110e7e66cb56b2a44a914b: Status 404 returned error can't find the container with id 49fdc86b6380ae60c13fe153a6e690d66a69bb001d110e7e66cb56b2a44a914b
Nov 04 02:35:14.306844 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:14.306820    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"]
Nov 04 02:35:14.308048 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:14.308016    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:14.308150 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:14.308083    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:14.308150 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:14.308112    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:14.379105 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:14.379073    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn" event={"ID":"46833101-49be-437f-8ad5-3d332bdb85e0","Type":"ContainerStarted","Data":"49fdc86b6380ae60c13fe153a6e690d66a69bb001d110e7e66cb56b2a44a914b"}
Nov 04 02:35:14.502254 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:14.502209    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn" podStartSLOduration=1.502195418 podStartE2EDuration="1.502195418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:14.501716815 +0000 UTC m=+1125.975253999" watchObservedRunningTime="2026-11-04 02:35:14.502195418 +0000 UTC m=+1125.975732622"
Nov 04 02:35:14.884434 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:14.884401    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:15.311739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:15.311372    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:15.406679 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:15.400999    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn" event={"ID":"46833101-49be-437f-8ad5-3d332bdb85e0","Type":"ContainerStarted","Data":"056d49bce9ecb1f57558c9906450cab6c06e7dfe3b0898dce236f0dd2c393588"}
Nov 04 02:35:15.886689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:15.886614    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-wpdjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Nov 04 02:35:15.887188 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:15.886709    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn" podUID="46833101-49be-437f-8ad5-3d332bdb85e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Nov 04 02:35:16.890792 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:16.890757    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-wpdjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Nov 04 02:35:16.891505 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:16.891473    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn" podUID="46833101-49be-437f-8ad5-3d332bdb85e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Nov 04 02:35:17.884107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:17.884068    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-wpdjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Nov 04 02:35:17.884440 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:17.884403    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn" podUID="46833101-49be-437f-8ad5-3d332bdb85e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Nov 04 02:35:18.347312 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:18.347229    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:35:18.347312 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:18.347305    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:35:18.654631 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:18.654583    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4" podUID="ba446fbb-6854-4e0a-b266-f8c561fa50fd" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:35:18.654831 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:18.654597    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd" podUID="aa754e81-71f0-4010-96ea-f4d5bccc33ac" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:35:18.887082 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:18.887048    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-wpdjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Nov 04 02:35:18.887268 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:18.887102    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn" podUID="46833101-49be-437f-8ad5-3d332bdb85e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Nov 04 02:35:18.973995 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:18.973913    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:19.886023 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:19.885983    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-wpdjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Nov 04 02:35:19.886411 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:19.886054    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn" podUID="46833101-49be-437f-8ad5-3d332bdb85e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Nov 04 02:35:20.805679 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:20.805619    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:20.884638 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:20.884609    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-wpdjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Nov 04 02:35:20.884878 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:20.884858    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn" podUID="46833101-49be-437f-8ad5-3d332bdb85e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Nov 04 02:35:21.884161 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:21.884123    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-wpdjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Nov 04 02:35:21.884550 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:21.884188    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn" podUID="46833101-49be-437f-8ad5-3d332bdb85e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Nov 04 02:35:22.746964 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:22.746928    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:22.924947 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:22.924894    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:23.186101 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:23.186066    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:23.508278 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:23.508189    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:23.508694 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:23.508632    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:23.509509 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:23.509489    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-wpdjn"
Nov 04 02:35:26.182891 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.182863    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:26.261933 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.261858    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:35:26.362491 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.362468    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:35:26.391280 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.391251    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aa754e81-71f0-4010-96ea-f4d5bccc33ac-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa754e81-71f0-4010-96ea-f4d5bccc33ac-plugins-config-volume\") pod \"aa754e81-71f0-4010-96ea-f4d5bccc33ac\" (UID: \"aa754e81-71f0-4010-96ea-f4d5bccc33ac\") "
Nov 04 02:35:26.391452 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.391346    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa754e81-71f0-4010-96ea-f4d5bccc33ac-kube-api-access-xfb56\" (UniqueName: \"kubernetes.io/projected/aa754e81-71f0-4010-96ea-f4d5bccc33ac-kube-api-access-xfb56\") pod \"aa754e81-71f0-4010-96ea-f4d5bccc33ac\" (UID: \"aa754e81-71f0-4010-96ea-f4d5bccc33ac\") "
Nov 04 02:35:26.391737 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.391710    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa754e81-71f0-4010-96ea-f4d5bccc33ac-plugins-config-volume" pod "aa754e81-71f0-4010-96ea-f4d5bccc33ac" (UID: "aa754e81-71f0-4010-96ea-f4d5bccc33ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:26.391890 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.391873    5722 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa754e81-71f0-4010-96ea-f4d5bccc33ac-plugins-config-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:26.393589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.393567    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa754e81-71f0-4010-96ea-f4d5bccc33ac-kube-api-access-xfb56" pod "aa754e81-71f0-4010-96ea-f4d5bccc33ac" (UID: "aa754e81-71f0-4010-96ea-f4d5bccc33ac"). InnerVolumeSpecName "kube-api-access-xfb56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:26.488626 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.488592    5722 generic.go:356] "Generic (PLEG): container finished" podID="ba446fbb-6854-4e0a-b266-f8c561fa50fd" containerID="284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b" exitCode=0
Nov 04 02:35:26.488816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.488645    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"
Nov 04 02:35:26.488816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.488684    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4" event={"ID":"ba446fbb-6854-4e0a-b266-f8c561fa50fd","Type":"ContainerDied","Data":"284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b"}
Nov 04 02:35:26.488816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.488736    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4" event={"ID":"ba446fbb-6854-4e0a-b266-f8c561fa50fd","Type":"ContainerDied","Data":"7f8471db983eff02b6f680c20ea00591bb8276b36a32c941a6eacab6f7847c87"}
Nov 04 02:35:26.488816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.488751    5722 scope.go:122] "RemoveContainer" containerID="284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b"
Nov 04 02:35:26.489965 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.489943    5722 generic.go:356] "Generic (PLEG): container finished" podID="aa754e81-71f0-4010-96ea-f4d5bccc33ac" containerID="f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4" exitCode=0
Nov 04 02:35:26.490080 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.489982    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"
Nov 04 02:35:26.490080 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.490024    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd" event={"ID":"aa754e81-71f0-4010-96ea-f4d5bccc33ac","Type":"ContainerDied","Data":"f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4"}
Nov 04 02:35:26.490080 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.490071    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd" event={"ID":"aa754e81-71f0-4010-96ea-f4d5bccc33ac","Type":"ContainerDied","Data":"f3c979c0d4d79f0dd35470dd0e7ba7273667de12cc305fd5773ec9811d62b6d4"}
Nov 04 02:35:26.492321 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.492298    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba446fbb-6854-4e0a-b266-f8c561fa50fd-kube-api-access-55h5b\" (UniqueName: \"kubernetes.io/projected/ba446fbb-6854-4e0a-b266-f8c561fa50fd-kube-api-access-55h5b\") pod \"ba446fbb-6854-4e0a-b266-f8c561fa50fd\" (UID: \"ba446fbb-6854-4e0a-b266-f8c561fa50fd\") "
Nov 04 02:35:26.492444 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.492363    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba446fbb-6854-4e0a-b266-f8c561fa50fd-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba446fbb-6854-4e0a-b266-f8c561fa50fd-plugins-config-volume\") pod \"ba446fbb-6854-4e0a-b266-f8c561fa50fd\" (UID: \"ba446fbb-6854-4e0a-b266-f8c561fa50fd\") "
Nov 04 02:35:26.492835 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.492800    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba446fbb-6854-4e0a-b266-f8c561fa50fd-plugins-config-volume" pod "ba446fbb-6854-4e0a-b266-f8c561fa50fd" (UID: "ba446fbb-6854-4e0a-b266-f8c561fa50fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:26.492924 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.492854    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfb56\" (UniqueName: \"kubernetes.io/projected/aa754e81-71f0-4010-96ea-f4d5bccc33ac-kube-api-access-xfb56\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:26.494861 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.494839    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba446fbb-6854-4e0a-b266-f8c561fa50fd-kube-api-access-55h5b" pod "ba446fbb-6854-4e0a-b266-f8c561fa50fd" (UID: "ba446fbb-6854-4e0a-b266-f8c561fa50fd"). InnerVolumeSpecName "kube-api-access-55h5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:26.498815 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.498794    5722 scope.go:122] "RemoveContainer" containerID="284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b"
Nov 04 02:35:26.502796 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:35:26.502770    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b\": container with ID starting with 284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b not found: ID does not exist" containerID="284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b"
Nov 04 02:35:26.502880 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.502807    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b"} err="failed to get container status \"284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b\": rpc error: code = NotFound desc = could not find container \"284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b\": container with ID starting with 284256b2d554d84736f523a9c69bb03ef948b7f2fc3e9f97bff1541a2b8a680b not found: ID does not exist"
Nov 04 02:35:26.502880 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.502830    5722 scope.go:122] "RemoveContainer" containerID="f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4"
Nov 04 02:35:26.513127 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.513106    5722 scope.go:122] "RemoveContainer" containerID="f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4"
Nov 04 02:35:26.513444 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:35:26.513424    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4\": container with ID starting with f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4 not found: ID does not exist" containerID="f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4"
Nov 04 02:35:26.513500 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.513452    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4"} err="failed to get container status \"f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4\": rpc error: code = NotFound desc = could not find container \"f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4\": container with ID starting with f91552a9a923cda4b90ac8f55058ff7e486cda0753eee68f5922a030bed77eb4 not found: ID does not exist"
Nov 04 02:35:26.594219 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.594195    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55h5b\" (UniqueName: \"kubernetes.io/projected/ba446fbb-6854-4e0a-b266-f8c561fa50fd-kube-api-access-55h5b\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:26.594219 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.594217    5722 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba446fbb-6854-4e0a-b266-f8c561fa50fd-plugins-config-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:26.668055 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.668029    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"]
Nov 04 02:35:26.672667 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.672629    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-a18c43-64f77d44d-s8gjd"]
Nov 04 02:35:26.679790 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.679764    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aa754e81-71f0-4010-96ea-f4d5bccc33ac" path="/var/lib/kubelet/pods/aa754e81-71f0-4010-96ea-f4d5bccc33ac/volumes"
Nov 04 02:35:26.905397 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.905366    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"]
Nov 04 02:35:26.909498 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:26.909476    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-a18c43-c6cc7f675-f88w4"]
Nov 04 02:35:28.681959 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:28.681929    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba446fbb-6854-4e0a-b266-f8c561fa50fd" path="/var/lib/kubelet/pods/ba446fbb-6854-4e0a-b266-f8c561fa50fd/volumes"
Nov 04 02:35:29.288460 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:29.288427    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:29.471626 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:29.471569    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:30.208943 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:30.208911    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:31.433033 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.432997    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"]
Nov 04 02:35:31.433475 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.433461    5722 cpu_manager.go:414] "containerMap: removing container" podUID="ba446fbb-6854-4e0a-b266-f8c561fa50fd" containerName="payload-pre-processing"
Nov 04 02:35:31.433520 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.433476    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba446fbb-6854-4e0a-b266-f8c561fa50fd" containerName="payload-pre-processing"
Nov 04 02:35:31.433520 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.433507    5722 cpu_manager.go:414] "containerMap: removing container" podUID="aa754e81-71f0-4010-96ea-f4d5bccc33ac" containerName="payload-processing"
Nov 04 02:35:31.433520 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.433513    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa754e81-71f0-4010-96ea-f4d5bccc33ac" containerName="payload-processing"
Nov 04 02:35:31.433616 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.433595    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba446fbb-6854-4e0a-b266-f8c561fa50fd" containerName="payload-pre-processing"
Nov 04 02:35:31.433616 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.433607    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="aa754e81-71f0-4010-96ea-f4d5bccc33ac" containerName="payload-processing"
Nov 04 02:35:31.438373 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.438350    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.558111 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.558075    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.558111 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.558115    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.558325 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.558141    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.558325 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.558272    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.558325 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.558304    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.558470 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.558331    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.558470 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.558443    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.558559 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.558502    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.558607 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.558587    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d5fg\" (UniqueName: \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-kube-api-access-9d5fg\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.569326 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.569294    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"]
Nov 04 02:35:31.580731 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.580683    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:31.659684 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.659618    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.659855 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.659735    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.659855 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.659796    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d5fg\" (UniqueName: \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-kube-api-access-9d5fg\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.659941 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.659855    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.659941 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.659883    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.659941 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.659924    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.660035 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.659985    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.660035 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.660013    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.660141 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.660055    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.660209 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.660185    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.660413 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.660357    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.660536 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.660424    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.660716 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.660695    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.661001 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.660981    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.662378 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.662357    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.662974 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.662951    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.725497 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.725427    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d5fg\" (UniqueName: \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-kube-api-access-9d5fg\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.725783 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.725764    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.752850 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.752824    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:31.783672 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.783629    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:31.995980 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:31.995842    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:32.181723 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:32.181675    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:32.215031 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:32.213954    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"]
Nov 04 02:35:32.215546 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:35:32.215516    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119d7b11_8aa9_4f3a_9d84_b49a9803a177.slice/crio-b8e5f37b2a830d17dac8a93a1401d998825f7d798085c015c7ba8fc962fa8fb2 WatchSource:0}: Error finding container b8e5f37b2a830d17dac8a93a1401d998825f7d798085c015c7ba8fc962fa8fb2: Status 404 returned error can't find the container with id b8e5f37b2a830d17dac8a93a1401d998825f7d798085c015c7ba8fc962fa8fb2
Nov 04 02:35:32.228862 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:32.228821    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:32.228987 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:32.228917    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:32.228987 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:32.228957    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:32.389920 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:32.389888    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:32.527059 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:32.526974    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" event={"ID":"119d7b11-8aa9-4f3a-9d84-b49a9803a177","Type":"ContainerStarted","Data":"17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a"}
Nov 04 02:35:32.527059 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:32.527029    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" event={"ID":"119d7b11-8aa9-4f3a-9d84-b49a9803a177","Type":"ContainerStarted","Data":"b8e5f37b2a830d17dac8a93a1401d998825f7d798085c015c7ba8fc962fa8fb2"}
Nov 04 02:35:32.663687 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:32.663622    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" podStartSLOduration=1.663606685 podStartE2EDuration="1.663606685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:32.662909277 +0000 UTC m=+1144.136446472" watchObservedRunningTime="2026-11-04 02:35:32.663606685 +0000 UTC m=+1144.137143866"
Nov 04 02:35:32.754177 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:32.754146    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:33.334712 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:33.334478    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:33.581699 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:33.581171    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:33.754960 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:33.754925    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 04 02:35:33.755149 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:33.754985    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" podUID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 04 02:35:34.753568 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:34.753531    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 04 02:35:34.754008 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:34.753614    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" podUID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 04 02:35:35.753535 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:35.753503    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 04 02:35:35.753735 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:35.753565    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" podUID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 04 02:35:36.753836 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:36.753806    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 04 02:35:36.754302 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:36.753859    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" podUID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 04 02:35:37.204534 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:37.204503    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:37.499276 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:37.498322    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"]
Nov 04 02:35:37.499276 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:37.498903    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8" podUID="7036e465-2346-4f87-9040-5025d4d786f4" containerName="maas-api" containerID="cri-o://f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be" gracePeriod=30
Nov 04 02:35:37.625901 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:37.625853    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:37.835741 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:37.832845    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 04 02:35:37.835741 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:37.832911    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" podUID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 04 02:35:37.963534 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:37.963227    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:35:38.050588 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.050425    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7036e465-2346-4f87-9040-5025d4d786f4-kube-api-access-lmc6m\" (UniqueName: \"kubernetes.io/projected/7036e465-2346-4f87-9040-5025d4d786f4-kube-api-access-lmc6m\") pod \"7036e465-2346-4f87-9040-5025d4d786f4\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") "
Nov 04 02:35:38.051702 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.051675    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7036e465-2346-4f87-9040-5025d4d786f4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7036e465-2346-4f87-9040-5025d4d786f4-openshift-service-ca\") pod \"7036e465-2346-4f87-9040-5025d4d786f4\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") "
Nov 04 02:35:38.052972 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.052703    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7036e465-2346-4f87-9040-5025d4d786f4-openshift-service-ca" pod "7036e465-2346-4f87-9040-5025d4d786f4" (UID: "7036e465-2346-4f87-9040-5025d4d786f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:38.052972 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.052889    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-metrics-certs\") pod \"7036e465-2346-4f87-9040-5025d4d786f4\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") "
Nov 04 02:35:38.052972 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.052950    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-maas-api-tls\") pod \"7036e465-2346-4f87-9040-5025d4d786f4\" (UID: \"7036e465-2346-4f87-9040-5025d4d786f4\") "
Nov 04 02:35:38.054165 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.053490    5722 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7036e465-2346-4f87-9040-5025d4d786f4-openshift-service-ca\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:38.069260 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.069213    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-maas-api-tls" pod "7036e465-2346-4f87-9040-5025d4d786f4" (UID: "7036e465-2346-4f87-9040-5025d4d786f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:35:38.077326 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.076948    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7036e465-2346-4f87-9040-5025d4d786f4-kube-api-access-lmc6m" pod "7036e465-2346-4f87-9040-5025d4d786f4" (UID: "7036e465-2346-4f87-9040-5025d4d786f4"). InnerVolumeSpecName "kube-api-access-lmc6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:38.100759 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.100251    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-metrics-certs" pod "7036e465-2346-4f87-9040-5025d4d786f4" (UID: "7036e465-2346-4f87-9040-5025d4d786f4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:35:38.154146 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.154111    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmc6m\" (UniqueName: \"kubernetes.io/projected/7036e465-2346-4f87-9040-5025d4d786f4-kube-api-access-lmc6m\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:38.154146 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.154141    5722 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-metrics-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:38.154146 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.154150    5722 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7036e465-2346-4f87-9040-5025d4d786f4-maas-api-tls\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:38.348679 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.348598    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"]
Nov 04 02:35:38.356729 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.356564    5722 cpu_manager.go:414] "containerMap: removing container" podUID="7036e465-2346-4f87-9040-5025d4d786f4" containerName="maas-api"
Nov 04 02:35:38.356729 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.356594    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7036e465-2346-4f87-9040-5025d4d786f4" containerName="maas-api"
Nov 04 02:35:38.357036 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.356779    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="7036e465-2346-4f87-9040-5025d4d786f4" containerName="maas-api"
Nov 04 02:35:38.366694 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.366401    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.410697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.409897    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"]
Nov 04 02:35:38.433556 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.431620    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-ab61a8\"/\"kube-root-ca.crt\""
Nov 04 02:35:38.433556 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.432909    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-b-ab61a8\"/\"agc-cred-fcd78004850a\""
Nov 04 02:35:38.433556 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.433036    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-b-ab61a8\"/\"payload-processing-external-model-e2e--c850f481-dockercfg-sfwt2\""
Nov 04 02:35:38.433556 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.433128    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-ab61a8\"/\"payload-processing-external-model-plugins-e2e-extmod-b-ab61a8\""
Nov 04 02:35:38.433556 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.433198    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-ab61a8\"/\"routing-overlay\""
Nov 04 02:35:38.433556 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.433280    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-ab61a8\"/\"openshift-service-ca.crt\""
Nov 04 02:35:38.460091 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.459371    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7mv9\" (UniqueName: \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-kube-api-access-t7mv9\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.460091 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.459812    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.460091 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.459969    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.460091 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.460010    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.573722 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.573473    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.575689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.574639    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.575689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.574748    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.575689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.574905    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7mv9\" (UniqueName: \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-kube-api-access-t7mv9\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.575689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.574517    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.596680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.580463    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.622777 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.621343    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.632758 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.627793    5722 generic.go:356] "Generic (PLEG): container finished" podID="7036e465-2346-4f87-9040-5025d4d786f4" containerID="f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be" exitCode=0
Nov 04 02:35:38.632758 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.627948    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8" event={"ID":"7036e465-2346-4f87-9040-5025d4d786f4","Type":"ContainerDied","Data":"f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be"}
Nov 04 02:35:38.632758 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.628006    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8" event={"ID":"7036e465-2346-4f87-9040-5025d4d786f4","Type":"ContainerDied","Data":"551fa3ad34bb9603d6c79e8d3ac20e64521f090c17b149f20e973943a763f3d8"}
Nov 04 02:35:38.632758 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.628038    5722 scope.go:122] "RemoveContainer" containerID="f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be"
Nov 04 02:35:38.632758 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.628185    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"
Nov 04 02:35:38.656778 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.655755    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7mv9\" (UniqueName: \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-kube-api-access-t7mv9\") pod \"payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") " pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.685244 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.685214    5722 scope.go:122] "RemoveContainer" containerID="f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be"
Nov 04 02:35:38.687893 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:35:38.687774    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be\": container with ID starting with f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be not found: ID does not exist" containerID="f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be"
Nov 04 02:35:38.687893 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.687823    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be"} err="failed to get container status \"f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be\": rpc error: code = NotFound desc = could not find container \"f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be\": container with ID starting with f61b429fe81d5603c1f0f531175cc654ccac7747e4bbc023e54ab235edbe09be not found: ID does not exist"
Nov 04 02:35:38.699784 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.698580    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:38.753974 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.753943    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Nov 04 02:35:38.754156 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.754007    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" podUID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Nov 04 02:35:38.813834 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.813796    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"]
Nov 04 02:35:38.825022 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:38.824989    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8"]
Nov 04 02:35:39.091968 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:35:39.091935    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4a687a_d9d4_4c98_9203_9d5a2fc1aa96.slice/crio-9b5533a0361129061837295f91a497ba80eec4d612ac6484f28e23e2698c1773 WatchSource:0}: Error finding container 9b5533a0361129061837295f91a497ba80eec4d612ac6484f28e23e2698c1773: Status 404 returned error can't find the container with id 9b5533a0361129061837295f91a497ba80eec4d612ac6484f28e23e2698c1773
Nov 04 02:35:39.095789 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:39.095766    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"]
Nov 04 02:35:39.594975 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:39.594925    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:39.684303 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:39.668964    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt" event={"ID":"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96","Type":"ContainerStarted","Data":"7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8"}
Nov 04 02:35:39.684303 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:39.674759    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt" event={"ID":"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96","Type":"ContainerStarted","Data":"9b5533a0361129061837295f91a497ba80eec4d612ac6484f28e23e2698c1773"}
Nov 04 02:35:39.684303 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:39.675801    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:39.797313 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:39.797239    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt" podStartSLOduration=1.797221824 podStartE2EDuration="1.797221824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:39.795185883 +0000 UTC m=+1151.268723061" watchObservedRunningTime="2026-11-04 02:35:39.797221824 +0000 UTC m=+1151.270759007"
Nov 04 02:35:40.031824 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:40.031780    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:40.032098 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:40.032079    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:40.032884 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:40.032865    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:40.611038 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:35:40.610998    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:35:40.682097 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:40.682060    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7036e465-2346-4f87-9040-5025d4d786f4" path="/var/lib/kubelet/pods/7036e465-2346-4f87-9040-5025d4d786f4/volumes"
Nov 04 02:35:40.698584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:40.698550    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-a18c43-7b69fb85bf-lc4r8" podUID="7036e465-2346-4f87-9040-5025d4d786f4" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.41:8443/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:35:44.541606 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:44.541571    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:44.732246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:44.732217    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:45.164739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:45.158739    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:46.473468 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.473427    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:46.507576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.507539    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"]
Nov 04 02:35:46.511418 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.511401    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.577609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.577582    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.577755 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.577633    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.577755 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.577687    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.577869 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.577775    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.577933 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.577906    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.577985 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.577958    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.578089 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.578064    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx25d\" (UniqueName: \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-kube-api-access-jx25d\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.578122 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.578113    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.578229 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.578209    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.630035 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.630004    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"]
Nov 04 02:35:46.679301 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.679275    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.679301 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.679304    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.679543 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.679324    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.679543 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.679361    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.679543 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.679392    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.679543 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.679422    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx25d\" (UniqueName: \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-kube-api-access-jx25d\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.679543 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.679452    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.679543 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.679513    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.680006 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.679645    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.680232 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.680121    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.680232 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.680144    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.680442 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.680415    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.680506 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.680440    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.680676 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.680631    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.682709 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.682686    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.682827 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.682807    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.749972 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.749908    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.754327 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.754302    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx25d\" (UniqueName: \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-kube-api-access-jx25d\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.826137 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.826108    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:46.924379 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.924174    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"]
Nov 04 02:35:46.925683 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.924527    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" podUID="55cfec76-aee9-46aa-ab04-d4a19030adc7" containerName="istio-proxy" containerID="cri-o://6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56" gracePeriod=30
Nov 04 02:35:46.935008 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.934972    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"]
Nov 04 02:35:46.935464 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.935390    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" podUID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" containerName="istio-proxy" containerID="cri-o://17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a" gracePeriod=30
Nov 04 02:35:46.943161 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.943114    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"]
Nov 04 02:35:46.946337 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.946313    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"]
Nov 04 02:35:46.946544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:46.946521    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" podUID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" containerName="istio-proxy" containerID="cri-o://774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2" gracePeriod=30
Nov 04 02:35:47.044311 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:47.044219    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:47.255767 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:47.255736    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:47.262628 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:35:47.262600    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb7285e_0754_459a_a3a8_cdb6adfac0e2.slice/crio-5ddfbc7c94389c134a0aa3d13485f92cca0cd97b1a845ee8f8f88b2b9903498e WatchSource:0}: Error finding container 5ddfbc7c94389c134a0aa3d13485f92cca0cd97b1a845ee8f8f88b2b9903498e: Status 404 returned error can't find the container with id 5ddfbc7c94389c134a0aa3d13485f92cca0cd97b1a845ee8f8f88b2b9903498e
Nov 04 02:35:47.263261 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:47.263213    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"]
Nov 04 02:35:47.265127 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:47.265095    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:47.265235 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:47.265171    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:47.265235 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:47.265211    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:35:47.465362 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:47.465322    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:47.763835 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:47.763792    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp" event={"ID":"cfb7285e-0754-459a-a3a8-cdb6adfac0e2","Type":"ContainerStarted","Data":"7c7a01362ff1ead349fc7707fff2bd914cf752a8ff95ab6d4eb7714081ee53ff"}
Nov 04 02:35:47.764483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:47.764455    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp" event={"ID":"cfb7285e-0754-459a-a3a8-cdb6adfac0e2","Type":"ContainerStarted","Data":"5ddfbc7c94389c134a0aa3d13485f92cca0cd97b1a845ee8f8f88b2b9903498e"}
Nov 04 02:35:47.764832 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:47.764804    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp" podUID="cfb7285e-0754-459a-a3a8-cdb6adfac0e2" containerName="istio-proxy" containerID="cri-o://7c7a01362ff1ead349fc7707fff2bd914cf752a8ff95ab6d4eb7714081ee53ff" gracePeriod=30
Nov 04 02:35:47.892681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:47.892264    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp" podStartSLOduration=1.892249229 podStartE2EDuration="1.892249229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:47.891310845 +0000 UTC m=+1159.364848029" watchObservedRunningTime="2026-11-04 02:35:47.892249229 +0000 UTC m=+1159.365786389"
Nov 04 02:35:49.995680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:49.994842    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-7r6mg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 02:35:49.995680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:49.994943    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" podUID="bde9bff4-3d54-471d-ae04-e7fa835fb4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:35:51.513633 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:51.513554    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:51.658371 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:51.658290    5722 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 02:35:51.658371 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:51.658344    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" podUID="55cfec76-aee9-46aa-ab04-d4a19030adc7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 02:35:51.692426 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:51.692395    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:35:52.230515 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.230484    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:35:52.262544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.262521    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-data\") pod \"55cfec76-aee9-46aa-ab04-d4a19030adc7\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") "
Nov 04 02:35:52.262689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.262591    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-socket\") pod \"55cfec76-aee9-46aa-ab04-d4a19030adc7\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") "
Nov 04 02:35:52.262765 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.262693    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-kube-api-access-4sghw\" (UniqueName: \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-kube-api-access-4sghw\") pod \"55cfec76-aee9-46aa-ab04-d4a19030adc7\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") "
Nov 04 02:35:52.262765 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.262734    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-certs\") pod \"55cfec76-aee9-46aa-ab04-d4a19030adc7\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") "
Nov 04 02:35:52.262886 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.262769    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-token\" (UniqueName: \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-token\") pod \"55cfec76-aee9-46aa-ab04-d4a19030adc7\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") "
Nov 04 02:35:52.262886 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.262834    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-envoy\") pod \"55cfec76-aee9-46aa-ab04-d4a19030adc7\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") "
Nov 04 02:35:52.262886 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.262838    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-data" pod "55cfec76-aee9-46aa-ab04-d4a19030adc7" (UID: "55cfec76-aee9-46aa-ab04-d4a19030adc7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.262886 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.262873    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-podinfo\") pod \"55cfec76-aee9-46aa-ab04-d4a19030adc7\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") "
Nov 04 02:35:52.263087 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.262958    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/55cfec76-aee9-46aa-ab04-d4a19030adc7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55cfec76-aee9-46aa-ab04-d4a19030adc7-istiod-ca-cert\") pod \"55cfec76-aee9-46aa-ab04-d4a19030adc7\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") "
Nov 04 02:35:52.263087 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.262961    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-socket" pod "55cfec76-aee9-46aa-ab04-d4a19030adc7" (UID: "55cfec76-aee9-46aa-ab04-d4a19030adc7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.263087 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.262997    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-credential-socket\") pod \"55cfec76-aee9-46aa-ab04-d4a19030adc7\" (UID: \"55cfec76-aee9-46aa-ab04-d4a19030adc7\") "
Nov 04 02:35:52.263282 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.263255    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-certs" pod "55cfec76-aee9-46aa-ab04-d4a19030adc7" (UID: "55cfec76-aee9-46aa-ab04-d4a19030adc7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.263389 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.263368    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55cfec76-aee9-46aa-ab04-d4a19030adc7-istiod-ca-cert" pod "55cfec76-aee9-46aa-ab04-d4a19030adc7" (UID: "55cfec76-aee9-46aa-ab04-d4a19030adc7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:52.263669 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.263613    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-credential-socket" pod "55cfec76-aee9-46aa-ab04-d4a19030adc7" (UID: "55cfec76-aee9-46aa-ab04-d4a19030adc7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.263770 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.263743    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55cfec76-aee9-46aa-ab04-d4a19030adc7-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.263855 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.263802    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.263855 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.263816    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.263855 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.263829    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.266073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.266037    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-envoy" pod "55cfec76-aee9-46aa-ab04-d4a19030adc7" (UID: "55cfec76-aee9-46aa-ab04-d4a19030adc7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.266073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.266058    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-kube-api-access-4sghw" pod "55cfec76-aee9-46aa-ab04-d4a19030adc7" (UID: "55cfec76-aee9-46aa-ab04-d4a19030adc7"). InnerVolumeSpecName "kube-api-access-4sghw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.266200 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.266087    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-podinfo" pod "55cfec76-aee9-46aa-ab04-d4a19030adc7" (UID: "55cfec76-aee9-46aa-ab04-d4a19030adc7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:35:52.266200 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.266112    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-token" pod "55cfec76-aee9-46aa-ab04-d4a19030adc7" (UID: "55cfec76-aee9-46aa-ab04-d4a19030adc7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.266200 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.266144    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:35:52.275714 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.275697    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:52.364979 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.364950    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istiod-ca-cert\") pod \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") "
Nov 04 02:35:52.365226 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365003    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-certs\") pod \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") "
Nov 04 02:35:52.365226 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365040    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-socket\") pod \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") "
Nov 04 02:35:52.365226 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365069    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-envoy\") pod \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") "
Nov 04 02:35:52.365226 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365101    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istiod-ca-cert\") pod \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") "
Nov 04 02:35:52.365226 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365134    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-data\") pod \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") "
Nov 04 02:35:52.365226 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365173    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-kube-api-access-9d5fg\" (UniqueName: \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-kube-api-access-9d5fg\") pod \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") "
Nov 04 02:35:52.365226 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365228    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-envoy\") pod \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") "
Nov 04 02:35:52.365609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365254    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-token\" (UniqueName: \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-token\") pod \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") "
Nov 04 02:35:52.365609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365299    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-podinfo\") pod \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") "
Nov 04 02:35:52.365609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365336    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-credential-socket\") pod \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") "
Nov 04 02:35:52.365609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365358    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istiod-ca-cert" pod "119d7b11-8aa9-4f3a-9d84-b49a9803a177" (UID: "119d7b11-8aa9-4f3a-9d84-b49a9803a177"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:52.365609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365380    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-socket\") pod \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") "
Nov 04 02:35:52.365609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365423    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-podinfo\") pod \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") "
Nov 04 02:35:52.365609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365460    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-credential-socket\") pod \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") "
Nov 04 02:35:52.365609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365505    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-certs\") pod \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") "
Nov 04 02:35:52.365609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365542    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istiod-ca-cert" pod "d2a26874-2087-4dd3-ae6e-b0f4f51afce3" (UID: "d2a26874-2087-4dd3-ae6e-b0f4f51afce3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:52.365609 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365551    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-data\") pod \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\" (UID: \"119d7b11-8aa9-4f3a-9d84-b49a9803a177\") "
Nov 04 02:35:52.366104 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365696    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-socket" pod "119d7b11-8aa9-4f3a-9d84-b49a9803a177" (UID: "119d7b11-8aa9-4f3a-9d84-b49a9803a177"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.366104 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365733    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-data" pod "119d7b11-8aa9-4f3a-9d84-b49a9803a177" (UID: "119d7b11-8aa9-4f3a-9d84-b49a9803a177"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.366104 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365745    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-token\" (UniqueName: \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-token\") pod \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") "
Nov 04 02:35:52.366104 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365781    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-kube-api-access-7745z\" (UniqueName: \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-kube-api-access-7745z\") pod \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\" (UID: \"d2a26874-2087-4dd3-ae6e-b0f4f51afce3\") "
Nov 04 02:35:52.366104 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365899    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-credential-socket" pod "119d7b11-8aa9-4f3a-9d84-b49a9803a177" (UID: "119d7b11-8aa9-4f3a-9d84-b49a9803a177"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.366104 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.365930    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-data" pod "d2a26874-2087-4dd3-ae6e-b0f4f51afce3" (UID: "d2a26874-2087-4dd3-ae6e-b0f4f51afce3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.366347 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366106    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-socket" pod "d2a26874-2087-4dd3-ae6e-b0f4f51afce3" (UID: "d2a26874-2087-4dd3-ae6e-b0f4f51afce3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.366413 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366352    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.366413 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366375    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.366413 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366390    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.366413 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366405    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.366618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366419    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55cfec76-aee9-46aa-ab04-d4a19030adc7-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.366618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366434    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.366618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366447    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.366618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366461    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.366618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366479    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.366618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366493    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.366618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366507    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sghw\" (UniqueName: \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-kube-api-access-4sghw\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.366618 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366521    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55cfec76-aee9-46aa-ab04-d4a19030adc7-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.367193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366880    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-certs" pod "d2a26874-2087-4dd3-ae6e-b0f4f51afce3" (UID: "d2a26874-2087-4dd3-ae6e-b0f4f51afce3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.367193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.366897    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-credential-socket" pod "d2a26874-2087-4dd3-ae6e-b0f4f51afce3" (UID: "d2a26874-2087-4dd3-ae6e-b0f4f51afce3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.367193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.367081    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-certs" pod "119d7b11-8aa9-4f3a-9d84-b49a9803a177" (UID: "119d7b11-8aa9-4f3a-9d84-b49a9803a177"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.368939 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.368754    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-kube-api-access-9d5fg" pod "119d7b11-8aa9-4f3a-9d84-b49a9803a177" (UID: "119d7b11-8aa9-4f3a-9d84-b49a9803a177"). InnerVolumeSpecName "kube-api-access-9d5fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.369545 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.369524    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-envoy" pod "119d7b11-8aa9-4f3a-9d84-b49a9803a177" (UID: "119d7b11-8aa9-4f3a-9d84-b49a9803a177"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.370030 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.370003    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-kube-api-access-7745z" pod "d2a26874-2087-4dd3-ae6e-b0f4f51afce3" (UID: "d2a26874-2087-4dd3-ae6e-b0f4f51afce3"). InnerVolumeSpecName "kube-api-access-7745z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.370139 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.370096    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-podinfo" pod "d2a26874-2087-4dd3-ae6e-b0f4f51afce3" (UID: "d2a26874-2087-4dd3-ae6e-b0f4f51afce3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:35:52.370205 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.370173    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-token" pod "d2a26874-2087-4dd3-ae6e-b0f4f51afce3" (UID: "d2a26874-2087-4dd3-ae6e-b0f4f51afce3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.370316 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.370295    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-envoy" pod "d2a26874-2087-4dd3-ae6e-b0f4f51afce3" (UID: "d2a26874-2087-4dd3-ae6e-b0f4f51afce3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.370478 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.370456    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-token" pod "119d7b11-8aa9-4f3a-9d84-b49a9803a177" (UID: "119d7b11-8aa9-4f3a-9d84-b49a9803a177"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.371643 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.371619    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-podinfo" pod "119d7b11-8aa9-4f3a-9d84-b49a9803a177" (UID: "119d7b11-8aa9-4f3a-9d84-b49a9803a177"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:35:52.468093 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.468037    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d5fg\" (UniqueName: \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-kube-api-access-9d5fg\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.468093 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.468062    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.468093 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.468071    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.468093 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.468081    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.468093 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.468089    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.468308 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.468097    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.468308 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.468105    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.468308 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.468113    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.468308 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.468122    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7745z\" (UniqueName: \"kubernetes.io/projected/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-kube-api-access-7745z\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.468308 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.468130    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2a26874-2087-4dd3-ae6e-b0f4f51afce3-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.468308 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.468139    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/119d7b11-8aa9-4f3a-9d84-b49a9803a177-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.838050 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.838016    5722 generic.go:356] "Generic (PLEG): container finished" podID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" containerID="17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a" exitCode=0
Nov 04 02:35:52.838449 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.838066    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"
Nov 04 02:35:52.838449 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.838106    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" event={"ID":"119d7b11-8aa9-4f3a-9d84-b49a9803a177","Type":"ContainerDied","Data":"17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a"}
Nov 04 02:35:52.838449 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.838153    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5" event={"ID":"119d7b11-8aa9-4f3a-9d84-b49a9803a177","Type":"ContainerDied","Data":"b8e5f37b2a830d17dac8a93a1401d998825f7d798085c015c7ba8fc962fa8fb2"}
Nov 04 02:35:52.838449 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.838179    5722 scope.go:122] "RemoveContainer" containerID="17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a"
Nov 04 02:35:52.839730 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.839714    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"
Nov 04 02:35:52.839826 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.839758    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" event={"ID":"d2a26874-2087-4dd3-ae6e-b0f4f51afce3","Type":"ContainerDied","Data":"774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2"}
Nov 04 02:35:52.839874 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.839830    5722 generic.go:356] "Generic (PLEG): container finished" podID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" containerID="774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2" exitCode=0
Nov 04 02:35:52.839946 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.839931    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh" event={"ID":"d2a26874-2087-4dd3-ae6e-b0f4f51afce3","Type":"ContainerDied","Data":"326b64ea49cfc2b4e3072d4104bb72aad3a7da213dd85be6e64a8b0495cb5fa4"}
Nov 04 02:35:52.841271 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.841250    5722 generic.go:356] "Generic (PLEG): container finished" podID="55cfec76-aee9-46aa-ab04-d4a19030adc7" containerID="6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56" exitCode=0
Nov 04 02:35:52.841374 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.841297    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"
Nov 04 02:35:52.841374 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.841332    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" event={"ID":"55cfec76-aee9-46aa-ab04-d4a19030adc7","Type":"ContainerDied","Data":"6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56"}
Nov 04 02:35:52.841374 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.841370    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8" event={"ID":"55cfec76-aee9-46aa-ab04-d4a19030adc7","Type":"ContainerDied","Data":"713ee127a4b94a014890116c0b59fd741e3855d21558041812c6283c0f479b52"}
Nov 04 02:35:52.842976 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.842953    5722 generic.go:356] "Generic (PLEG): container finished" podID="cfb7285e-0754-459a-a3a8-cdb6adfac0e2" containerID="7c7a01362ff1ead349fc7707fff2bd914cf752a8ff95ab6d4eb7714081ee53ff" exitCode=0
Nov 04 02:35:52.843058 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.842980    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp" event={"ID":"cfb7285e-0754-459a-a3a8-cdb6adfac0e2","Type":"ContainerDied","Data":"7c7a01362ff1ead349fc7707fff2bd914cf752a8ff95ab6d4eb7714081ee53ff"}
Nov 04 02:35:52.854589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.854561    5722 scope.go:122] "RemoveContainer" containerID="17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a"
Nov 04 02:35:52.854862 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:35:52.854840    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a\": container with ID starting with 17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a not found: ID does not exist" containerID="17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a"
Nov 04 02:35:52.854990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.854873    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a"} err="failed to get container status \"17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a\": rpc error: code = NotFound desc = could not find container \"17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a\": container with ID starting with 17c3aeadfac900df06d755824491db8e0fe6ce3f4dc9457306896aadd789412a not found: ID does not exist"
Nov 04 02:35:52.854990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.854897    5722 scope.go:122] "RemoveContainer" containerID="774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2"
Nov 04 02:35:52.862978 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.862961    5722 scope.go:122] "RemoveContainer" containerID="774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2"
Nov 04 02:35:52.863250 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:35:52.863231    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2\": container with ID starting with 774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2 not found: ID does not exist" containerID="774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2"
Nov 04 02:35:52.863299 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.863259    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2"} err="failed to get container status \"774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2\": rpc error: code = NotFound desc = could not find container \"774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2\": container with ID starting with 774774c5b9249ec3db904e7eadfd6ba7bb22af087207c9020407b5a1d4db91f2 not found: ID does not exist"
Nov 04 02:35:52.863299 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.863279    5722 scope.go:122] "RemoveContainer" containerID="6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56"
Nov 04 02:35:52.871458 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.871441    5722 scope.go:122] "RemoveContainer" containerID="6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56"
Nov 04 02:35:52.871768 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:35:52.871747    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56\": container with ID starting with 6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56 not found: ID does not exist" containerID="6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56"
Nov 04 02:35:52.871833 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:52.871775    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56"} err="failed to get container status \"6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56\": rpc error: code = NotFound desc = could not find container \"6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56\": container with ID starting with 6c29e4baadfbddd50a5e948390dbe5c34755ee68db6ee733190e22caf7d37d56 not found: ID does not exist"
Nov 04 02:35:53.010166 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.010143    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"]
Nov 04 02:35:53.061764 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.061689    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-bp8n5"]
Nov 04 02:35:53.177348 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.177314    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"]
Nov 04 02:35:53.182614 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.182590    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-sxcxh"]
Nov 04 02:35:53.295201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.295173    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"]
Nov 04 02:35:53.297052 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.297030    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-5sff8"]
Nov 04 02:35:53.450186 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.450157    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:53.478136 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478111    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-certs\") pod \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") "
Nov 04 02:35:53.478242 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478199    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-data\") pod \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") "
Nov 04 02:35:53.478297 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478255    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istiod-ca-cert\") pod \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") "
Nov 04 02:35:53.478351 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478300    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-podinfo\") pod \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") "
Nov 04 02:35:53.478351 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478321    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-envoy\") pod \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") "
Nov 04 02:35:53.478458 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478361    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-credential-socket\") pod \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") "
Nov 04 02:35:53.478458 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478377    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-data" pod "cfb7285e-0754-459a-a3a8-cdb6adfac0e2" (UID: "cfb7285e-0754-459a-a3a8-cdb6adfac0e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:53.478458 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478385    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-certs" pod "cfb7285e-0754-459a-a3a8-cdb6adfac0e2" (UID: "cfb7285e-0754-459a-a3a8-cdb6adfac0e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:53.478458 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478422    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-kube-api-access-jx25d\" (UniqueName: \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-kube-api-access-jx25d\") pod \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") "
Nov 04 02:35:53.478458 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478446    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-token\" (UniqueName: \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-token\") pod \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") "
Nov 04 02:35:53.478752 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478485    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-socket\") pod \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\" (UID: \"cfb7285e-0754-459a-a3a8-cdb6adfac0e2\") "
Nov 04 02:35:53.478813 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478740    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-credential-socket" pod "cfb7285e-0754-459a-a3a8-cdb6adfac0e2" (UID: "cfb7285e-0754-459a-a3a8-cdb6adfac0e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:53.478869 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478814    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istiod-ca-cert" pod "cfb7285e-0754-459a-a3a8-cdb6adfac0e2" (UID: "cfb7285e-0754-459a-a3a8-cdb6adfac0e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:53.478869 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.478826    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-socket" pod "cfb7285e-0754-459a-a3a8-cdb6adfac0e2" (UID: "cfb7285e-0754-459a-a3a8-cdb6adfac0e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:53.479057 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.479039    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.479136 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.479065    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.479136 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.479079    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.479136 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.479093    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.479136 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.479107    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.480709 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.480636    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-podinfo" pod "cfb7285e-0754-459a-a3a8-cdb6adfac0e2" (UID: "cfb7285e-0754-459a-a3a8-cdb6adfac0e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:35:53.480844 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.480825    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-kube-api-access-jx25d" pod "cfb7285e-0754-459a-a3a8-cdb6adfac0e2" (UID: "cfb7285e-0754-459a-a3a8-cdb6adfac0e2"). InnerVolumeSpecName "kube-api-access-jx25d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:53.481131 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.481106    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-envoy" pod "cfb7285e-0754-459a-a3a8-cdb6adfac0e2" (UID: "cfb7285e-0754-459a-a3a8-cdb6adfac0e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:53.481131 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.481121    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-token" pod "cfb7285e-0754-459a-a3a8-cdb6adfac0e2" (UID: "cfb7285e-0754-459a-a3a8-cdb6adfac0e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:53.580148 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.580122    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.580148 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.580149    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.580317 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.580164    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx25d\" (UniqueName: \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-kube-api-access-jx25d\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.580317 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.580180    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfb7285e-0754-459a-a3a8-cdb6adfac0e2-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:53.850833 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.850805    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"
Nov 04 02:35:53.851293 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.850845    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp" event={"ID":"cfb7285e-0754-459a-a3a8-cdb6adfac0e2","Type":"ContainerDied","Data":"5ddfbc7c94389c134a0aa3d13485f92cca0cd97b1a845ee8f8f88b2b9903498e"}
Nov 04 02:35:53.851293 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:53.850904    5722 scope.go:122] "RemoveContainer" containerID="7c7a01362ff1ead349fc7707fff2bd914cf752a8ff95ab6d4eb7714081ee53ff"
Nov 04 02:35:54.040645 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:54.040615    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"]
Nov 04 02:35:54.054911 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:54.054888    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dhmzp"]
Nov 04 02:35:54.681249 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:54.681221    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" path="/var/lib/kubelet/pods/119d7b11-8aa9-4f3a-9d84-b49a9803a177/volumes"
Nov 04 02:35:54.681633 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:54.681619    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="55cfec76-aee9-46aa-ab04-d4a19030adc7" path="/var/lib/kubelet/pods/55cfec76-aee9-46aa-ab04-d4a19030adc7/volumes"
Nov 04 02:35:54.682051 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:54.682039    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cfb7285e-0754-459a-a3a8-cdb6adfac0e2" path="/var/lib/kubelet/pods/cfb7285e-0754-459a-a3a8-cdb6adfac0e2/volumes"
Nov 04 02:35:54.682768 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:54.682748    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" path="/var/lib/kubelet/pods/d2a26874-2087-4dd3-ae6e-b0f4f51afce3/volumes"
Nov 04 02:35:56.716062 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:56.716023    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:35:57.195256 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:35:57.195222    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:00.894053 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:00.894019    5722 generic.go:356] "Generic (PLEG): container finished" podID="cb45a256-d8c5-4c00-9b11-b22a4948acd6" containerID="e14cdef774988d48474c8a954d471f4d1ffe2c4dbcaee173aa5b21a1b1f476d1" exitCode=0
Nov 04 02:36:00.894405 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:00.894092    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xjq4v-74j97" event={"ID":"cb45a256-d8c5-4c00-9b11-b22a4948acd6","Type":"ContainerDied","Data":"e14cdef774988d48474c8a954d471f4d1ffe2c4dbcaee173aa5b21a1b1f476d1"}
Nov 04 02:36:02.072289 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.072265    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:36:02.177223 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.177138    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-service-ca-bundle\") pod \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") "
Nov 04 02:36:02.177223 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.177217    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-trusted-ca-bundle\") pod \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") "
Nov 04 02:36:02.177434 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.177316    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb45a256-d8c5-4c00-9b11-b22a4948acd6-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cb45a256-d8c5-4c00-9b11-b22a4948acd6-archives-path\") pod \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") "
Nov 04 02:36:02.177434 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.177389    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb45a256-d8c5-4c00-9b11-b22a4948acd6-kube-api-access-qpz59\" (UniqueName: \"kubernetes.io/projected/cb45a256-d8c5-4c00-9b11-b22a4948acd6-kube-api-access-qpz59\") pod \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\" (UID: \"cb45a256-d8c5-4c00-9b11-b22a4948acd6\") "
Nov 04 02:36:02.177550 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.177489    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-service-ca-bundle" pod "cb45a256-d8c5-4c00-9b11-b22a4948acd6" (UID: "cb45a256-d8c5-4c00-9b11-b22a4948acd6"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:36:02.177633 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.177609    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-trusted-ca-bundle" pod "cb45a256-d8c5-4c00-9b11-b22a4948acd6" (UID: "cb45a256-d8c5-4c00-9b11-b22a4948acd6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:36:02.177725 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.177682    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb45a256-d8c5-4c00-9b11-b22a4948acd6-archives-path" pod "cb45a256-d8c5-4c00-9b11-b22a4948acd6" (UID: "cb45a256-d8c5-4c00-9b11-b22a4948acd6"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:36:02.177854 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.177839    5722 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-service-ca-bundle\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:02.177892 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.177858    5722 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb45a256-d8c5-4c00-9b11-b22a4948acd6-trusted-ca-bundle\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:02.177892 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.177869    5722 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cb45a256-d8c5-4c00-9b11-b22a4948acd6-archives-path\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:02.179820 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.179797    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb45a256-d8c5-4c00-9b11-b22a4948acd6-kube-api-access-qpz59" pod "cb45a256-d8c5-4c00-9b11-b22a4948acd6" (UID: "cb45a256-d8c5-4c00-9b11-b22a4948acd6"). InnerVolumeSpecName "kube-api-access-qpz59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:36:02.279482 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.279447    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpz59\" (UniqueName: \"kubernetes.io/projected/cb45a256-d8c5-4c00-9b11-b22a4948acd6-kube-api-access-qpz59\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:02.359233 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359201    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"]
Nov 04 02:36:02.359699 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359684    5722 cpu_manager.go:414] "containerMap: removing container" podUID="cb45a256-d8c5-4c00-9b11-b22a4948acd6" containerName="insights-gathering"
Nov 04 02:36:02.359699 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359699    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb45a256-d8c5-4c00-9b11-b22a4948acd6" containerName="insights-gathering"
Nov 04 02:36:02.359814 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359707    5722 cpu_manager.go:414] "containerMap: removing container" podUID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" containerName="istio-proxy"
Nov 04 02:36:02.359814 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359712    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" containerName="istio-proxy"
Nov 04 02:36:02.359814 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359724    5722 cpu_manager.go:414] "containerMap: removing container" podUID="cfb7285e-0754-459a-a3a8-cdb6adfac0e2" containerName="istio-proxy"
Nov 04 02:36:02.359814 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359730    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cfb7285e-0754-459a-a3a8-cdb6adfac0e2" containerName="istio-proxy"
Nov 04 02:36:02.359814 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359754    5722 cpu_manager.go:414] "containerMap: removing container" podUID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" containerName="istio-proxy"
Nov 04 02:36:02.359814 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359759    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" containerName="istio-proxy"
Nov 04 02:36:02.359814 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359766    5722 cpu_manager.go:414] "containerMap: removing container" podUID="55cfec76-aee9-46aa-ab04-d4a19030adc7" containerName="istio-proxy"
Nov 04 02:36:02.359814 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359773    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55cfec76-aee9-46aa-ab04-d4a19030adc7" containerName="istio-proxy"
Nov 04 02:36:02.360258 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359849    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="cb45a256-d8c5-4c00-9b11-b22a4948acd6" containerName="insights-gathering"
Nov 04 02:36:02.360258 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359859    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="119d7b11-8aa9-4f3a-9d84-b49a9803a177" containerName="istio-proxy"
Nov 04 02:36:02.360258 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359865    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="cfb7285e-0754-459a-a3a8-cdb6adfac0e2" containerName="istio-proxy"
Nov 04 02:36:02.360258 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359874    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2a26874-2087-4dd3-ae6e-b0f4f51afce3" containerName="istio-proxy"
Nov 04 02:36:02.360258 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.359880    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="55cfec76-aee9-46aa-ab04-d4a19030adc7" containerName="istio-proxy"
Nov 04 02:36:02.369506 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.366321    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.421520 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.421482    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:36:02.421769 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.421750    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-3353a6-serving-cert\""
Nov 04 02:36:02.421990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.421975    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:36:02.422073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.421999    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 04 02:36:02.422073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.422033    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-plfvj\""
Nov 04 02:36:02.474887 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.474808    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"]
Nov 04 02:36:02.481103 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.481075    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-maas-api-tls\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.481326 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.481280    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfs46\" (UniqueName: \"kubernetes.io/projected/fb2c99a7-e075-492e-972d-06dee97464b2-kube-api-access-hfs46\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.481406 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.481340    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-metrics-certs\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.481471 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.481448    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2c99a7-e075-492e-972d-06dee97464b2-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.582117 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.582078    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfs46\" (UniqueName: \"kubernetes.io/projected/fb2c99a7-e075-492e-972d-06dee97464b2-kube-api-access-hfs46\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.582117 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.582119    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-metrics-certs\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.582336 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.582149    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2c99a7-e075-492e-972d-06dee97464b2-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.582336 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.582195    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-maas-api-tls\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.582411 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:36:02.582346    5722 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-serving-cert: secret "maas-api-e2e-extmod-b-3353a6-serving-cert" not found
Nov 04 02:36:02.582454 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:36:02.582418    5722 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-maas-api-tls podName:fb2c99a7-e075-492e-972d-06dee97464b2 nodeName:}" failed. No retries permitted until 2026-11-04 02:36:03.082400221 +0000 UTC m=+1174.555937383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-maas-api-tls") pod "maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb" (UID: "fb2c99a7-e075-492e-972d-06dee97464b2") : secret "maas-api-e2e-extmod-b-3353a6-serving-cert" not found
Nov 04 02:36:02.582899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.582870    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2c99a7-e075-492e-972d-06dee97464b2-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.584622 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.584602    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-metrics-certs\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.621887 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.621856    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:02.681689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.681381    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfs46\" (UniqueName: \"kubernetes.io/projected/fb2c99a7-e075-492e-972d-06dee97464b2-kube-api-access-hfs46\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:02.820647 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.820560    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:02.929153 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.921485    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-xjq4v-74j97" event={"ID":"cb45a256-d8c5-4c00-9b11-b22a4948acd6","Type":"ContainerDied","Data":"175348ce311477dc2e16cf27630ceeb70b642f26d4a56ee983bbadaf9a94f761"}
Nov 04 02:36:02.929153 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.921551    5722 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="175348ce311477dc2e16cf27630ceeb70b642f26d4a56ee983bbadaf9a94f761"
Nov 04 02:36:02.929153 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.921639    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-xjq4v-74j97"
Nov 04 02:36:02.997512 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:02.997485    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:03.096414 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:03.096336    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-maas-api-tls\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:03.099008 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:03.098981    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-maas-api-tls\") pod \"maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:03.284140 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:03.284114    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:03.702234 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:36:03.702191    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2c99a7_e075_492e_972d_06dee97464b2.slice/crio-13ce7ae6553957e52c370b7867681fdeb977bec1f0e233e83d8476f1246d4f05 WatchSource:0}: Error finding container 13ce7ae6553957e52c370b7867681fdeb977bec1f0e233e83d8476f1246d4f05: Status 404 returned error can't find the container with id 13ce7ae6553957e52c370b7867681fdeb977bec1f0e233e83d8476f1246d4f05
Nov 04 02:36:03.703751 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:03.703728    5722 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:36:03.706369 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:03.706347    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"]
Nov 04 02:36:03.839614 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:03.839585    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:03.927952 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:03.927919    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb" event={"ID":"fb2c99a7-e075-492e-972d-06dee97464b2","Type":"ContainerStarted","Data":"13ce7ae6553957e52c370b7867681fdeb977bec1f0e233e83d8476f1246d4f05"}
Nov 04 02:36:04.017931 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:04.017852    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:04.954582 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:04.954048    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb" event={"ID":"fb2c99a7-e075-492e-972d-06dee97464b2","Type":"ContainerStarted","Data":"2a52eec0e90c7554b862156b77cabdba6756197140c46fb95df725d60972f284"}
Nov 04 02:36:04.954582 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:04.954436    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:05.076535 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:05.076482    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb" podStartSLOduration=2.142882278 podStartE2EDuration="3.076463344s" totalImagesPullingTime="933.581066ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:36:05.075214283 +0000 UTC m=+1176.548751465" watchObservedRunningTime="2026-11-04 02:36:05.076463344 +0000 UTC m=+1176.550000527"
Nov 04 02:36:06.113316 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:06.113284    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:07.476605 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:07.476526    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:07.682401 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:07.682367    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:07.901177 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:07.901145    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:08.070184 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:08.070156    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:08.300188 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:08.300105    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:08.754992 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:08.754955    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:09.227606 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:09.227575    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:09.417683 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:09.411802    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:10.608176 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:36:10.608140    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:36:11.022114 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:11.022086    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:36:12.049719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:12.049688    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:13.177567 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.177534    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"]
Nov 04 02:36:13.181482 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.181465    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.240346 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.240318    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-d501fd\"/\"payload-processing-external-model-plugins-e2e-extmod-b-d501fd\""
Nov 04 02:36:13.291693 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.291634    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-d501fd\"/\"routing-overlay\""
Nov 04 02:36:13.291693 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.291677    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-b-d501fd\"/\"payload-processing-external-model-e2e--2d309e2c-dockercfg-kddhf\""
Nov 04 02:36:13.291693 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.291650    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-d501fd\"/\"openshift-service-ca.crt\""
Nov 04 02:36:13.291693 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.291696    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-b-d501fd\"/\"agc-cred-359d7877ad2f\""
Nov 04 02:36:13.292043 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.291776    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-d501fd\"/\"kube-root-ca.crt\""
Nov 04 02:36:13.293874 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.293853    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"]
Nov 04 02:36:13.337905 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.337880    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzz2c\" (UniqueName: \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-kube-api-access-mzz2c\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.338001 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.337942    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.338117 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.338099    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.338154 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.338139    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.439170 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.439116    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.439170 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.439154    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.439375 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.439194    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzz2c\" (UniqueName: \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-kube-api-access-mzz2c\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.439375 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.439243    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.439772 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.439750    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.440032 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.439900    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.441629 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.441611    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.501993 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.501970    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzz2c\" (UniqueName: \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-kube-api-access-mzz2c\") pod \"payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") " pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:13.794269 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:13.794202    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:14.083807 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:14.083734    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:14.175461 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:36:14.175430    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b23a40_aadc_46f0_8e6e_e48581817438.slice/crio-e25cfc2d1d4285bfaadb90d551f2bd7e2872c0a5481eaef500230cc9c499537f WatchSource:0}: Error finding container e25cfc2d1d4285bfaadb90d551f2bd7e2872c0a5481eaef500230cc9c499537f: Status 404 returned error can't find the container with id e25cfc2d1d4285bfaadb90d551f2bd7e2872c0a5481eaef500230cc9c499537f
Nov 04 02:36:14.179111 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:14.179085    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"]
Nov 04 02:36:15.068487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:15.068438    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4" event={"ID":"28b23a40-aadc-46f0-8e6e-e48581817438","Type":"ContainerStarted","Data":"284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af"}
Nov 04 02:36:15.068698 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:15.068496    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4" event={"ID":"28b23a40-aadc-46f0-8e6e-e48581817438","Type":"ContainerStarted","Data":"e25cfc2d1d4285bfaadb90d551f2bd7e2872c0a5481eaef500230cc9c499537f"}
Nov 04 02:36:15.068698 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:15.068527    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:15.189795 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:15.189745    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4" podStartSLOduration=2.189732205 podStartE2EDuration="2.189732205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:36:15.187443589 +0000 UTC m=+1186.660980770" watchObservedRunningTime="2026-11-04 02:36:15.189732205 +0000 UTC m=+1186.663269409"
Nov 04 02:36:19.511352 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:19.511320    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:25.062370 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:25.061724    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:26.077080 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:26.077055    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:36:26.697391 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:26.697359    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"]
Nov 04 02:36:26.697557 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:26.697525    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" podUID="01707330-73cd-4eda-9501-0ec7b2a9389e" containerName="istio-proxy" containerID="cri-o://87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb" gracePeriod=30
Nov 04 02:36:28.799581 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:28.799542    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:36:28.805536 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:28.805513    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:36:28.808719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:28.808696    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:36:28.857990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:28.857958    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:36:30.470690 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:30.470628    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:31.707905 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:31.707868    5722 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:42506->10.132.0.51:15021: read: connection reset by peer" start-of-body=
Nov 04 02:36:31.708416 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:31.707930    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" podUID="01707330-73cd-4eda-9501-0ec7b2a9389e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:42506->10.132.0.51:15021: read: connection reset by peer"
Nov 04 02:36:31.964201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:31.964145    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:36:32.037319 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037288    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/01707330-73cd-4eda-9501-0ec7b2a9389e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01707330-73cd-4eda-9501-0ec7b2a9389e-istiod-ca-cert\") pod \"01707330-73cd-4eda-9501-0ec7b2a9389e\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") "
Nov 04 02:36:32.037479 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037330    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-token\" (UniqueName: \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-token\") pod \"01707330-73cd-4eda-9501-0ec7b2a9389e\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") "
Nov 04 02:36:32.037479 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037382    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-credential-socket\") pod \"01707330-73cd-4eda-9501-0ec7b2a9389e\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") "
Nov 04 02:36:32.037479 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037416    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-certs\") pod \"01707330-73cd-4eda-9501-0ec7b2a9389e\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") "
Nov 04 02:36:32.037479 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037456    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-data\") pod \"01707330-73cd-4eda-9501-0ec7b2a9389e\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") "
Nov 04 02:36:32.037743 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037480    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-kube-api-access-vsjlj\" (UniqueName: \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-kube-api-access-vsjlj\") pod \"01707330-73cd-4eda-9501-0ec7b2a9389e\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") "
Nov 04 02:36:32.037743 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037508    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-podinfo\") pod \"01707330-73cd-4eda-9501-0ec7b2a9389e\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") "
Nov 04 02:36:32.037743 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037560    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-socket\") pod \"01707330-73cd-4eda-9501-0ec7b2a9389e\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") "
Nov 04 02:36:32.037743 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037675    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-envoy\") pod \"01707330-73cd-4eda-9501-0ec7b2a9389e\" (UID: \"01707330-73cd-4eda-9501-0ec7b2a9389e\") "
Nov 04 02:36:32.037957 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037746    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01707330-73cd-4eda-9501-0ec7b2a9389e-istiod-ca-cert" pod "01707330-73cd-4eda-9501-0ec7b2a9389e" (UID: "01707330-73cd-4eda-9501-0ec7b2a9389e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:36:32.037957 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037747    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-certs" pod "01707330-73cd-4eda-9501-0ec7b2a9389e" (UID: "01707330-73cd-4eda-9501-0ec7b2a9389e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:36:32.037957 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.037778    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-data" pod "01707330-73cd-4eda-9501-0ec7b2a9389e" (UID: "01707330-73cd-4eda-9501-0ec7b2a9389e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:36:32.038106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.038037    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-credential-socket" pod "01707330-73cd-4eda-9501-0ec7b2a9389e" (UID: "01707330-73cd-4eda-9501-0ec7b2a9389e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:36:32.038106 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.038054    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-socket" pod "01707330-73cd-4eda-9501-0ec7b2a9389e" (UID: "01707330-73cd-4eda-9501-0ec7b2a9389e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:36:32.038206 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.038150    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01707330-73cd-4eda-9501-0ec7b2a9389e-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:32.038206 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.038171    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:32.038206 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.038187    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:32.038206 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.038201    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:32.038374 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.038214    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:32.039909 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.039885    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-token" pod "01707330-73cd-4eda-9501-0ec7b2a9389e" (UID: "01707330-73cd-4eda-9501-0ec7b2a9389e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:36:32.040019 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.039944    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-podinfo" pod "01707330-73cd-4eda-9501-0ec7b2a9389e" (UID: "01707330-73cd-4eda-9501-0ec7b2a9389e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:36:32.040409 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.040392    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-envoy" pod "01707330-73cd-4eda-9501-0ec7b2a9389e" (UID: "01707330-73cd-4eda-9501-0ec7b2a9389e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:36:32.040409 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.040390    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-kube-api-access-vsjlj" pod "01707330-73cd-4eda-9501-0ec7b2a9389e" (UID: "01707330-73cd-4eda-9501-0ec7b2a9389e"). InnerVolumeSpecName "kube-api-access-vsjlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:36:32.139853 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.139826    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsjlj\" (UniqueName: \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-kube-api-access-vsjlj\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:32.139853 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.139852    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:32.139853 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.139862    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:32.140073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.139874    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01707330-73cd-4eda-9501-0ec7b2a9389e-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:32.160613 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.160576    5722 generic.go:356] "Generic (PLEG): container finished" podID="01707330-73cd-4eda-9501-0ec7b2a9389e" containerID="87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb" exitCode=0
Nov 04 02:36:32.160803 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.160635    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"
Nov 04 02:36:32.160803 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.160651    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" event={"ID":"01707330-73cd-4eda-9501-0ec7b2a9389e","Type":"ContainerDied","Data":"87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb"}
Nov 04 02:36:32.160803 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.160723    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm" event={"ID":"01707330-73cd-4eda-9501-0ec7b2a9389e","Type":"ContainerDied","Data":"c7c51b46991c430089afc2113668da5112a8784c59900033e6a57a5cefc554da"}
Nov 04 02:36:32.160803 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.160745    5722 scope.go:122] "RemoveContainer" containerID="87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb"
Nov 04 02:36:32.171541 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.171523    5722 scope.go:122] "RemoveContainer" containerID="87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb"
Nov 04 02:36:32.172118 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:36:32.171874    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb\": container with ID starting with 87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb not found: ID does not exist" containerID="87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb"
Nov 04 02:36:32.172118 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.171911    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb"} err="failed to get container status \"87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb\": rpc error: code = NotFound desc = could not find container \"87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb\": container with ID starting with 87cdc90baec35304b9610a450722d646db881f5a242007ba39dd7fbcfc0240eb not found: ID does not exist"
Nov 04 02:36:32.331139 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.331053    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"]
Nov 04 02:36:32.336141 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.336104    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-cdhbm"]
Nov 04 02:36:32.681063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:32.681034    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="01707330-73cd-4eda-9501-0ec7b2a9389e" path="/var/lib/kubelet/pods/01707330-73cd-4eda-9501-0ec7b2a9389e/volumes"
Nov 04 02:36:35.890623 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:35.890594    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:40.612051 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:36:40.612006    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:36:41.388883 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:41.388850    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:46.840062 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:46.840029    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:52.280750 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:52.280713    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:57.106910 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:57.106870    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:57.358975 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:57.358893    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:36:57.786629 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:36:57.786583    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:03.205926 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:03.205888    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:08.203164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:08.203122    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:08.386630 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:08.386592    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:08.593596 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:08.593510    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:08.950846 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:08.950806    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:09.309433 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:09.309296    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:10.578168 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:10.578096    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:10.609369 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:10.609334    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:37:10.808143 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:10.808105    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:11.014234 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:11.014200    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:11.226856 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:11.226822    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:11.568575 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:11.568541    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:12.345364 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:12.345325    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:12.514960 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:12.514931    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:12.826815 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:12.826782    5722 projected.go:266] Couldn't get secret ai-tenant-e2e-extmod-b-ab61a8/agc-cred-fcd78004850a: secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:12.827017 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:12.826825    5722 projected.go:196] Error preparing data for projected volume provider-credentials for pod ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt: secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:12.827017 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:12.826945    5722 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials podName:5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96 nodeName:}" failed. No retries permitted until 2026-11-04 02:37:13.326923412 +0000 UTC m=+1244.800460587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials") pod "payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt" (UID: "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96") : secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:13.332817 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:13.332772    5722 projected.go:266] Couldn't get secret ai-tenant-e2e-extmod-b-ab61a8/agc-cred-fcd78004850a: secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:13.332817 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:13.332807    5722 projected.go:196] Error preparing data for projected volume provider-credentials for pod ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt: secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:13.333079 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:13.332868    5722 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials podName:5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96 nodeName:}" failed. No retries permitted until 2026-11-04 02:37:14.332852348 +0000 UTC m=+1245.806389528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials") pod "payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt" (UID: "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96") : secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:14.341643 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:14.341611    5722 projected.go:266] Couldn't get secret ai-tenant-e2e-extmod-b-ab61a8/agc-cred-fcd78004850a: secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:14.341643 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:14.341635    5722 projected.go:196] Error preparing data for projected volume provider-credentials for pod ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt: secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:14.342133 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:14.341722    5722 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials podName:5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96 nodeName:}" failed. No retries permitted until 2026-11-04 02:37:16.341706256 +0000 UTC m=+1247.815243429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials") pod "payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt" (UID: "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96") : secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:14.603947 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:14.603868    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:15.143760 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:15.143709    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:15.386587 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:15.386555    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:15.719968 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:15.719930    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"]
Nov 04 02:37:15.906927 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:15.906881    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:16.368540 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:16.368504    5722 projected.go:266] Couldn't get secret ai-tenant-e2e-extmod-b-ab61a8/agc-cred-fcd78004850a: secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:16.368540 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:16.368530    5722 projected.go:196] Error preparing data for projected volume provider-credentials for pod ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt: secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:16.368852 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:16.368590    5722 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials podName:5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96 nodeName:}" failed. No retries permitted until 2026-11-04 02:37:20.368574823 +0000 UTC m=+1251.842111987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials") pod "payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt" (UID: "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96") : secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:19.750075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:19.750031    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:20.087702 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.087595    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:20.421781 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:20.421754    5722 projected.go:266] Couldn't get secret ai-tenant-e2e-extmod-b-ab61a8/agc-cred-fcd78004850a: secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:20.421781 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:20.421776    5722 projected.go:196] Error preparing data for projected volume provider-credentials for pod ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt: secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:20.421986 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:20.421831    5722 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials podName:5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96 nodeName:}" failed. No retries permitted until 2026-11-04 02:37:28.421816568 +0000 UTC m=+1259.895353727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials") pod "payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt" (UID: "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96") : secret "agc-cred-fcd78004850a" not found
Nov 04 02:37:20.721015 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.720931    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt" podUID="5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96" containerName="payload-processing" containerID="cri-o://7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8" gracePeriod=25
Nov 04 02:37:20.872423 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.872355    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"]
Nov 04 02:37:20.873084 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.873062    5722 cpu_manager.go:414] "containerMap: removing container" podUID="01707330-73cd-4eda-9501-0ec7b2a9389e" containerName="istio-proxy"
Nov 04 02:37:20.873168 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.873086    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="01707330-73cd-4eda-9501-0ec7b2a9389e" containerName="istio-proxy"
Nov 04 02:37:20.873265 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.873217    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="01707330-73cd-4eda-9501-0ec7b2a9389e" containerName="istio-proxy"
Nov 04 02:37:20.876645 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.876623    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:20.938306 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.938275    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"]
Nov 04 02:37:20.986695 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.986623    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-b-3353a6\"/\"agc-cred-9f6e60d6e7b6\""
Nov 04 02:37:20.986695 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.986669    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-3353a6\"/\"payload-processing-external-model-plugins-e2e-extmod-b-3353a6\""
Nov 04 02:37:20.986900 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.986699    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-3353a6\"/\"openshift-service-ca.crt\""
Nov 04 02:37:20.986900 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.986709    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-3353a6\"/\"kube-root-ca.crt\""
Nov 04 02:37:20.986900 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.986773    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-b-3353a6\"/\"payload-processing-external-model-e2e--0ce0b707-dockercfg-6r27t\""
Nov 04 02:37:20.986900 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.986830    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-3353a6\"/\"routing-overlay\""
Nov 04 02:37:20.990089 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:20.990070    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:37:21.028906 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.028878    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.029034 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.028958    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.029034 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.029006    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.029128 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.029068    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw92n\" (UniqueName: \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-kube-api-access-dw92n\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.130063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.130042    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-kube-api-access-t7mv9\" (UniqueName: \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-kube-api-access-t7mv9\") pod \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") "
Nov 04 02:37:21.130194 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.130073    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-routing-overlay-volume\") pod \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") "
Nov 04 02:37:21.130194 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.130124    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials\" (UniqueName: \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials\") pod \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") "
Nov 04 02:37:21.130324 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.130229    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-plugins-config-volume\") pod \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\" (UID: \"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96\") "
Nov 04 02:37:21.130379 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.130362    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.130441 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.130429    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.130495 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.130465    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.130559 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.130524    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-routing-overlay-volume" pod "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96" (UID: "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:37:21.130559 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.130543    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw92n\" (UniqueName: \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-kube-api-access-dw92n\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.130652 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.130609    5722 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-routing-overlay-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:21.130652 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.130608    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-plugins-config-volume" pod "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96" (UID: "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:37:21.131216 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.131193    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.131315 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.131298    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.132717 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.132696    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-kube-api-access-t7mv9" pod "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96" (UID: "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96"). InnerVolumeSpecName "kube-api-access-t7mv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:37:21.132808 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.132780    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials" pod "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96" (UID: "5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:37:21.133084 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.133069    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.193716 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.193692    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw92n\" (UniqueName: \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-kube-api-access-dw92n\") pod \"payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") " pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.195533 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.195516    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:21.231237 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.231185    5722 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-plugins-config-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:21.231237 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.231208    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7mv9\" (UniqueName: \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-kube-api-access-t7mv9\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:21.231237 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.231218    5722 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96-provider-credentials\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:21.472507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.472477    5722 generic.go:356] "Generic (PLEG): container finished" podID="5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96" containerID="7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8" exitCode=0
Nov 04 02:37:21.472709 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.472535    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"
Nov 04 02:37:21.472709 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.472563    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt" event={"ID":"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96","Type":"ContainerDied","Data":"7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8"}
Nov 04 02:37:21.472709 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.472621    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt" event={"ID":"5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96","Type":"ContainerDied","Data":"9b5533a0361129061837295f91a497ba80eec4d612ac6484f28e23e2698c1773"}
Nov 04 02:37:21.472709 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.472647    5722 scope.go:122] "RemoveContainer" containerID="7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8"
Nov 04 02:37:21.482966 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.482929    5722 scope.go:122] "RemoveContainer" containerID="7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8"
Nov 04 02:37:21.490420 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:21.490388    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8\": container with ID starting with 7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8 not found: ID does not exist" containerID="7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8"
Nov 04 02:37:21.490533 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.490433    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8"} err="failed to get container status \"7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8\": rpc error: code = NotFound desc = could not find container \"7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8\": container with ID starting with 7d383af165bcd676db0da4995e2289c1c023e87294602dd4a14770d3cfbe64d8 not found: ID does not exist"
Nov 04 02:37:21.527867 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:21.527837    5722 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4a687a_d9d4_4c98_9203_9d5a2fc1aa96.slice/crio-9b5533a0361129061837295f91a497ba80eec4d612ac6484f28e23e2698c1773\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4a687a_d9d4_4c98_9203_9d5a2fc1aa96.slice\": RecentStats: unable to find data in memory cache]"
Nov 04 02:37:21.568404 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:37:21.568375    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf165daaa_3088_43eb_8b39_82172e503aa1.slice/crio-65605c94222c1dd710374b46882c0bdaffc8112ce07ded0840421d9bcff079fb WatchSource:0}: Error finding container 65605c94222c1dd710374b46882c0bdaffc8112ce07ded0840421d9bcff079fb: Status 404 returned error can't find the container with id 65605c94222c1dd710374b46882c0bdaffc8112ce07ded0840421d9bcff079fb
Nov 04 02:37:21.571132 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.571112    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"]
Nov 04 02:37:21.645012 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.644982    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"]
Nov 04 02:37:21.649065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:21.649037    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-extmod-b-ab61a8/payload-processing-external-model-e2e-extmod-b-ab61a8-798bs2nqt"]
Nov 04 02:37:22.243775 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:22.243743    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:22.476427 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:22.476393    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:22.480917 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:22.480894    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx" event={"ID":"f165daaa-3088-43eb-8b39-82172e503aa1","Type":"ContainerStarted","Data":"7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df"}
Nov 04 02:37:22.481040 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:22.480937    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx" event={"ID":"f165daaa-3088-43eb-8b39-82172e503aa1","Type":"ContainerStarted","Data":"65605c94222c1dd710374b46882c0bdaffc8112ce07ded0840421d9bcff079fb"}
Nov 04 02:37:22.481040 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:22.480978    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:22.605458 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:22.605367    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx" podStartSLOduration=2.605353552 podStartE2EDuration="2.605353552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:37:22.60359069 +0000 UTC m=+1254.077127874" watchObservedRunningTime="2026-11-04 02:37:22.605353552 +0000 UTC m=+1254.078890733"
Nov 04 02:37:22.679940 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:22.679907    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96" path="/var/lib/kubelet/pods/5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96/volumes"
Nov 04 02:37:22.962722 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:22.962682    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:23.180012 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:23.179978    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:25.585702 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:25.585670    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:30.060913 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:30.060880    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:30.781682 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:30.762771    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:30.941810 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:30.941769    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"]
Nov 04 02:37:31.006068 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:31.006034    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:31.189192 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:31.188383    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:33.489123 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:33.489094    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:37:34.014112 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:34.014074    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:34.214873 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:34.214833    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:35.943013 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:35.942977    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4" podUID="28b23a40-aadc-46f0-8e6e-e48581817438" containerName="payload-processing" containerID="cri-o://284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af" gracePeriod=25
Nov 04 02:37:36.074917 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:37:36.074895    5722 logging.go:55] [core] [Channel #782 SubChannel #783]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.69:50052", ServerName: "10.132.0.69:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.69:50052: connect: connection refused"
Nov 04 02:37:36.207241 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.207173    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:37:36.329403 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.329369    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-routing-overlay-volume\") pod \"28b23a40-aadc-46f0-8e6e-e48581817438\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") "
Nov 04 02:37:36.329570 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.329454    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-provider-credentials\" (UniqueName: \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-provider-credentials\") pod \"28b23a40-aadc-46f0-8e6e-e48581817438\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") "
Nov 04 02:37:36.329570 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.329491    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-kube-api-access-mzz2c\" (UniqueName: \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-kube-api-access-mzz2c\") pod \"28b23a40-aadc-46f0-8e6e-e48581817438\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") "
Nov 04 02:37:36.329721 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.329626    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-plugins-config-volume\") pod \"28b23a40-aadc-46f0-8e6e-e48581817438\" (UID: \"28b23a40-aadc-46f0-8e6e-e48581817438\") "
Nov 04 02:37:36.329785 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.329714    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-routing-overlay-volume" pod "28b23a40-aadc-46f0-8e6e-e48581817438" (UID: "28b23a40-aadc-46f0-8e6e-e48581817438"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:37:36.330034 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.330015    5722 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-routing-overlay-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:36.330103 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.330018    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-plugins-config-volume" pod "28b23a40-aadc-46f0-8e6e-e48581817438" (UID: "28b23a40-aadc-46f0-8e6e-e48581817438"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:37:36.331979 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.331949    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-provider-credentials" pod "28b23a40-aadc-46f0-8e6e-e48581817438" (UID: "28b23a40-aadc-46f0-8e6e-e48581817438"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:37:36.332085 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.332066    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-kube-api-access-mzz2c" pod "28b23a40-aadc-46f0-8e6e-e48581817438" (UID: "28b23a40-aadc-46f0-8e6e-e48581817438"). InnerVolumeSpecName "kube-api-access-mzz2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:37:36.431076 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.431047    5722 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-provider-credentials\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:36.431076 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.431072    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzz2c\" (UniqueName: \"kubernetes.io/projected/28b23a40-aadc-46f0-8e6e-e48581817438-kube-api-access-mzz2c\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:36.431076 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.431081    5722 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28b23a40-aadc-46f0-8e6e-e48581817438-plugins-config-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:36.595065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.594987    5722 generic.go:356] "Generic (PLEG): container finished" podID="28b23a40-aadc-46f0-8e6e-e48581817438" containerID="284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af" exitCode=0
Nov 04 02:37:36.595065 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.595041    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"
Nov 04 02:37:36.595236 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.595064    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4" event={"ID":"28b23a40-aadc-46f0-8e6e-e48581817438","Type":"ContainerDied","Data":"284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af"}
Nov 04 02:37:36.595236 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.595137    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4" event={"ID":"28b23a40-aadc-46f0-8e6e-e48581817438","Type":"ContainerDied","Data":"e25cfc2d1d4285bfaadb90d551f2bd7e2872c0a5481eaef500230cc9c499537f"}
Nov 04 02:37:36.595236 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.595159    5722 scope.go:122] "RemoveContainer" containerID="284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af"
Nov 04 02:37:36.604911 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.604890    5722 scope.go:122] "RemoveContainer" containerID="284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af"
Nov 04 02:37:36.605183 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:36.605166    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af\": container with ID starting with 284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af not found: ID does not exist" containerID="284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af"
Nov 04 02:37:36.605234 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.605193    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af"} err="failed to get container status \"284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af\": rpc error: code = NotFound desc = could not find container \"284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af\": container with ID starting with 284350ef74cc9de7dfbb026aae1a64c1af9c9db6bd49d46f61dc7677d215b6af not found: ID does not exist"
Nov 04 02:37:36.778586 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.778555    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"]
Nov 04 02:37:36.784367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.784346    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4"]
Nov 04 02:37:36.835696 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:36.831406    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:37.075556 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:37.075517    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-extmod-b-d501fd/payload-processing-external-model-e2e-extmod-b-d501fd-85b6hqtn4" podUID="28b23a40-aadc-46f0-8e6e-e48581817438" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.69:50052\" within 1s: context deadline exceeded"
Nov 04 02:37:37.075556 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:37:37.075561    5722 logging.go:55] [core] [Channel #782 SubChannel #783]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.69:50052", ServerName: "10.132.0.69:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.69:50052: operation was canceled"
Nov 04 02:37:37.153386 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:37.153308    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:37.748155 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:37.748123    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:37.943701 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:37.943647    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:38.375583 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:38.375543    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:38.680103 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:38.680014    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="28b23a40-aadc-46f0-8e6e-e48581817438" path="/var/lib/kubelet/pods/28b23a40-aadc-46f0-8e6e-e48581817438/volumes"
Nov 04 02:37:40.610607 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:37:40.610565    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:37:42.558026 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:42.557998    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:44.945963 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:44.945934    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:45.477905 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:45.477872    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:45.678288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:45.670727    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:48.305134 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:48.305098    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:51.004280 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:51.004248    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:54.095528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:54.095492    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:57.490374 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:57.490336    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:37:59.627239 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:37:59.627205    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:05.028045 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:05.028014    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:09.755916 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:09.755817    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:10.609339 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:38:10.609301    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:38:10.753287 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:10.753245    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:11.790260 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:11.790226    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:17.188115 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:17.188083    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:20.294190 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:20.294155    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:20.476966 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:20.476905    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:22.073257 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:22.073222    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:22.754194 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:22.754149    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:22.955028 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:22.954989    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:23.607872 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:23.607824    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:28.555631 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:28.555572    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:28.732890 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:28.731385    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:29.338157 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:29.338070    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:29.521995 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:29.521920    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:30.186163 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:30.186129    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:30.444674 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:30.444587    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:34.577281 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:34.577225    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:35.784771 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:35.784732    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:35.915753 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:35.915721    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"]
Nov 04 02:38:35.956823 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:35.956793    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:36.152546 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:36.151823    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:36.792066 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:36.791998    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:39.379400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:39.379364    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:40.610082 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:38:40.610045    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:38:40.916894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:40.916854    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx" podUID="f165daaa-3088-43eb-8b39-82172e503aa1" containerName="payload-processing" containerID="cri-o://7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df" gracePeriod=25
Nov 04 02:38:41.177002 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.176930    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:38:41.236248 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.236216    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-routing-overlay-volume\") pod \"f165daaa-3088-43eb-8b39-82172e503aa1\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") "
Nov 04 02:38:41.236248 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.236252    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-plugins-config-volume\") pod \"f165daaa-3088-43eb-8b39-82172e503aa1\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") "
Nov 04 02:38:41.236460 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.236308    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-kube-api-access-dw92n\" (UniqueName: \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-kube-api-access-dw92n\") pod \"f165daaa-3088-43eb-8b39-82172e503aa1\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") "
Nov 04 02:38:41.236460 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.236359    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-provider-credentials\" (UniqueName: \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-provider-credentials\") pod \"f165daaa-3088-43eb-8b39-82172e503aa1\" (UID: \"f165daaa-3088-43eb-8b39-82172e503aa1\") "
Nov 04 02:38:41.236699 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.236672    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-routing-overlay-volume" pod "f165daaa-3088-43eb-8b39-82172e503aa1" (UID: "f165daaa-3088-43eb-8b39-82172e503aa1"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:41.236809 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.236789    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-plugins-config-volume" pod "f165daaa-3088-43eb-8b39-82172e503aa1" (UID: "f165daaa-3088-43eb-8b39-82172e503aa1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:41.238746 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.238719    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-provider-credentials" pod "f165daaa-3088-43eb-8b39-82172e503aa1" (UID: "f165daaa-3088-43eb-8b39-82172e503aa1"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:41.238852 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.238742    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-kube-api-access-dw92n" pod "f165daaa-3088-43eb-8b39-82172e503aa1" (UID: "f165daaa-3088-43eb-8b39-82172e503aa1"). InnerVolumeSpecName "kube-api-access-dw92n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:41.338171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.338135    5722 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-provider-credentials\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:41.338171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.338166    5722 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-routing-overlay-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:41.338171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.338176    5722 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f165daaa-3088-43eb-8b39-82172e503aa1-plugins-config-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:41.338433 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.338188    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw92n\" (UniqueName: \"kubernetes.io/projected/f165daaa-3088-43eb-8b39-82172e503aa1-kube-api-access-dw92n\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:41.389438 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.389406    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:41.939267 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.939231    5722 generic.go:356] "Generic (PLEG): container finished" podID="f165daaa-3088-43eb-8b39-82172e503aa1" containerID="7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df" exitCode=0
Nov 04 02:38:41.939793 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.939276    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"
Nov 04 02:38:41.939793 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.939319    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx" event={"ID":"f165daaa-3088-43eb-8b39-82172e503aa1","Type":"ContainerDied","Data":"7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df"}
Nov 04 02:38:41.939793 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.939370    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx" event={"ID":"f165daaa-3088-43eb-8b39-82172e503aa1","Type":"ContainerDied","Data":"65605c94222c1dd710374b46882c0bdaffc8112ce07ded0840421d9bcff079fb"}
Nov 04 02:38:41.939793 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.939400    5722 scope.go:122] "RemoveContainer" containerID="7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df"
Nov 04 02:38:41.949617 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.949595    5722 scope.go:122] "RemoveContainer" containerID="7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df"
Nov 04 02:38:41.949950 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:38:41.949930    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df\": container with ID starting with 7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df not found: ID does not exist" containerID="7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df"
Nov 04 02:38:41.950025 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:41.949957    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df"} err="failed to get container status \"7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df\": rpc error: code = NotFound desc = could not find container \"7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df\": container with ID starting with 7e27051ad235c8af44c0373c23eae761fdf28d69e38b4d1a89ad66d2298a09df not found: ID does not exist"
Nov 04 02:38:42.159148 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:42.156618    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"]
Nov 04 02:38:42.206611 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:42.206519    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-extmod-b-3353a6/payload-processing-external-model-e2e-extmod-b-3353a6-7459sqdpx"]
Nov 04 02:38:42.680550 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:42.680518    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f165daaa-3088-43eb-8b39-82172e503aa1" path="/var/lib/kubelet/pods/f165daaa-3088-43eb-8b39-82172e503aa1/volumes"
Nov 04 02:38:43.487147 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:43.487088    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:43.680815 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:43.680783    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:43.950605 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:43.950566    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:44.150665 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:44.150629    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:45.299519 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:45.299482    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:45.914649 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:45.914602    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:46.761165 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:46.761132    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:47.191443 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:47.191414    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:50.173973 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:50.173938    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:50.353382 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:50.353340    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:51.386035 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:51.385975    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:51.561781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:51.561729    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:53.965622 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:53.965589    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:54.140527 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:54.140471    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:54.867626 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:54.867590    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:55.048000 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:55.046430    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:57.824925 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:57.824889    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:58.608588 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:58.608550    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:38:58.937144 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:38:58.937110    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:04.130682 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:04.121055    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:04.991826 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:04.991787    5722 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-7r6mg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 02:39:04.992126 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:04.992092    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-7r6mg" podUID="bde9bff4-3d54-471d-ae04-e7fa835fb4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:39:06.813003 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:06.812967    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"]
Nov 04 02:39:06.813406 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:06.813172    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5" podUID="ab09ed0d-6616-4ca0-87b0-c200dcdd5920" containerName="istio-proxy" containerID="cri-o://aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b" gracePeriod=30
Nov 04 02:39:09.591506 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:09.591470    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:10.609293 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:39:10.609256    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:39:12.072875 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.072851    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:39:12.168305 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.168269    5722 generic.go:356] "Generic (PLEG): container finished" podID="ab09ed0d-6616-4ca0-87b0-c200dcdd5920" containerID="aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b" exitCode=0
Nov 04 02:39:12.168507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.168319    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"
Nov 04 02:39:12.168507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.168354    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5" event={"ID":"ab09ed0d-6616-4ca0-87b0-c200dcdd5920","Type":"ContainerDied","Data":"aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b"}
Nov 04 02:39:12.168507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.168405    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5" event={"ID":"ab09ed0d-6616-4ca0-87b0-c200dcdd5920","Type":"ContainerDied","Data":"72e2c4edc23f1a9cf667e8985e7926384a9e71265d50b0c3014786e6a9386f04"}
Nov 04 02:39:12.168507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.168426    5722 scope.go:122] "RemoveContainer" containerID="aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b"
Nov 04 02:39:12.177426 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.177407    5722 scope.go:122] "RemoveContainer" containerID="aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b"
Nov 04 02:39:12.177811 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:39:12.177794    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b\": container with ID starting with aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b not found: ID does not exist" containerID="aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b"
Nov 04 02:39:12.177870 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.177821    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b"} err="failed to get container status \"aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b\": rpc error: code = NotFound desc = could not find container \"aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b\": container with ID starting with aae286bf077aaebfe5439029d72701441f701f382013bbde7259351a4211c40b not found: ID does not exist"
Nov 04 02:39:12.187500 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187477    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-socket\") pod \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") "
Nov 04 02:39:12.187593 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187579    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-data\") pod \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") "
Nov 04 02:39:12.187636 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187614    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-certs\") pod \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") "
Nov 04 02:39:12.187696 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187635    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-podinfo\") pod \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") "
Nov 04 02:39:12.187696 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187677    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-token\" (UniqueName: \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-token\") pod \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") "
Nov 04 02:39:12.187783 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187722    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istiod-ca-cert\") pod \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") "
Nov 04 02:39:12.187783 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187753    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-socket" pod "ab09ed0d-6616-4ca0-87b0-c200dcdd5920" (UID: "ab09ed0d-6616-4ca0-87b0-c200dcdd5920"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:12.187893 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187820    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-credential-socket\") pod \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") "
Nov 04 02:39:12.187948 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187912    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-kube-api-access-94x89\" (UniqueName: \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-kube-api-access-94x89\") pod \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") "
Nov 04 02:39:12.187948 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187908    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-certs" pod "ab09ed0d-6616-4ca0-87b0-c200dcdd5920" (UID: "ab09ed0d-6616-4ca0-87b0-c200dcdd5920"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:12.188049 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187922    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-data" pod "ab09ed0d-6616-4ca0-87b0-c200dcdd5920" (UID: "ab09ed0d-6616-4ca0-87b0-c200dcdd5920"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:12.188049 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.187971    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-envoy\") pod \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\" (UID: \"ab09ed0d-6616-4ca0-87b0-c200dcdd5920\") "
Nov 04 02:39:12.188170 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.188114    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-credential-socket" pod "ab09ed0d-6616-4ca0-87b0-c200dcdd5920" (UID: "ab09ed0d-6616-4ca0-87b0-c200dcdd5920"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:12.188223 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.188170    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istiod-ca-cert" pod "ab09ed0d-6616-4ca0-87b0-c200dcdd5920" (UID: "ab09ed0d-6616-4ca0-87b0-c200dcdd5920"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:12.188577 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.188557    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:12.188577 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.188583    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:12.188756 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.188597    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:12.188756 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.188611    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:12.188756 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.188625    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:12.190008 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.189982    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-podinfo" pod "ab09ed0d-6616-4ca0-87b0-c200dcdd5920" (UID: "ab09ed0d-6616-4ca0-87b0-c200dcdd5920"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:39:12.190107 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.190045    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-kube-api-access-94x89" pod "ab09ed0d-6616-4ca0-87b0-c200dcdd5920" (UID: "ab09ed0d-6616-4ca0-87b0-c200dcdd5920"). InnerVolumeSpecName "kube-api-access-94x89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:12.190160 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.190132    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-envoy" pod "ab09ed0d-6616-4ca0-87b0-c200dcdd5920" (UID: "ab09ed0d-6616-4ca0-87b0-c200dcdd5920"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:12.190199 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.190184    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-token" pod "ab09ed0d-6616-4ca0-87b0-c200dcdd5920" (UID: "ab09ed0d-6616-4ca0-87b0-c200dcdd5920"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:12.290151 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.290119    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94x89\" (UniqueName: \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-kube-api-access-94x89\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:12.290151 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.290148    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:12.290151 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.290158    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:12.290387 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.290167    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab09ed0d-6616-4ca0-87b0-c200dcdd5920-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:12.592137 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.592102    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"]
Nov 04 02:39:12.597807 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.597785    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-cwwh5"]
Nov 04 02:39:12.682910 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:12.682503    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab09ed0d-6616-4ca0-87b0-c200dcdd5920" path="/var/lib/kubelet/pods/ab09ed0d-6616-4ca0-87b0-c200dcdd5920/volumes"
Nov 04 02:39:14.292173 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:14.292110    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:16.290416 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:16.290378    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:18.168530 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:18.168491    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:18.348153 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:18.348115    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:19.877797 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:19.877762    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:20.369072 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:20.369049    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"]
Nov 04 02:39:20.369261 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:20.369241    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy" containerID="cri-o://42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21" gracePeriod=30
Nov 04 02:39:20.389350 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:20.389315    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:20.891629 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:20.891589    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:21.920040 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:21.919996    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:22.387011 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:22.386982    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:22.446073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:22.446038    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"]
Nov 04 02:39:22.446311 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:22.446242    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" podUID="1575ff3a-a763-4ecb-a536-9c5f82651aed" containerName="istio-proxy" containerID="cri-o://356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da" gracePeriod=30
Nov 04 02:39:22.497809 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:22.497747    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"]
Nov 04 02:39:22.497989 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:22.497958    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" podUID="8491d004-87be-458d-a69f-3a6a48f595f8" containerName="istio-proxy" containerID="cri-o://f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2" gracePeriod=30
Nov 04 02:39:23.049341 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:23.049298    5722 patch_prober.go:29] interesting pod/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 02:39:23.049756 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:23.049356    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 02:39:25.833404 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.833063    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"]
Nov 04 02:39:25.839687 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.839633    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:39:25.957922 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.957887    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-podinfo\") pod \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") "
Nov 04 02:39:25.958124 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958013    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-data\") pod \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") "
Nov 04 02:39:25.958124 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958050    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-envoy\") pod \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") "
Nov 04 02:39:25.958124 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958096    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-token\" (UniqueName: \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-token\") pod \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") "
Nov 04 02:39:25.958289 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958142    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-certs\") pod \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") "
Nov 04 02:39:25.958289 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958207    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istiod-ca-cert\") pod \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") "
Nov 04 02:39:25.958289 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958249    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-data" pod "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" (UID: "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:25.958289 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958270    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-credential-socket\") pod \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") "
Nov 04 02:39:25.958500 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958325    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-kube-api-access-vttp2\" (UniqueName: \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-kube-api-access-vttp2\") pod \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") "
Nov 04 02:39:25.958500 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958377    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-socket\") pod \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\" (UID: \"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2\") "
Nov 04 02:39:25.958500 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958399    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-certs" pod "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" (UID: "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:25.958500 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958483    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-credential-socket" pod "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" (UID: "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:25.958726 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958573    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istiod-ca-cert" pod "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" (UID: "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:25.958874 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.958849    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-socket" pod "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" (UID: "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:25.959056 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.959033    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:25.959135 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.959065    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:25.959135 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.959080    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:25.959135 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.959096    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:25.959135 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.959110    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:25.985135 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.960731    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-podinfo" pod "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" (UID: "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:39:25.985135 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.965065    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-token" pod "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" (UID: "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:25.985135 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:25.981233    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-kube-api-access-vttp2" pod "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" (UID: "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2"). InnerVolumeSpecName "kube-api-access-vttp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:26.023068 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.011240    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-envoy" pod "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" (UID: "7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:26.025215 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.024996    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:26.060038 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.060009    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:26.060038 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.060035    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:26.060038 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.060044    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:26.060270 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.060059    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vttp2\" (UniqueName: \"kubernetes.io/projected/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2-kube-api-access-vttp2\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:26.324765 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.321216    5722 generic.go:356] "Generic (PLEG): container finished" podID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerID="42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21" exitCode=0
Nov 04 02:39:26.324765 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.321354    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" event={"ID":"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2","Type":"ContainerDied","Data":"42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21"}
Nov 04 02:39:26.324765 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.321405    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5" event={"ID":"7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2","Type":"ContainerDied","Data":"3c02e6fa39beda0c78c9b3fdea78ca9794ef57d520e76c37317205face68da1e"}
Nov 04 02:39:26.324765 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.321439    5722 scope.go:122] "RemoveContainer" containerID="42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21"
Nov 04 02:39:26.324765 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.321607    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"
Nov 04 02:39:26.365701 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.360765    5722 scope.go:122] "RemoveContainer" containerID="a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2"
Nov 04 02:39:26.446332 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.446306    5722 scope.go:122] "RemoveContainer" containerID="42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21"
Nov 04 02:39:26.446713 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:39:26.446686    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21\": container with ID starting with 42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21 not found: ID does not exist" containerID="42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21"
Nov 04 02:39:26.446843 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.446720    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21"} err="failed to get container status \"42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21\": rpc error: code = NotFound desc = could not find container \"42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21\": container with ID starting with 42d66534b332b601bf6bd1f7b1db1ef2366f7c3baa8ca2b3a3d68f2d0fed0f21 not found: ID does not exist"
Nov 04 02:39:26.446843 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.446739    5722 scope.go:122] "RemoveContainer" containerID="a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2"
Nov 04 02:39:26.447026 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:39:26.447001    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2\": container with ID starting with a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2 not found: ID does not exist" containerID="a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2"
Nov 04 02:39:26.447112 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.447036    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2"} err="failed to get container status \"a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2\": rpc error: code = NotFound desc = could not find container \"a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2\": container with ID starting with a6a91b890bb9bb300c472091c2bdec3549a79fc107de99c93fe5fc4901b6bcb2 not found: ID does not exist"
Nov 04 02:39:26.515681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.515040    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"]
Nov 04 02:39:26.551490 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.551455    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-ab61a8-openshift-default-57c59cc9d9-6rxf5"]
Nov 04 02:39:26.716694 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:26.707172    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" path="/var/lib/kubelet/pods/7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2/volumes"
Nov 04 02:39:27.349639 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:27.349604    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:27.704357 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:27.704305    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:27.877086 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:27.877062    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:39:27.880419 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:27.880396    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:39:28.033007 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.032970    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-token\" (UniqueName: \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-token\") pod \"1575ff3a-a763-4ecb-a536-9c5f82651aed\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") "
Nov 04 02:39:28.033007 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033009    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-data\") pod \"8491d004-87be-458d-a69f-3a6a48f595f8\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") "
Nov 04 02:39:28.033632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033041    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8491d004-87be-458d-a69f-3a6a48f595f8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8491d004-87be-458d-a69f-3a6a48f595f8-istio-podinfo\") pod \"8491d004-87be-458d-a69f-3a6a48f595f8\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") "
Nov 04 02:39:28.033632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033065    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-envoy\") pod \"1575ff3a-a763-4ecb-a536-9c5f82651aed\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") "
Nov 04 02:39:28.033632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033083    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-kube-api-access-mtj96\" (UniqueName: \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-kube-api-access-mtj96\") pod \"8491d004-87be-458d-a69f-3a6a48f595f8\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") "
Nov 04 02:39:28.033632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033100    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8491d004-87be-458d-a69f-3a6a48f595f8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8491d004-87be-458d-a69f-3a6a48f595f8-istiod-ca-cert\") pod \"8491d004-87be-458d-a69f-3a6a48f595f8\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") "
Nov 04 02:39:28.033632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033120    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-credential-socket\") pod \"8491d004-87be-458d-a69f-3a6a48f595f8\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") "
Nov 04 02:39:28.033632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033156    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-credential-socket\") pod \"1575ff3a-a763-4ecb-a536-9c5f82651aed\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") "
Nov 04 02:39:28.033632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033324    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-data" pod "8491d004-87be-458d-a69f-3a6a48f595f8" (UID: "8491d004-87be-458d-a69f-3a6a48f595f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:28.033632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033441    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-credential-socket" pod "8491d004-87be-458d-a69f-3a6a48f595f8" (UID: "8491d004-87be-458d-a69f-3a6a48f595f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:28.033632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033260    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-kube-api-access-khjlg\" (UniqueName: \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-kube-api-access-khjlg\") pod \"1575ff3a-a763-4ecb-a536-9c5f82651aed\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") "
Nov 04 02:39:28.033632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033538    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-credential-socket" pod "1575ff3a-a763-4ecb-a536-9c5f82651aed" (UID: "1575ff3a-a763-4ecb-a536-9c5f82651aed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:28.033632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.033567    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8491d004-87be-458d-a69f-3a6a48f595f8-istiod-ca-cert" pod "8491d004-87be-458d-a69f-3a6a48f595f8" (UID: "8491d004-87be-458d-a69f-3a6a48f595f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:28.034411 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034042    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-envoy\") pod \"8491d004-87be-458d-a69f-3a6a48f595f8\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") "
Nov 04 02:39:28.034411 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034165    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-certs\") pod \"8491d004-87be-458d-a69f-3a6a48f595f8\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") "
Nov 04 02:39:28.034411 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034206    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-certs\") pod \"1575ff3a-a763-4ecb-a536-9c5f82651aed\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") "
Nov 04 02:39:28.034411 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034235    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-istio-token\" (UniqueName: \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-istio-token\") pod \"8491d004-87be-458d-a69f-3a6a48f595f8\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") "
Nov 04 02:39:28.034411 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034272    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1575ff3a-a763-4ecb-a536-9c5f82651aed-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1575ff3a-a763-4ecb-a536-9c5f82651aed-istiod-ca-cert\") pod \"1575ff3a-a763-4ecb-a536-9c5f82651aed\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") "
Nov 04 02:39:28.034411 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034312    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-data\") pod \"1575ff3a-a763-4ecb-a536-9c5f82651aed\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") "
Nov 04 02:39:28.034411 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034397    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-socket\") pod \"1575ff3a-a763-4ecb-a536-9c5f82651aed\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") "
Nov 04 02:39:28.034816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034430    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-podinfo\") pod \"1575ff3a-a763-4ecb-a536-9c5f82651aed\" (UID: \"1575ff3a-a763-4ecb-a536-9c5f82651aed\") "
Nov 04 02:39:28.034816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034470    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-socket\") pod \"8491d004-87be-458d-a69f-3a6a48f595f8\" (UID: \"8491d004-87be-458d-a69f-3a6a48f595f8\") "
Nov 04 02:39:28.034816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034611    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-certs" pod "1575ff3a-a763-4ecb-a536-9c5f82651aed" (UID: "1575ff3a-a763-4ecb-a536-9c5f82651aed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:28.034816 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034799    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-data" pod "1575ff3a-a763-4ecb-a536-9c5f82651aed" (UID: "1575ff3a-a763-4ecb-a536-9c5f82651aed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:28.035026 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034885    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-certs" pod "8491d004-87be-458d-a69f-3a6a48f595f8" (UID: "8491d004-87be-458d-a69f-3a6a48f595f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:28.035026 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.034984    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-socket" pod "8491d004-87be-458d-a69f-3a6a48f595f8" (UID: "8491d004-87be-458d-a69f-3a6a48f595f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:28.035128 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.035066    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8491d004-87be-458d-a69f-3a6a48f595f8-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.035128 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.035086    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.035128 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.035102    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.035128 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.035116    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.035337 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.035131    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.035337 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.035145    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.035337 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.035160    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.035337 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.035161    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-socket" pod "1575ff3a-a763-4ecb-a536-9c5f82651aed" (UID: "1575ff3a-a763-4ecb-a536-9c5f82651aed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:28.035337 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.035180    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1575ff3a-a763-4ecb-a536-9c5f82651aed-istiod-ca-cert" pod "1575ff3a-a763-4ecb-a536-9c5f82651aed" (UID: "1575ff3a-a763-4ecb-a536-9c5f82651aed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:28.035975 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.035946    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-envoy" pod "1575ff3a-a763-4ecb-a536-9c5f82651aed" (UID: "1575ff3a-a763-4ecb-a536-9c5f82651aed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:28.036280 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.036259    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-token" pod "1575ff3a-a763-4ecb-a536-9c5f82651aed" (UID: "1575ff3a-a763-4ecb-a536-9c5f82651aed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:28.036365 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.036324    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-kube-api-access-khjlg" pod "1575ff3a-a763-4ecb-a536-9c5f82651aed" (UID: "1575ff3a-a763-4ecb-a536-9c5f82651aed"). InnerVolumeSpecName "kube-api-access-khjlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:28.037121 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.037095    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8491d004-87be-458d-a69f-3a6a48f595f8-istio-podinfo" pod "8491d004-87be-458d-a69f-3a6a48f595f8" (UID: "8491d004-87be-458d-a69f-3a6a48f595f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:39:28.037207 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.037166    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-kube-api-access-mtj96" pod "8491d004-87be-458d-a69f-3a6a48f595f8" (UID: "8491d004-87be-458d-a69f-3a6a48f595f8"). InnerVolumeSpecName "kube-api-access-mtj96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:28.037378 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.037360    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-envoy" pod "8491d004-87be-458d-a69f-3a6a48f595f8" (UID: "8491d004-87be-458d-a69f-3a6a48f595f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:28.037564 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.037544    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-podinfo" pod "1575ff3a-a763-4ecb-a536-9c5f82651aed" (UID: "1575ff3a-a763-4ecb-a536-9c5f82651aed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:39:28.037623 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.037579    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-istio-token" pod "8491d004-87be-458d-a69f-3a6a48f595f8" (UID: "8491d004-87be-458d-a69f-3a6a48f595f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:28.135883 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.135855    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.135883 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.135883    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.136109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.135894    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1575ff3a-a763-4ecb-a536-9c5f82651aed-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.136109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.135904    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.136109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.135919    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.136109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.135932    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8491d004-87be-458d-a69f-3a6a48f595f8-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.136109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.135940    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.136109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.135949    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8491d004-87be-458d-a69f-3a6a48f595f8-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.136109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.135959    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1575ff3a-a763-4ecb-a536-9c5f82651aed-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.136109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.135967    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtj96\" (UniqueName: \"kubernetes.io/projected/8491d004-87be-458d-a69f-3a6a48f595f8-kube-api-access-mtj96\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.136109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.135977    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khjlg\" (UniqueName: \"kubernetes.io/projected/1575ff3a-a763-4ecb-a536-9c5f82651aed-kube-api-access-khjlg\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:28.348999 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.348962    5722 generic.go:356] "Generic (PLEG): container finished" podID="1575ff3a-a763-4ecb-a536-9c5f82651aed" containerID="356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da" exitCode=0
Nov 04 02:39:28.349203 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.349028    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"
Nov 04 02:39:28.349203 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.349042    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" event={"ID":"1575ff3a-a763-4ecb-a536-9c5f82651aed","Type":"ContainerDied","Data":"356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da"}
Nov 04 02:39:28.349203 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.349118    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" event={"ID":"1575ff3a-a763-4ecb-a536-9c5f82651aed","Type":"ContainerDied","Data":"5c665886fe25d5e9452843f7c11bfeced63f1ab20397099ffbec5656417cc1d1"}
Nov 04 02:39:28.349203 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.349146    5722 scope.go:122] "RemoveContainer" containerID="356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da"
Nov 04 02:39:28.350424 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.350404    5722 generic.go:356] "Generic (PLEG): container finished" podID="8491d004-87be-458d-a69f-3a6a48f595f8" containerID="f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2" exitCode=0
Nov 04 02:39:28.350763 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.350459    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"
Nov 04 02:39:28.350763 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.350477    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" event={"ID":"8491d004-87be-458d-a69f-3a6a48f595f8","Type":"ContainerDied","Data":"f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2"}
Nov 04 02:39:28.350763 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.350519    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b" event={"ID":"8491d004-87be-458d-a69f-3a6a48f595f8","Type":"ContainerDied","Data":"fa3e8bf8d437254ce0f3826e55f453a743a372bec6148468939fb83748205166"}
Nov 04 02:39:28.359580 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.359560    5722 scope.go:122] "RemoveContainer" containerID="356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da"
Nov 04 02:39:28.360014 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:39:28.359995    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da\": container with ID starting with 356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da not found: ID does not exist" containerID="356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da"
Nov 04 02:39:28.360103 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.360031    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da"} err="failed to get container status \"356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da\": rpc error: code = NotFound desc = could not find container \"356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da\": container with ID starting with 356fbaea450d6d2b126fb6ceb9737bce066f5fa77be172b94d3c676da1dce2da not found: ID does not exist"
Nov 04 02:39:28.360103 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.360048    5722 scope.go:122] "RemoveContainer" containerID="f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2"
Nov 04 02:39:28.369761 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.369738    5722 scope.go:122] "RemoveContainer" containerID="f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2"
Nov 04 02:39:28.370052 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:39:28.370022    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2\": container with ID starting with f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2 not found: ID does not exist" containerID="f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2"
Nov 04 02:39:28.370180 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.370062    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2"} err="failed to get container status \"f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2\": rpc error: code = NotFound desc = could not find container \"f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2\": container with ID starting with f601141ebf3c6f1ac0ccbf8ada4edd83e5aea4e2f1e7a674971ef63bffe7e8a2 not found: ID does not exist"
Nov 04 02:39:28.518467 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.518374    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"]
Nov 04 02:39:28.522768 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.522741    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-dbd2b"]
Nov 04 02:39:28.635780 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.635749    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"]
Nov 04 02:39:28.640490 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.640464    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m"]
Nov 04 02:39:28.680150 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.680122    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1575ff3a-a763-4ecb-a536-9c5f82651aed" path="/var/lib/kubelet/pods/1575ff3a-a763-4ecb-a536-9c5f82651aed/volumes"
Nov 04 02:39:28.680554 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.680541    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8491d004-87be-458d-a69f-3a6a48f595f8" path="/var/lib/kubelet/pods/8491d004-87be-458d-a69f-3a6a48f595f8/volumes"
Nov 04 02:39:28.834893 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.834809    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 02:39:28.834893 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:28.834869    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-vgp2m" podUID="1575ff3a-a763-4ecb-a536-9c5f82651aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:39:32.457939 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.457908    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"]
Nov 04 02:39:32.458339 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458328    5722 cpu_manager.go:414] "containerMap: removing container" podUID="5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96" containerName="payload-processing"
Nov 04 02:39:32.458381 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458341    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96" containerName="payload-processing"
Nov 04 02:39:32.458381 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458353    5722 cpu_manager.go:414] "containerMap: removing container" podUID="ab09ed0d-6616-4ca0-87b0-c200dcdd5920" containerName="istio-proxy"
Nov 04 02:39:32.458381 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458358    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab09ed0d-6616-4ca0-87b0-c200dcdd5920" containerName="istio-proxy"
Nov 04 02:39:32.458381 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458377    5722 cpu_manager.go:414] "containerMap: removing container" podUID="8491d004-87be-458d-a69f-3a6a48f595f8" containerName="istio-proxy"
Nov 04 02:39:32.458381 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458383    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8491d004-87be-458d-a69f-3a6a48f595f8" containerName="istio-proxy"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458391    5722 cpu_manager.go:414] "containerMap: removing container" podUID="1575ff3a-a763-4ecb-a536-9c5f82651aed" containerName="istio-proxy"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458396    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1575ff3a-a763-4ecb-a536-9c5f82651aed" containerName="istio-proxy"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458405    5722 cpu_manager.go:414] "containerMap: removing container" podUID="28b23a40-aadc-46f0-8e6e-e48581817438" containerName="payload-processing"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458410    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28b23a40-aadc-46f0-8e6e-e48581817438" containerName="payload-processing"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458418    5722 cpu_manager.go:414] "containerMap: removing container" podUID="f165daaa-3088-43eb-8b39-82172e503aa1" containerName="payload-processing"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458423    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f165daaa-3088-43eb-8b39-82172e503aa1" containerName="payload-processing"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458432    5722 cpu_manager.go:414] "containerMap: removing container" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458436    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458442    5722 cpu_manager.go:414] "containerMap: removing container" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458446    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458507    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="8491d004-87be-458d-a69f-3a6a48f595f8" containerName="istio-proxy"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458517    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="1575ff3a-a763-4ecb-a536-9c5f82651aed" containerName="istio-proxy"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458524    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="28b23a40-aadc-46f0-8e6e-e48581817438" containerName="payload-processing"
Nov 04 02:39:32.458528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458530    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="f165daaa-3088-43eb-8b39-82172e503aa1" containerName="payload-processing"
Nov 04 02:39:32.458993 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458537    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy"
Nov 04 02:39:32.458993 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458542    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="7cba5dab-703a-4dc2-b3d3-c7e43ddfb5c2" containerName="istio-proxy"
Nov 04 02:39:32.458993 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458550    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c4a687a-d9d4-4c98-9203-9d5a2fc1aa96" containerName="payload-processing"
Nov 04 02:39:32.458993 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.458555    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab09ed0d-6616-4ca0-87b0-c200dcdd5920" containerName="istio-proxy"
Nov 04 02:39:32.463441 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.463425    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:32.569760 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.569722    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:39:32.569933 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.569768    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:39:32.571893 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.571867    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"]
Nov 04 02:39:32.581480 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.581444    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d1b146bb-xlv2l\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:32.581718 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.581696    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d1b146bb-xlv2l\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:32.581769 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.581734    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvvd9\" (UniqueName: \"kubernetes.io/projected/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-kube-api-access-qvvd9\") pod \"maas-api-revoke-sub-d1b146bb-xlv2l\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:32.683171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.683133    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d1b146bb-xlv2l\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:32.683345 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.683178    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvvd9\" (UniqueName: \"kubernetes.io/projected/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-kube-api-access-qvvd9\") pod \"maas-api-revoke-sub-d1b146bb-xlv2l\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:32.683345 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.683217    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d1b146bb-xlv2l\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:32.683910 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.683839    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d1b146bb-xlv2l\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:32.685634 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.685609    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d1b146bb-xlv2l\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:32.745760 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.745691    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvvd9\" (UniqueName: \"kubernetes.io/projected/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-kube-api-access-qvvd9\") pod \"maas-api-revoke-sub-d1b146bb-xlv2l\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:32.776833 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:32.776802    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:33.099199 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:33.099126    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:33.182717 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:33.180805    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"]
Nov 04 02:39:33.375849 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:33.375816    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l" event={"ID":"f126c75d-c6a7-409d-a0c6-8fbec4561aa0","Type":"ContainerStarted","Data":"5bc427cb304824d46b2f910765f7bba7684e7e28f117250e02de67a583988091"}
Nov 04 02:39:33.745066 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:33.744973    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:34.026478 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:34.026395    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"]
Nov 04 02:39:34.134155 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:34.134123    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"]
Nov 04 02:39:34.382971 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:34.382933    5722 generic.go:356] "Generic (PLEG): container finished" podID="f126c75d-c6a7-409d-a0c6-8fbec4561aa0" containerID="a4a9d57ae07aff36fb7c2048dc0f3f83af2eb92e7714795b9633066dbe8f52bb" exitCode=0
Nov 04 02:39:34.383169 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:34.382973    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l" event={"ID":"f126c75d-c6a7-409d-a0c6-8fbec4561aa0","Type":"ContainerDied","Data":"a4a9d57ae07aff36fb7c2048dc0f3f83af2eb92e7714795b9633066dbe8f52bb"}
Nov 04 02:39:34.424021 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:34.423988    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:34.603064 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:34.603026    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:35.583639 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:35.583616    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:35.748288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:35.748195    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-openshift-ca\") pod \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") "
Nov 04 02:39:35.748528 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:35.748505    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-xks-ca\") pod \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") "
Nov 04 02:39:35.748719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:35.748701    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-kube-api-access-qvvd9\" (UniqueName: \"kubernetes.io/projected/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-kube-api-access-qvvd9\") pod \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\" (UID: \"f126c75d-c6a7-409d-a0c6-8fbec4561aa0\") "
Nov 04 02:39:35.753158 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:35.753051    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-openshift-ca" pod "f126c75d-c6a7-409d-a0c6-8fbec4561aa0" (UID: "f126c75d-c6a7-409d-a0c6-8fbec4561aa0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:35.772741 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:35.769804    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-xks-ca" pod "f126c75d-c6a7-409d-a0c6-8fbec4561aa0" (UID: "f126c75d-c6a7-409d-a0c6-8fbec4561aa0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:39:35.791626 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:35.791588    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-kube-api-access-qvvd9" pod "f126c75d-c6a7-409d-a0c6-8fbec4561aa0" (UID: "f126c75d-c6a7-409d-a0c6-8fbec4561aa0"). InnerVolumeSpecName "kube-api-access-qvvd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:35.850351 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:35.850311    5722 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-openshift-ca\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:35.850351 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:35.850342    5722 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-maas-api-xks-ca\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:35.850351 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:35.850356    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvvd9\" (UniqueName: \"kubernetes.io/projected/f126c75d-c6a7-409d-a0c6-8fbec4561aa0-kube-api-access-qvvd9\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:36.393740 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:36.393707    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"
Nov 04 02:39:36.393922 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:36.393749    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l" event={"ID":"f126c75d-c6a7-409d-a0c6-8fbec4561aa0","Type":"ContainerDied","Data":"5bc427cb304824d46b2f910765f7bba7684e7e28f117250e02de67a583988091"}
Nov 04 02:39:36.393922 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:36.393799    5722 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bc427cb304824d46b2f910765f7bba7684e7e28f117250e02de67a583988091"
Nov 04 02:39:37.952291 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:37.952250    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:39.027348 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:39.027264    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k" podUID="39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a" containerName="payload-processing" containerID="cri-o://0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe" gracePeriod=25
Nov 04 02:39:39.135354 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:39.135316    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw" podUID="528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8" containerName="payload-pre-processing" containerID="cri-o://1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3" gracePeriod=25
Nov 04 02:39:39.896614 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:39.896582    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:40.074250 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:40.074216    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:40.345595 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:40.345512    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:40.526438 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:40.526406    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:40.609709 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:39:40.609609    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:39:40.859392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:40.859333    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf" podUID="8510d5a9-b444-4d2f-8a07-e0790770a68c" containerName="main" containerID="cri-o://502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c" gracePeriod=45
Nov 04 02:39:41.121233 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.121209    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:39:41.211956 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.211921    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-home\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-home\") pod \"8510d5a9-b444-4d2f-8a07-e0790770a68c\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") "
Nov 04 02:39:41.212149 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.211978    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8510d5a9-b444-4d2f-8a07-e0790770a68c-tls-certs\" (UniqueName: \"kubernetes.io/secret/8510d5a9-b444-4d2f-8a07-e0790770a68c-tls-certs\") pod \"8510d5a9-b444-4d2f-8a07-e0790770a68c\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") "
Nov 04 02:39:41.212149 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.212017    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8510d5a9-b444-4d2f-8a07-e0790770a68c-kube-api-access-bns8s\" (UniqueName: \"kubernetes.io/projected/8510d5a9-b444-4d2f-8a07-e0790770a68c-kube-api-access-bns8s\") pod \"8510d5a9-b444-4d2f-8a07-e0790770a68c\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") "
Nov 04 02:39:41.212149 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.212067    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-tmp-dir\") pod \"8510d5a9-b444-4d2f-8a07-e0790770a68c\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") "
Nov 04 02:39:41.212149 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.212146    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-model-cache\") pod \"8510d5a9-b444-4d2f-8a07-e0790770a68c\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") "
Nov 04 02:39:41.212394 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.212194    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-dshm\") pod \"8510d5a9-b444-4d2f-8a07-e0790770a68c\" (UID: \"8510d5a9-b444-4d2f-8a07-e0790770a68c\") "
Nov 04 02:39:41.212394 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.212374    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-home" pod "8510d5a9-b444-4d2f-8a07-e0790770a68c" (UID: "8510d5a9-b444-4d2f-8a07-e0790770a68c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:41.212557 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.212539    5722 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-home\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:41.212620 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.212581    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-model-cache" pod "8510d5a9-b444-4d2f-8a07-e0790770a68c" (UID: "8510d5a9-b444-4d2f-8a07-e0790770a68c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:41.212827 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.212766    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-tmp-dir" pod "8510d5a9-b444-4d2f-8a07-e0790770a68c" (UID: "8510d5a9-b444-4d2f-8a07-e0790770a68c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:41.214480 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.214453    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-dshm" pod "8510d5a9-b444-4d2f-8a07-e0790770a68c" (UID: "8510d5a9-b444-4d2f-8a07-e0790770a68c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:41.214583 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.214497    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8510d5a9-b444-4d2f-8a07-e0790770a68c-tls-certs" pod "8510d5a9-b444-4d2f-8a07-e0790770a68c" (UID: "8510d5a9-b444-4d2f-8a07-e0790770a68c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:39:41.214624 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.214589    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8510d5a9-b444-4d2f-8a07-e0790770a68c-kube-api-access-bns8s" pod "8510d5a9-b444-4d2f-8a07-e0790770a68c" (UID: "8510d5a9-b444-4d2f-8a07-e0790770a68c"). InnerVolumeSpecName "kube-api-access-bns8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:41.313184 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.313150    5722 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-model-cache\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:41.313184 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.313181    5722 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-dshm\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:41.313184 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.313191    5722 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8510d5a9-b444-4d2f-8a07-e0790770a68c-tls-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:41.313410 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.313202    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bns8s\" (UniqueName: \"kubernetes.io/projected/8510d5a9-b444-4d2f-8a07-e0790770a68c-kube-api-access-bns8s\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:41.313410 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.313213    5722 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8510d5a9-b444-4d2f-8a07-e0790770a68c-tmp-dir\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:41.425697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.425596    5722 generic.go:356] "Generic (PLEG): container finished" podID="8510d5a9-b444-4d2f-8a07-e0790770a68c" containerID="502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c" exitCode=0
Nov 04 02:39:41.425697 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.425639    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"
Nov 04 02:39:41.425872 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.425692    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf" event={"ID":"8510d5a9-b444-4d2f-8a07-e0790770a68c","Type":"ContainerDied","Data":"502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c"}
Nov 04 02:39:41.425872 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.425735    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf" event={"ID":"8510d5a9-b444-4d2f-8a07-e0790770a68c","Type":"ContainerDied","Data":"dc5cb23bafb897f42679180998605798cceca325fd28954087930034cc26ae37"}
Nov 04 02:39:41.425872 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.425767    5722 scope.go:122] "RemoveContainer" containerID="502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c"
Nov 04 02:39:41.435225 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.435208    5722 scope.go:122] "RemoveContainer" containerID="502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c"
Nov 04 02:39:41.435486 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:39:41.435467    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c\": container with ID starting with 502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c not found: ID does not exist" containerID="502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c"
Nov 04 02:39:41.435543 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.435496    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c"} err="failed to get container status \"502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c\": rpc error: code = NotFound desc = could not find container \"502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c\": container with ID starting with 502cbd7c97d1f81f7244c68b5794aedc39436c062d09ac4fe3fedcf47890f37c not found: ID does not exist"
Nov 04 02:39:41.593370 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.593329    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"]
Nov 04 02:39:41.597397 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:41.597371    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/simulator-w0-2ba6b8-kserve-75cc8b5cb-25kvf"]
Nov 04 02:39:42.068741 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:42.068706    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:42.630896 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:42.628297    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:42.679533 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:42.679496    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8510d5a9-b444-4d2f-8a07-e0790770a68c" path="/var/lib/kubelet/pods/8510d5a9-b444-4d2f-8a07-e0790770a68c/volumes"
Nov 04 02:39:43.091910 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:43.091822    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:43.624794 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:43.624763    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k" podUID="39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:39:43.624794 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:43.624772    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw" podUID="528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:39:45.704188 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:45.704152    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:45.878188 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:45.878151    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:46.172885 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:46.172853    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:46.352090 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:46.352056    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:48.115284 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.115252    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:48.298970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.298933    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:48.577839 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.577802    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"]
Nov 04 02:39:48.578295 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.578280    5722 cpu_manager.go:414] "containerMap: removing container" podUID="8510d5a9-b444-4d2f-8a07-e0790770a68c" containerName="main"
Nov 04 02:39:48.578337 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.578297    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8510d5a9-b444-4d2f-8a07-e0790770a68c" containerName="main"
Nov 04 02:39:48.578337 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.578308    5722 cpu_manager.go:414] "containerMap: removing container" podUID="f126c75d-c6a7-409d-a0c6-8fbec4561aa0" containerName="revoke-keys"
Nov 04 02:39:48.578337 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.578316    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f126c75d-c6a7-409d-a0c6-8fbec4561aa0" containerName="revoke-keys"
Nov 04 02:39:48.578428 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.578400    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="8510d5a9-b444-4d2f-8a07-e0790770a68c" containerName="main"
Nov 04 02:39:48.578428 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.578409    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="f126c75d-c6a7-409d-a0c6-8fbec4561aa0" containerName="revoke-keys"
Nov 04 02:39:48.581584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.581568    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.589198 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.589178    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-provider-credentials\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.589317 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.589210    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-plugins-config-volume\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.589317 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.589232    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9rw9\" (UniqueName: \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-kube-api-access-s9rw9\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.589411 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.589391    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-routing-overlay-volume\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.686769 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.686723    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-a2f4f0610abb\""
Nov 04 02:39:48.686769 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.686748    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"openshift-service-ca.crt\""
Nov 04 02:39:48.686769 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.686763    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-dockercfg-btb9r\""
Nov 04 02:39:48.686769 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.686735    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"routing-overlay\""
Nov 04 02:39:48.687169 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.686772    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"kube-root-ca.crt\""
Nov 04 02:39:48.687169 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.686772    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-plugins\""
Nov 04 02:39:48.688638 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.688612    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"]
Nov 04 02:39:48.690571 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.690552    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9rw9\" (UniqueName: \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-kube-api-access-s9rw9\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.690687 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.690632    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-routing-overlay-volume\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.690725 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.690709    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-provider-credentials\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.690771 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.690747    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-plugins-config-volume\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.691301 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.691283    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-routing-overlay-volume\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.691406 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.691389    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-plugins-config-volume\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.693460 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.693434    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-provider-credentials\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.753124 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.753087    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9rw9\" (UniqueName: \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-kube-api-access-s9rw9\") pod \"payload-processing-external-model-b6fbcb49-hvml2\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") " pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:48.894292 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:48.894254    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:49.263719 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:39:49.263621    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod781e5a65_33be_432b_9445_f5ce66d9274f.slice/crio-841d2e0a977815177ae3a2ea774d0b1f4f804dd07966e86edec15e56de89522e WatchSource:0}: Error finding container 841d2e0a977815177ae3a2ea774d0b1f4f804dd07966e86edec15e56de89522e: Status 404 returned error can't find the container with id 841d2e0a977815177ae3a2ea774d0b1f4f804dd07966e86edec15e56de89522e
Nov 04 02:39:49.267338 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:49.267314    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"]
Nov 04 02:39:49.466622 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:49.466586    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" event={"ID":"781e5a65-33be-432b-9445-f5ce66d9274f","Type":"ContainerStarted","Data":"f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068"}
Nov 04 02:39:49.466848 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:49.466641    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" event={"ID":"781e5a65-33be-432b-9445-f5ce66d9274f","Type":"ContainerStarted","Data":"841d2e0a977815177ae3a2ea774d0b1f4f804dd07966e86edec15e56de89522e"}
Nov 04 02:39:49.466848 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:49.466706    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:39:49.587708 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:49.587581    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podStartSLOduration=1.5875661129999998 podStartE2EDuration="1.587566113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:39:49.586202172 +0000 UTC m=+1401.059739355" watchObservedRunningTime="2026-11-04 02:39:49.587566113 +0000 UTC m=+1401.061103330"
Nov 04 02:39:51.394225 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:51.394199    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:52.984443 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:52.984409    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"]
Nov 04 02:39:53.035758 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:53.035731    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"]
Nov 04 02:39:53.037925 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:53.037894    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"]
Nov 04 02:39:53.176647 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:53.176583    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:53.625119 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:53.625085    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw" podUID="528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:39:53.625297 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:53.625086    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k" podUID="39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:39:54.499504 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:54.499470    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:56.789629 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:56.789592    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:58.183642 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:58.183604    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:58.433296 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:58.433265    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:59.290880 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.290817    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:39:59.381289 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.381263    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:39:59.390820 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.390794    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:39:59.393915 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.393894    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-kube-api-access-jhqks\" (UniqueName: \"kubernetes.io/projected/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-kube-api-access-jhqks\") pod \"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a\" (UID: \"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a\") "
Nov 04 02:39:59.394009 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.393927    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-plugins-config-volume\") pod \"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a\" (UID: \"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a\") "
Nov 04 02:39:59.394306 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.394285    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-plugins-config-volume" pod "39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a" (UID: "39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:59.396030 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.396010    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-kube-api-access-jhqks" pod "39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a" (UID: "39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a"). InnerVolumeSpecName "kube-api-access-jhqks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:59.494518 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.494496    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-kube-api-access-6zndb\" (UniqueName: \"kubernetes.io/projected/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-kube-api-access-6zndb\") pod \"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8\" (UID: \"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8\") "
Nov 04 02:39:59.494628 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.494561    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-plugins-config-volume\") pod \"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8\" (UID: \"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8\") "
Nov 04 02:39:59.494864 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.494848    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhqks\" (UniqueName: \"kubernetes.io/projected/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-kube-api-access-jhqks\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:59.494933 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.494868    5722 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a-plugins-config-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:59.494933 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.494906    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-plugins-config-volume" pod "528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8" (UID: "528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:59.496666 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.496636    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-kube-api-access-6zndb" pod "528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8" (UID: "528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8"). InnerVolumeSpecName "kube-api-access-6zndb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:59.515581 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.515555    5722 generic.go:356] "Generic (PLEG): container finished" podID="39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a" containerID="0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe" exitCode=0
Nov 04 02:39:59.515687 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.515597    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"
Nov 04 02:39:59.515687 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.515612    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k" event={"ID":"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a","Type":"ContainerDied","Data":"0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe"}
Nov 04 02:39:59.515786 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.515691    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k" event={"ID":"39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a","Type":"ContainerDied","Data":"93ac7258d87bfd15460a34492afde520467281a254277e8adcf0170c97ee3594"}
Nov 04 02:39:59.515786 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.515715    5722 scope.go:122] "RemoveContainer" containerID="0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe"
Nov 04 02:39:59.517063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.517042    5722 generic.go:356] "Generic (PLEG): container finished" podID="528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8" containerID="1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3" exitCode=0
Nov 04 02:39:59.517174 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.517092    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"
Nov 04 02:39:59.517174 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.517129    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw" event={"ID":"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8","Type":"ContainerDied","Data":"1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3"}
Nov 04 02:39:59.517258 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.517192    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw" event={"ID":"528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8","Type":"ContainerDied","Data":"c2b060d3f3ee7228c0b594a798cfecda80d7213fdf873e33064308464e979d5c"}
Nov 04 02:39:59.524544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.524464    5722 scope.go:122] "RemoveContainer" containerID="0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe"
Nov 04 02:39:59.524873 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:39:59.524842    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe\": container with ID starting with 0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe not found: ID does not exist" containerID="0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe"
Nov 04 02:39:59.524956 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.524878    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe"} err="failed to get container status \"0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe\": rpc error: code = NotFound desc = could not find container \"0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe\": container with ID starting with 0cf085a572c1c432ae825fcfa6b599d684064e013573eb319427162cc6eed9fe not found: ID does not exist"
Nov 04 02:39:59.524956 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.524903    5722 scope.go:122] "RemoveContainer" containerID="1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3"
Nov 04 02:39:59.534071 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.534055    5722 scope.go:122] "RemoveContainer" containerID="1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3"
Nov 04 02:39:59.534330 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:39:59.534309    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3\": container with ID starting with 1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3 not found: ID does not exist" containerID="1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3"
Nov 04 02:39:59.534409 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.534341    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3"} err="failed to get container status \"1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3\": rpc error: code = NotFound desc = could not find container \"1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3\": container with ID starting with 1533b29e33f26cd10aa08cb70341126090c7cbde4f95a86f5e92b865affc1fe3 not found: ID does not exist"
Nov 04 02:39:59.596376 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.596285    5722 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-plugins-config-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:59.596376 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.596309    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zndb\" (UniqueName: \"kubernetes.io/projected/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8-kube-api-access-6zndb\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:59.640768 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.640746    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"]
Nov 04 02:39:59.644866 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.644847    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2ba6b8-6dcc87dd8-wv76k"]
Nov 04 02:39:59.756509 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.756478    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"]
Nov 04 02:39:59.762139 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:39:59.762114    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-2ba6b8-6549d78655-lrshw"]
Nov 04 02:40:00.474150 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:00.474034    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:40:00.679111 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:00.679084    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a" path="/var/lib/kubelet/pods/39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a/volumes"
Nov 04 02:40:00.679452 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:00.679438    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8" path="/var/lib/kubelet/pods/528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8/volumes"
Nov 04 02:40:01.102050 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:01.102017    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:02.109983 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:02.109945    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:02.299472 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:02.299401    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:02.583934 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:02.583897    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:03.644114 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:03.644079    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:03.815075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:03.815040    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:05.691084 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:05.691046    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:06.559358 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:06.559324    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:06.761894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:06.761861    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:07.351821 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:07.351790    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:08.004464 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.004428    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz" podUID="653b3986-bd80-4a1f-998c-0f49d561fcd3" containerName="main" containerID="cri-o://76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501" gracePeriod=45
Nov 04 02:40:08.055472 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.055438    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm" podUID="b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" containerName="main" containerID="cri-o://d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f" gracePeriod=45
Nov 04 02:40:08.056797 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.056768    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc" podUID="4c6334f2-998f-43bb-8342-ac444013c6b3" containerName="main" containerID="cri-o://02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5" gracePeriod=45
Nov 04 02:40:08.349487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.349455    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:40:08.373054 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.373026    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:40:08.377895 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.377873    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:40:08.423510 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.423473    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:08.549967 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.549881    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-kube-api-access-bbm4f\" (UniqueName: \"kubernetes.io/projected/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-kube-api-access-bbm4f\") pod \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") "
Nov 04 02:40:08.549967 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.549922    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tls-certs\" (UniqueName: \"kubernetes.io/secret/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tls-certs\") pod \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") "
Nov 04 02:40:08.549967 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.549950    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-home\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-home\") pod \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") "
Nov 04 02:40:08.549967 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.549965    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-dshm\") pod \"653b3986-bd80-4a1f-998c-0f49d561fcd3\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") "
Nov 04 02:40:08.550283 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.549988    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-model-cache\") pod \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") "
Nov 04 02:40:08.550283 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550022    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-model-cache\") pod \"653b3986-bd80-4a1f-998c-0f49d561fcd3\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") "
Nov 04 02:40:08.550283 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550053    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-dshm\") pod \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") "
Nov 04 02:40:08.550283 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550087    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c6334f2-998f-43bb-8342-ac444013c6b3-tls-certs\" (UniqueName: \"kubernetes.io/secret/4c6334f2-998f-43bb-8342-ac444013c6b3-tls-certs\") pod \"4c6334f2-998f-43bb-8342-ac444013c6b3\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") "
Nov 04 02:40:08.550283 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550121    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tmp-dir\") pod \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\" (UID: \"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552\") "
Nov 04 02:40:08.550283 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550174    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-tmp-dir\") pod \"653b3986-bd80-4a1f-998c-0f49d561fcd3\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") "
Nov 04 02:40:08.550283 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550194    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-home" pod "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" (UID: "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.550283 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550214    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c6334f2-998f-43bb-8342-ac444013c6b3-kube-api-access-slbn6\" (UniqueName: \"kubernetes.io/projected/4c6334f2-998f-43bb-8342-ac444013c6b3-kube-api-access-slbn6\") pod \"4c6334f2-998f-43bb-8342-ac444013c6b3\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") "
Nov 04 02:40:08.550283 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550247    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/653b3986-bd80-4a1f-998c-0f49d561fcd3-kube-api-access-ftftp\" (UniqueName: \"kubernetes.io/projected/653b3986-bd80-4a1f-998c-0f49d561fcd3-kube-api-access-ftftp\") pod \"653b3986-bd80-4a1f-998c-0f49d561fcd3\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") "
Nov 04 02:40:08.550739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550316    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-model-cache\") pod \"4c6334f2-998f-43bb-8342-ac444013c6b3\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") "
Nov 04 02:40:08.550739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550350    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-model-cache" pod "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" (UID: "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.550739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550357    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-home\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-home\") pod \"653b3986-bd80-4a1f-998c-0f49d561fcd3\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") "
Nov 04 02:40:08.550739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550439    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-home\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-home\") pod \"4c6334f2-998f-43bb-8342-ac444013c6b3\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") "
Nov 04 02:40:08.550739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550522    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-tmp-dir\") pod \"4c6334f2-998f-43bb-8342-ac444013c6b3\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") "
Nov 04 02:40:08.550739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550529    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-home" pod "653b3986-bd80-4a1f-998c-0f49d561fcd3" (UID: "653b3986-bd80-4a1f-998c-0f49d561fcd3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.550739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550552    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/653b3986-bd80-4a1f-998c-0f49d561fcd3-tls-certs\" (UniqueName: \"kubernetes.io/secret/653b3986-bd80-4a1f-998c-0f49d561fcd3-tls-certs\") pod \"653b3986-bd80-4a1f-998c-0f49d561fcd3\" (UID: \"653b3986-bd80-4a1f-998c-0f49d561fcd3\") "
Nov 04 02:40:08.550739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550549    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-model-cache" pod "653b3986-bd80-4a1f-998c-0f49d561fcd3" (UID: "653b3986-bd80-4a1f-998c-0f49d561fcd3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.550739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550590    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-dshm\") pod \"4c6334f2-998f-43bb-8342-ac444013c6b3\" (UID: \"4c6334f2-998f-43bb-8342-ac444013c6b3\") "
Nov 04 02:40:08.550739 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.550678    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tmp-dir" pod "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" (UID: "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.551202 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.551030    5722 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-home\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.551202 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.551050    5722 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-home\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.551202 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.551064    5722 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-model-cache\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.551202 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.551079    5722 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-model-cache\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.551202 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.551093    5722 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tmp-dir\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.551587 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.551545    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-model-cache" pod "4c6334f2-998f-43bb-8342-ac444013c6b3" (UID: "4c6334f2-998f-43bb-8342-ac444013c6b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.551713 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.551613    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-tmp-dir" pod "4c6334f2-998f-43bb-8342-ac444013c6b3" (UID: "4c6334f2-998f-43bb-8342-ac444013c6b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.551776 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.551715    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-tmp-dir" pod "653b3986-bd80-4a1f-998c-0f49d561fcd3" (UID: "653b3986-bd80-4a1f-998c-0f49d561fcd3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.551831 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.551781    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-home" pod "4c6334f2-998f-43bb-8342-ac444013c6b3" (UID: "4c6334f2-998f-43bb-8342-ac444013c6b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.552844 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.552809    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-dshm" pod "653b3986-bd80-4a1f-998c-0f49d561fcd3" (UID: "653b3986-bd80-4a1f-998c-0f49d561fcd3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.553246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.553217    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tls-certs" pod "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" (UID: "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:08.553477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.553450    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-dshm" pod "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" (UID: "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.553801 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.553773    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/653b3986-bd80-4a1f-998c-0f49d561fcd3-kube-api-access-ftftp" pod "653b3986-bd80-4a1f-998c-0f49d561fcd3" (UID: "653b3986-bd80-4a1f-998c-0f49d561fcd3"). InnerVolumeSpecName "kube-api-access-ftftp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:08.553801 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.553791    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6334f2-998f-43bb-8342-ac444013c6b3-kube-api-access-slbn6" pod "4c6334f2-998f-43bb-8342-ac444013c6b3" (UID: "4c6334f2-998f-43bb-8342-ac444013c6b3"). InnerVolumeSpecName "kube-api-access-slbn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:08.554302 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.554284    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/653b3986-bd80-4a1f-998c-0f49d561fcd3-tls-certs" pod "653b3986-bd80-4a1f-998c-0f49d561fcd3" (UID: "653b3986-bd80-4a1f-998c-0f49d561fcd3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:08.554446 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.554430    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-dshm" pod "4c6334f2-998f-43bb-8342-ac444013c6b3" (UID: "4c6334f2-998f-43bb-8342-ac444013c6b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.554501 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.554481    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-kube-api-access-bbm4f" pod "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" (UID: "b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552"). InnerVolumeSpecName "kube-api-access-bbm4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:08.554559 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.554542    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c6334f2-998f-43bb-8342-ac444013c6b3-tls-certs" pod "4c6334f2-998f-43bb-8342-ac444013c6b3" (UID: "4c6334f2-998f-43bb-8342-ac444013c6b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:08.608017 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.607981    5722 generic.go:356] "Generic (PLEG): container finished" podID="4c6334f2-998f-43bb-8342-ac444013c6b3" containerID="02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5" exitCode=0
Nov 04 02:40:08.608186 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.608125    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"
Nov 04 02:40:08.608345 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.608307    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc" event={"ID":"4c6334f2-998f-43bb-8342-ac444013c6b3","Type":"ContainerDied","Data":"02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5"}
Nov 04 02:40:08.608475 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.608380    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc" event={"ID":"4c6334f2-998f-43bb-8342-ac444013c6b3","Type":"ContainerDied","Data":"8d9d9c28f59fcfd77e2759ac557135384171afd7a103def93dae6d202e8e106e"}
Nov 04 02:40:08.608475 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.608400    5722 scope.go:122] "RemoveContainer" containerID="02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5"
Nov 04 02:40:08.610207 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.610184    5722 generic.go:356] "Generic (PLEG): container finished" podID="b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" containerID="d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f" exitCode=0
Nov 04 02:40:08.610513 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.610492    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm" event={"ID":"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552","Type":"ContainerDied","Data":"d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f"}
Nov 04 02:40:08.610613 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.610530    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm" event={"ID":"b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552","Type":"ContainerDied","Data":"5132f5e51fe37ef73266d3d65c6d45411e75f8f2c94e5500749d0be39b334697"}
Nov 04 02:40:08.610613 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.610599    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"
Nov 04 02:40:08.612689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.612400    5722 generic.go:356] "Generic (PLEG): container finished" podID="653b3986-bd80-4a1f-998c-0f49d561fcd3" containerID="76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501" exitCode=0
Nov 04 02:40:08.612689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.612480    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz" event={"ID":"653b3986-bd80-4a1f-998c-0f49d561fcd3","Type":"ContainerDied","Data":"76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501"}
Nov 04 02:40:08.612689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.612508    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz" event={"ID":"653b3986-bd80-4a1f-998c-0f49d561fcd3","Type":"ContainerDied","Data":"c2fce1fde2235cdc2a32fb51c19886c8e809ffb0c98101bf1295c6cd609bdeb4"}
Nov 04 02:40:08.612689 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.612563    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"
Nov 04 02:40:08.633979 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.633959    5722 scope.go:122] "RemoveContainer" containerID="02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5"
Nov 04 02:40:08.634295 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:40:08.634275    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5\": container with ID starting with 02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5 not found: ID does not exist" containerID="02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5"
Nov 04 02:40:08.634358 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.634308    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5"} err="failed to get container status \"02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5\": rpc error: code = NotFound desc = could not find container \"02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5\": container with ID starting with 02942bca27c5881c82e956086b10c5e98fe4038cd7ea8d9537ee0fb142cb7ab5 not found: ID does not exist"
Nov 04 02:40:08.634358 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.634327    5722 scope.go:122] "RemoveContainer" containerID="d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f"
Nov 04 02:40:08.643632 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.643605    5722 scope.go:122] "RemoveContainer" containerID="d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f"
Nov 04 02:40:08.643931 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:40:08.643906    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f\": container with ID starting with d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f not found: ID does not exist" containerID="d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f"
Nov 04 02:40:08.644025 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.643940    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f"} err="failed to get container status \"d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f\": rpc error: code = NotFound desc = could not find container \"d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f\": container with ID starting with d6c4799ad3a114f851d727c6e3f153b3a38aca22cd48fd6ac8e386c04e6fa81f not found: ID does not exist"
Nov 04 02:40:08.644025 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.643976    5722 scope.go:122] "RemoveContainer" containerID="76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501"
Nov 04 02:40:08.652580 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652554    5722 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-tmp-dir\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652587    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slbn6\" (UniqueName: \"kubernetes.io/projected/4c6334f2-998f-43bb-8342-ac444013c6b3-kube-api-access-slbn6\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652602    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftftp\" (UniqueName: \"kubernetes.io/projected/653b3986-bd80-4a1f-998c-0f49d561fcd3-kube-api-access-ftftp\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652617    5722 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-model-cache\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652632    5722 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-home\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652645    5722 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-tmp-dir\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652675    5722 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/653b3986-bd80-4a1f-998c-0f49d561fcd3-tls-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652687    5722 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c6334f2-998f-43bb-8342-ac444013c6b3-dshm\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652700    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbm4f\" (UniqueName: \"kubernetes.io/projected/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-kube-api-access-bbm4f\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652715    5722 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-tls-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652728    5722 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/653b3986-bd80-4a1f-998c-0f49d561fcd3-dshm\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652740    5722 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552-dshm\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.652781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652752    5722 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c6334f2-998f-43bb-8342-ac444013c6b3-tls-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.653269 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.652801    5722 scope.go:122] "RemoveContainer" containerID="76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501"
Nov 04 02:40:08.653269 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:40:08.653103    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501\": container with ID starting with 76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501 not found: ID does not exist" containerID="76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501"
Nov 04 02:40:08.653269 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.653132    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501"} err="failed to get container status \"76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501\": rpc error: code = NotFound desc = could not find container \"76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501\": container with ID starting with 76c47d34847acb8c249b9e53976fb0e3b0f3694dd3a6b354549a384bb742e501 not found: ID does not exist"
Nov 04 02:40:08.823562 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.823479    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"]
Nov 04 02:40:08.827767 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.827739    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm"]
Nov 04 02:40:08.939801 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.939767    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"]
Nov 04 02:40:08.944060 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:08.944037    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-2-w4-ab53c1-kserve-846c658f7-vcklz"]
Nov 04 02:40:09.055849 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:09.055809    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"]
Nov 04 02:40:09.062347 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:09.062321    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/simulator-w4-ab53c1-kserve-5f8f499966-524nc"]
Nov 04 02:40:09.353888 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:09.353846    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ab53c1/premium-w4-ab53c1-kserve-699646b667-gzrcm" podUID="b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" containerName="main" probeResult="failure" output="Get \"https://10.132.0.45:8000/ready\": context deadline exceeded"
Nov 04 02:40:09.875903 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:09.875866    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:10.068419 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:10.068391    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:10.472918 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:10.472885    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:40:10.607571 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:40:10.607534    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:40:10.679613 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:10.679581    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4c6334f2-998f-43bb-8342-ac444013c6b3" path="/var/lib/kubelet/pods/4c6334f2-998f-43bb-8342-ac444013c6b3/volumes"
Nov 04 02:40:10.680009 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:10.679994    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="653b3986-bd80-4a1f-998c-0f49d561fcd3" path="/var/lib/kubelet/pods/653b3986-bd80-4a1f-998c-0f49d561fcd3/volumes"
Nov 04 02:40:10.680343 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:10.680330    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" path="/var/lib/kubelet/pods/b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552/volumes"
Nov 04 02:40:11.536186 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:11.536124    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:13.460589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.460546    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"]
Nov 04 02:40:13.464680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.461399    5722 cpu_manager.go:414] "containerMap: removing container" podUID="4c6334f2-998f-43bb-8342-ac444013c6b3" containerName="main"
Nov 04 02:40:13.464680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.461423    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c6334f2-998f-43bb-8342-ac444013c6b3" containerName="main"
Nov 04 02:40:13.464680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.461439    5722 cpu_manager.go:414] "containerMap: removing container" podUID="653b3986-bd80-4a1f-998c-0f49d561fcd3" containerName="main"
Nov 04 02:40:13.464680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.461447    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="653b3986-bd80-4a1f-998c-0f49d561fcd3" containerName="main"
Nov 04 02:40:13.464680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.461484    5722 cpu_manager.go:414] "containerMap: removing container" podUID="39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a" containerName="payload-processing"
Nov 04 02:40:13.464680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.461490    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a" containerName="payload-processing"
Nov 04 02:40:13.464680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.461528    5722 cpu_manager.go:414] "containerMap: removing container" podUID="528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8" containerName="payload-pre-processing"
Nov 04 02:40:13.464680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.461535    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8" containerName="payload-pre-processing"
Nov 04 02:40:13.464680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.461548    5722 cpu_manager.go:414] "containerMap: removing container" podUID="b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" containerName="main"
Nov 04 02:40:13.464680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.461554    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" containerName="main"
Nov 04 02:40:13.481833 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.481804    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="528302b1-eeb6-4a0b-8f8b-03ce2a1ba4d8" containerName="payload-pre-processing"
Nov 04 02:40:13.482035 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.482018    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="b95a5b9c-ce7e-4b47-87e5-5f4bf2ede552" containerName="main"
Nov 04 02:40:13.482158 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.482146    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c6334f2-998f-43bb-8342-ac444013c6b3" containerName="main"
Nov 04 02:40:13.482256 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.482244    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="653b3986-bd80-4a1f-998c-0f49d561fcd3" containerName="main"
Nov 04 02:40:13.482342 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.482332    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="39fdbf5d-c4a1-4a07-a9c2-f6f4f7a44c3a" containerName="payload-processing"
Nov 04 02:40:13.510706 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.510673    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:13.524683 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.517913    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.528680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.526434    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"]
Nov 04 02:40:13.595201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.595171    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-2ba6b8-openshift-default-dockercfg-n895s\""
Nov 04 02:40:13.641396 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.641352    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-podinfo\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.641722 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.641697    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-credential-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.641903 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.641885    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-envoy\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.642049 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.642033    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.642400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.642285    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-certs\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.642554 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.642536    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-data\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.642883 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.642857    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-token\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.643136 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.643117    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5wf8\" (UniqueName: \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-kube-api-access-n5wf8\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.643395 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.643362    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecc4012-ebb1-4baf-a0f7-138793c76990-istiod-ca-cert\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.745095 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.745011    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecc4012-ebb1-4baf-a0f7-138793c76990-istiod-ca-cert\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.746442 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.746422    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-podinfo\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.747055 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.747037    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-credential-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.747829 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.747812    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-envoy\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.748257 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.748240    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.748863 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.746316    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecc4012-ebb1-4baf-a0f7-138793c76990-istiod-ca-cert\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.748981 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.747756    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-credential-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.749067 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.748761    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.749789 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.749771    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-certs\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.750206 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.750190    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-data\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.751035 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.751017    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-token\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.751480 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.751462    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5wf8\" (UniqueName: \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-kube-api-access-n5wf8\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.751859 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.750930    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-data\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.751978 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.750713    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-podinfo\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.752062 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.750120    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-certs\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.752585 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.752569    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-envoy\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.809089 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.809046    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:13.822428 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.822398    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-token\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.835629 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.835602    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5wf8\" (UniqueName: \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-kube-api-access-n5wf8\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:13.858631 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:13.858596    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:14.405899 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:40:14.405858    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecc4012_ebb1_4baf_a0f7_138793c76990.slice/crio-2a693bd967c44b7efa7ec78fe6f953ce88cc19fb015dcbd154d239f02ec29063 WatchSource:0}: Error finding container 2a693bd967c44b7efa7ec78fe6f953ce88cc19fb015dcbd154d239f02ec29063: Status 404 returned error can't find the container with id 2a693bd967c44b7efa7ec78fe6f953ce88cc19fb015dcbd154d239f02ec29063
Nov 04 02:40:14.407707 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:14.407649    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"]
Nov 04 02:40:14.408373 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:14.408336    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:40:14.408438 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:14.408422    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:40:14.408486 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:14.408471    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:40:14.663698 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:14.663572    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" event={"ID":"1ecc4012-ebb1-4baf-a0f7-138793c76990","Type":"ContainerStarted","Data":"8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803"}
Nov 04 02:40:14.663698 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:14.663632    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" event={"ID":"1ecc4012-ebb1-4baf-a0f7-138793c76990","Type":"ContainerStarted","Data":"2a693bd967c44b7efa7ec78fe6f953ce88cc19fb015dcbd154d239f02ec29063"}
Nov 04 02:40:14.786945 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:14.786884    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" podStartSLOduration=1.786866794 podStartE2EDuration="1.786866794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:40:14.78625876 +0000 UTC m=+1426.259795943" watchObservedRunningTime="2026-11-04 02:40:14.786866794 +0000 UTC m=+1426.260403976"
Nov 04 02:40:14.865612 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:14.860762    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:15.861954 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:15.861904    5722 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 04 02:40:15.862523 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:15.862490    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" podUID="1ecc4012-ebb1-4baf-a0f7-138793c76990" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 04 02:40:16.042033 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:16.041999    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:16.859730 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:16.859695    5722 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 04 02:40:16.859916 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:16.859746    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" podUID="1ecc4012-ebb1-4baf-a0f7-138793c76990" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 04 02:40:17.778985 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:17.778952    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:17.859674 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:17.859628    5722 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 04 02:40:17.859836 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:17.859698    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" podUID="1ecc4012-ebb1-4baf-a0f7-138793c76990" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 04 02:40:18.859211 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:18.859180    5722 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 04 02:40:18.859583 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:18.859229    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" podUID="1ecc4012-ebb1-4baf-a0f7-138793c76990" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 04 02:40:19.859611 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:19.859576    5722 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Nov 04 02:40:19.860028 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:19.859630    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" podUID="1ecc4012-ebb1-4baf-a0f7-138793c76990" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Nov 04 02:40:19.902404 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:19.902372    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:20.087216 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:20.087125    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:20.472938 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:20.472903    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:40:20.863385 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:20.863311    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:20.863821 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:20.863788    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:20.864345 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:20.864325    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:21.100375 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:21.100331    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:21.677732 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:21.677690    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:21.885317 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:21.885286    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:22.052636 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.052542    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:22.202954 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.202916    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"]
Nov 04 02:40:22.230688 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.230644    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:22.725957 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.725925    5722 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" secret="" err="secret \"e2e-worker-w0-2ba6b8-openshift-default-dockercfg-n895s\" not found"
Nov 04 02:40:22.923958 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.923927    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"]
Nov 04 02:40:22.927696 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.927677    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:22.975177 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.975157    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"]
Nov 04 02:40:22.978379 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.978340    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:22.992380 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.992358    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:22.992461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.992391    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:22.992461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.992420    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:22.992554 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.992500    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:22.992554 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.992527    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:22.992554 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.992546    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srktt\" (UniqueName: \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-kube-api-access-srktt\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:22.992684 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.992651    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:22.992745 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.992732    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:22.992778 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:22.992754    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.032224 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.032203    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"]
Nov 04 02:40:23.084465 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.084441    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"]
Nov 04 02:40:23.093805 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.093777    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.093932 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.093837    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.093932 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.093900    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.094045 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094001    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptw8l\" (UniqueName: \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-kube-api-access-ptw8l\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.094098 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094049    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.094098 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094080    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.094200 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094131    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srktt\" (UniqueName: \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-kube-api-access-srktt\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.094200 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094163    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.094307 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094202    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.094307 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094245    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.094307 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094268    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.094307 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094295    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.094504 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094299    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.094504 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094383    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.094504 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094382    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.094701 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094540    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.094701 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094569    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.094701 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094593    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.094701 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094618    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.094701 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.094644    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.095034 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.095012    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.095167 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.095142    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.095505 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.095479    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.096376 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.096355    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.096760 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.096734    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.157292 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.157264    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.158571 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.158548    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srktt\" (UniqueName: \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-kube-api-access-srktt\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.196024 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.195997    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196033    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptw8l\" (UniqueName: \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-kube-api-access-ptw8l\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196080    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196115    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196171 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196155    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196384 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196179    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196384 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196230    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196384 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196277    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196384 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196303    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196581 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196401    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196581 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196556    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196789 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196764    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196866 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196795    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.196911 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.196883    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.198599 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.198578    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.198848 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.198829    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.240361 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.240308    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:23.262950 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.262928    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.263033 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.263006    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptw8l\" (UniqueName: \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-kube-api-access-ptw8l\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.290300 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.290276    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:23.350578 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.350544    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:23.656541 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:40:23.656514    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c4af96_36ee_41f4_bc48_9f1b87e9e068.slice/crio-4c419c62762fe08b76b345079a9f94c6f7782f1fdcf513e857f22504e322b91e WatchSource:0}: Error finding container 4c419c62762fe08b76b345079a9f94c6f7782f1fdcf513e857f22504e322b91e: Status 404 returned error can't find the container with id 4c419c62762fe08b76b345079a9f94c6f7782f1fdcf513e857f22504e322b91e
Nov 04 02:40:23.659139 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.659101    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:40:23.659224 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.659187    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:40:23.659259 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.659232    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:40:23.660214 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.660195    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"]
Nov 04 02:40:23.707514 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:40:23.707476    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5140eacd_ffa8_4e41_a77e_53dd70dd4c0e.slice/crio-183352c3cebafbe3f077cb88bd3284affae25bf9fc1945f9e0b739e99102eb5e WatchSource:0}: Error finding container 183352c3cebafbe3f077cb88bd3284affae25bf9fc1945f9e0b739e99102eb5e: Status 404 returned error can't find the container with id 183352c3cebafbe3f077cb88bd3284affae25bf9fc1945f9e0b739e99102eb5e
Nov 04 02:40:23.708611 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.708588    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"]
Nov 04 02:40:23.709821 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.709797    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:40:23.709887 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.709852    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:40:23.709887 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.709879    5722 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 02:40:23.732281 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.732250    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" event={"ID":"37c4af96-36ee-41f4-bc48-9f1b87e9e068","Type":"ContainerStarted","Data":"27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7"}
Nov 04 02:40:23.732398 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.732306    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" event={"ID":"37c4af96-36ee-41f4-bc48-9f1b87e9e068","Type":"ContainerStarted","Data":"4c419c62762fe08b76b345079a9f94c6f7782f1fdcf513e857f22504e322b91e"}
Nov 04 02:40:23.733722 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.733698    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" event={"ID":"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e","Type":"ContainerStarted","Data":"183352c3cebafbe3f077cb88bd3284affae25bf9fc1945f9e0b739e99102eb5e"}
Nov 04 02:40:23.733827 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.733759    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" podUID="1ecc4012-ebb1-4baf-a0f7-138793c76990" containerName="istio-proxy" containerID="cri-o://8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803" gracePeriod=30
Nov 04 02:40:23.858831 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:23.858767    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" podStartSLOduration=1.858749419 podStartE2EDuration="1.858749419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:40:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:40:23.856255193 +0000 UTC m=+1435.329792373" watchObservedRunningTime="2026-11-04 02:40:23.858749419 +0000 UTC m=+1435.332286601"
Nov 04 02:40:24.241212 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:24.241179    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:24.242978 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:24.242949    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:40:24.243109 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:24.242999    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 02:40:24.750979 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:24.744427    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" event={"ID":"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e","Type":"ContainerStarted","Data":"8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c"}
Nov 04 02:40:24.830671 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:24.830631    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:25.002738 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:25.002120    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:25.246674 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:25.244756    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:40:25.246674 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:25.244812    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 02:40:25.297931 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:25.297594    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:25.297931 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:25.297753    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:40:25.297931 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:25.297797    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" podUID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 02:40:26.219971 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:26.219933    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:26.241206 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:26.241148    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:40:26.241402 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:26.241218    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 02:40:26.291082 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:26.291044    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:40:26.291638 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:26.291607    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" podUID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 02:40:27.241280 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:27.241250    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:40:27.241563 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:27.241538    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 02:40:27.294068 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:27.294031    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:40:27.294630 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:27.294599    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" podUID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 02:40:28.241309 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:28.241277    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:40:28.241467 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:28.241327    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 02:40:28.291121 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:28.291086    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:40:28.291400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:28.291374    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" podUID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 02:40:28.611249 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:28.611114    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:29.241576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.240699    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:40:29.241576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.240757    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 02:40:29.245367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.245163    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:29.327683 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.318013    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:40:29.327683 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.318075    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" podUID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 02:40:29.429175 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.429152    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:29.429646 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.429377    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:29.520763 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.520624    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-credential-socket\") pod \"1ecc4012-ebb1-4baf-a0f7-138793c76990\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") "
Nov 04 02:40:29.520763 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.520680    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-socket\") pod \"1ecc4012-ebb1-4baf-a0f7-138793c76990\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") "
Nov 04 02:40:29.520763 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.520738    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-kube-api-access-n5wf8\" (UniqueName: \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-kube-api-access-n5wf8\") pod \"1ecc4012-ebb1-4baf-a0f7-138793c76990\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") "
Nov 04 02:40:29.520763 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.520765    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-data\") pod \"1ecc4012-ebb1-4baf-a0f7-138793c76990\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") "
Nov 04 02:40:29.521086 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.520810    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-token\" (UniqueName: \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-token\") pod \"1ecc4012-ebb1-4baf-a0f7-138793c76990\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") "
Nov 04 02:40:29.521086 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.520855    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-envoy\") pod \"1ecc4012-ebb1-4baf-a0f7-138793c76990\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") "
Nov 04 02:40:29.521086 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.520888    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-podinfo\") pod \"1ecc4012-ebb1-4baf-a0f7-138793c76990\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") "
Nov 04 02:40:29.521086 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.520948    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-credential-socket" pod "1ecc4012-ebb1-4baf-a0f7-138793c76990" (UID: "1ecc4012-ebb1-4baf-a0f7-138793c76990"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:29.521086 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.520986    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-socket" pod "1ecc4012-ebb1-4baf-a0f7-138793c76990" (UID: "1ecc4012-ebb1-4baf-a0f7-138793c76990"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:29.521086 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.521040    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ecc4012-ebb1-4baf-a0f7-138793c76990-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecc4012-ebb1-4baf-a0f7-138793c76990-istiod-ca-cert\") pod \"1ecc4012-ebb1-4baf-a0f7-138793c76990\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") "
Nov 04 02:40:29.521086 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.521080    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-certs\") pod \"1ecc4012-ebb1-4baf-a0f7-138793c76990\" (UID: \"1ecc4012-ebb1-4baf-a0f7-138793c76990\") "
Nov 04 02:40:29.521397 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.521131    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-data" pod "1ecc4012-ebb1-4baf-a0f7-138793c76990" (UID: "1ecc4012-ebb1-4baf-a0f7-138793c76990"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:29.521448 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.521381    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ecc4012-ebb1-4baf-a0f7-138793c76990-istiod-ca-cert" pod "1ecc4012-ebb1-4baf-a0f7-138793c76990" (UID: "1ecc4012-ebb1-4baf-a0f7-138793c76990"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:29.521500 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.521471    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.521500 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.521492    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ecc4012-ebb1-4baf-a0f7-138793c76990-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.521597 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.521507    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.521597 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.521522    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.521766 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.521746    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-certs" pod "1ecc4012-ebb1-4baf-a0f7-138793c76990" (UID: "1ecc4012-ebb1-4baf-a0f7-138793c76990"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:29.523484 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.523451    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-token" pod "1ecc4012-ebb1-4baf-a0f7-138793c76990" (UID: "1ecc4012-ebb1-4baf-a0f7-138793c76990"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:29.524022 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.523996    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-podinfo" pod "1ecc4012-ebb1-4baf-a0f7-138793c76990" (UID: "1ecc4012-ebb1-4baf-a0f7-138793c76990"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:40:29.524098 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.524015    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-envoy" pod "1ecc4012-ebb1-4baf-a0f7-138793c76990" (UID: "1ecc4012-ebb1-4baf-a0f7-138793c76990"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:29.524098 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.524002    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-kube-api-access-n5wf8" pod "1ecc4012-ebb1-4baf-a0f7-138793c76990" (UID: "1ecc4012-ebb1-4baf-a0f7-138793c76990"). InnerVolumeSpecName "kube-api-access-n5wf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:29.559497 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.559442    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" podStartSLOduration=7.559427373 podStartE2EDuration="7.559427373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:40:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:40:24.915039374 +0000 UTC m=+1436.388576556" watchObservedRunningTime="2026-11-04 02:40:29.559427373 +0000 UTC m=+1441.032964557"
Nov 04 02:40:29.622215 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.622184    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5wf8\" (UniqueName: \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-kube-api-access-n5wf8\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.622215 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.622213    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.622215 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.622223    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.622688 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.622231    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ecc4012-ebb1-4baf-a0f7-138793c76990-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.622688 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.622240    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ecc4012-ebb1-4baf-a0f7-138793c76990-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:29.832522 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.832434    5722 generic.go:356] "Generic (PLEG): container finished" podID="1ecc4012-ebb1-4baf-a0f7-138793c76990" containerID="8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803" exitCode=0
Nov 04 02:40:29.832522 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.832499    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"
Nov 04 02:40:29.832800 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.832536    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" event={"ID":"1ecc4012-ebb1-4baf-a0f7-138793c76990","Type":"ContainerDied","Data":"8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803"}
Nov 04 02:40:29.832800 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.832603    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4" event={"ID":"1ecc4012-ebb1-4baf-a0f7-138793c76990","Type":"ContainerDied","Data":"2a693bd967c44b7efa7ec78fe6f953ce88cc19fb015dcbd154d239f02ec29063"}
Nov 04 02:40:29.832800 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.832644    5722 scope.go:122] "RemoveContainer" containerID="8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803"
Nov 04 02:40:29.842441 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.842420    5722 scope.go:122] "RemoveContainer" containerID="8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803"
Nov 04 02:40:29.842844 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:40:29.842821    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803\": container with ID starting with 8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803 not found: ID does not exist" containerID="8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803"
Nov 04 02:40:29.842939 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:29.842849    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803"} err="failed to get container status \"8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803\": rpc error: code = NotFound desc = could not find container \"8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803\": container with ID starting with 8a534e2755382305e9e2b58b9d649000bc544bdeda6f75c40d47c9dcb060a803 not found: ID does not exist"
Nov 04 02:40:30.002094 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:30.002051    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"]
Nov 04 02:40:30.053321 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:30.053291    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-bspg4"]
Nov 04 02:40:30.240797 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:30.240762    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:40:30.240967 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:30.240828    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Nov 04 02:40:30.291241 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:30.291203    5722 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:40:30.291375 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:30.291265    5722 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" podUID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Nov 04 02:40:30.473191 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:30.473151    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:40:30.740678 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:30.722116    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ecc4012-ebb1-4baf-a0f7-138793c76990" path="/var/lib/kubelet/pods/1ecc4012-ebb1-4baf-a0f7-138793c76990/volumes"
Nov 04 02:40:30.743240 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:30.743179    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:30.946681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:30.940894    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:31.119280 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:31.119223    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:31.318096 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:31.318062    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:31.349223 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:31.349189    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:31.350006 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:31.349980    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:31.350845 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:31.350822    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:31.391727 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:31.390990    5722 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:31.391727 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:31.391607    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:31.392419 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:31.392392    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:31.624204 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:31.624167    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:33.582366 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:33.582331    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:33.765290 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:33.765257    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:34.187956 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:34.187922    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:34.376589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:34.376554    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:35.981082 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:35.981046    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:36.543898 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:36.543864    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"]
Nov 04 02:40:36.544139 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:36.544116    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" podUID="c3686444-55af-44b0-9a1d-277230d371a3" containerName="istio-proxy" containerID="cri-o://721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b" gracePeriod=30
Nov 04 02:40:36.560575 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:36.560543    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"]
Nov 04 02:40:36.560760 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:36.560741    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" podUID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" containerName="istio-proxy" containerID="cri-o://8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c" gracePeriod=30
Nov 04 02:40:36.568161 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:36.568123    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:36.569748 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:36.569725    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"]
Nov 04 02:40:36.569904 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:36.569887    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerName="istio-proxy" containerID="cri-o://27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7" gracePeriod=30
Nov 04 02:40:36.798418 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:36.798329    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:37.186415 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:37.186374    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:40.472838 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:40.472801    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:40:40.607622 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:40:40.607585    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:40:41.828221 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.828195    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:41.844054 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.844030    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:40:41.854360 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.854341    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:41.891603 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.891578    5722 generic.go:356] "Generic (PLEG): container finished" podID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerID="27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7" exitCode=0
Nov 04 02:40:41.891727 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.891625    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"
Nov 04 02:40:41.891727 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.891681    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" event={"ID":"37c4af96-36ee-41f4-bc48-9f1b87e9e068","Type":"ContainerDied","Data":"27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7"}
Nov 04 02:40:41.891727 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.891725    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf" event={"ID":"37c4af96-36ee-41f4-bc48-9f1b87e9e068","Type":"ContainerDied","Data":"4c419c62762fe08b76b345079a9f94c6f7782f1fdcf513e857f22504e322b91e"}
Nov 04 02:40:41.891854 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.891748    5722 scope.go:122] "RemoveContainer" containerID="27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7"
Nov 04 02:40:41.892955 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.892936    5722 generic.go:356] "Generic (PLEG): container finished" podID="c3686444-55af-44b0-9a1d-277230d371a3" containerID="721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b" exitCode=0
Nov 04 02:40:41.893044 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.892985    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"
Nov 04 02:40:41.893044 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.893021    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" event={"ID":"c3686444-55af-44b0-9a1d-277230d371a3","Type":"ContainerDied","Data":"721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b"}
Nov 04 02:40:41.893142 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.893063    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2" event={"ID":"c3686444-55af-44b0-9a1d-277230d371a3","Type":"ContainerDied","Data":"df20c3075fa49d1d753417a1ed3445dfe523474a14fc688299287d94cd64e0ee"}
Nov 04 02:40:41.894176 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.894157    5722 generic.go:356] "Generic (PLEG): container finished" podID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" containerID="8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c" exitCode=0
Nov 04 02:40:41.894270 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.894194    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" event={"ID":"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e","Type":"ContainerDied","Data":"8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c"}
Nov 04 02:40:41.894270 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.894206    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"
Nov 04 02:40:41.894270 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.894224    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl" event={"ID":"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e","Type":"ContainerDied","Data":"183352c3cebafbe3f077cb88bd3284affae25bf9fc1945f9e0b739e99102eb5e"}
Nov 04 02:40:41.900145 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.900129    5722 scope.go:122] "RemoveContainer" containerID="27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7"
Nov 04 02:40:41.900417 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:40:41.900400    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7\": container with ID starting with 27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7 not found: ID does not exist" containerID="27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7"
Nov 04 02:40:41.900465 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.900425    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7"} err="failed to get container status \"27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7\": rpc error: code = NotFound desc = could not find container \"27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7\": container with ID starting with 27ca30351aeec5e29a7c9a51ad90025c51494c4f0c9ed4bf5c506c67c62639c7 not found: ID does not exist"
Nov 04 02:40:41.900465 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.900439    5722 scope.go:122] "RemoveContainer" containerID="721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b"
Nov 04 02:40:41.908037 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.908023    5722 scope.go:122] "RemoveContainer" containerID="721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b"
Nov 04 02:40:41.908305 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:40:41.908287    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b\": container with ID starting with 721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b not found: ID does not exist" containerID="721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b"
Nov 04 02:40:41.908360 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.908313    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b"} err="failed to get container status \"721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b\": rpc error: code = NotFound desc = could not find container \"721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b\": container with ID starting with 721c4c3ff2a8af1298653aeee3b11aebd7f81beaf5301f1c14cc121808f03d0b not found: ID does not exist"
Nov 04 02:40:41.908360 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.908339    5722 scope.go:122] "RemoveContainer" containerID="8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c"
Nov 04 02:40:41.915623 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.915596    5722 scope.go:122] "RemoveContainer" containerID="8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c"
Nov 04 02:40:41.915892 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:40:41.915873    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c\": container with ID starting with 8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c not found: ID does not exist" containerID="8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c"
Nov 04 02:40:41.915935 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.915897    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c"} err="failed to get container status \"8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c\": rpc error: code = NotFound desc = could not find container \"8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c\": container with ID starting with 8b776fcdbcd50924a8fb510aa81341123c2aebd7c152bf738a182176a403988c not found: ID does not exist"
Nov 04 02:40:41.969075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969051    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-data\") pod \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") "
Nov 04 02:40:41.969183 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969082    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-credential-socket\") pod \"c3686444-55af-44b0-9a1d-277230d371a3\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") "
Nov 04 02:40:41.969183 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969115    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istiod-ca-cert\") pod \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") "
Nov 04 02:40:41.969183 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969171    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c3686444-55af-44b0-9a1d-277230d371a3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3686444-55af-44b0-9a1d-277230d371a3-istio-podinfo\") pod \"c3686444-55af-44b0-9a1d-277230d371a3\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") "
Nov 04 02:40:41.969335 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969204    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-data\") pod \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") "
Nov 04 02:40:41.969335 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969229    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-certs\") pod \"c3686444-55af-44b0-9a1d-277230d371a3\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") "
Nov 04 02:40:41.969335 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969258    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-envoy\") pod \"c3686444-55af-44b0-9a1d-277230d371a3\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") "
Nov 04 02:40:41.969335 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969284    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istiod-ca-cert\") pod \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") "
Nov 04 02:40:41.969335 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969324    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-token\" (UniqueName: \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-token\") pod \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") "
Nov 04 02:40:41.969576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969345    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-data" pod "37c4af96-36ee-41f4-bc48-9f1b87e9e068" (UID: "37c4af96-36ee-41f4-bc48-9f1b87e9e068"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.969576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969354    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-credential-socket" pod "c3686444-55af-44b0-9a1d-277230d371a3" (UID: "c3686444-55af-44b0-9a1d-277230d371a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.969576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969367    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-certs\") pod \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") "
Nov 04 02:40:41.969576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969403    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-kube-api-access-ptw8l\" (UniqueName: \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-kube-api-access-ptw8l\") pod \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") "
Nov 04 02:40:41.969576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969460    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-istio-token\" (UniqueName: \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-istio-token\") pod \"c3686444-55af-44b0-9a1d-277230d371a3\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") "
Nov 04 02:40:41.969576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969470    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istiod-ca-cert" pod "37c4af96-36ee-41f4-bc48-9f1b87e9e068" (UID: "37c4af96-36ee-41f4-bc48-9f1b87e9e068"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:41.969576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969495    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-podinfo\") pod \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") "
Nov 04 02:40:41.969576 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969556    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-credential-socket\") pod \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") "
Nov 04 02:40:41.969970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969606    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-kube-api-access-srktt\" (UniqueName: \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-kube-api-access-srktt\") pod \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") "
Nov 04 02:40:41.969970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969641    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-podinfo\") pod \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") "
Nov 04 02:40:41.969970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969643    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-data" pod "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" (UID: "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.969970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969698    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-socket\") pod \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") "
Nov 04 02:40:41.969970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969713    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-certs" pod "37c4af96-36ee-41f4-bc48-9f1b87e9e068" (UID: "37c4af96-36ee-41f4-bc48-9f1b87e9e068"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.969970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969740    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-certs" pod "c3686444-55af-44b0-9a1d-277230d371a3" (UID: "c3686444-55af-44b0-9a1d-277230d371a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.969970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969799    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-envoy\") pod \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") "
Nov 04 02:40:41.969970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969837    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-certs\") pod \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") "
Nov 04 02:40:41.969970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969895    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-envoy\") pod \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") "
Nov 04 02:40:41.969970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969925    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-socket" pod "37c4af96-36ee-41f4-bc48-9f1b87e9e068" (UID: "37c4af96-36ee-41f4-bc48-9f1b87e9e068"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.969970 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.969931    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-data\") pod \"c3686444-55af-44b0-9a1d-277230d371a3\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") "
Nov 04 02:40:41.970839 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.970020    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-token\" (UniqueName: \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-token\") pod \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\" (UID: \"37c4af96-36ee-41f4-bc48-9f1b87e9e068\") "
Nov 04 02:40:41.970839 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.970091    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-socket\") pod \"c3686444-55af-44b0-9a1d-277230d371a3\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") "
Nov 04 02:40:41.970839 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.970097    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-data" pod "c3686444-55af-44b0-9a1d-277230d371a3" (UID: "c3686444-55af-44b0-9a1d-277230d371a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.970839 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.970126    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-credential-socket\") pod \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") "
Nov 04 02:40:41.970839 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.970194    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c3686444-55af-44b0-9a1d-277230d371a3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3686444-55af-44b0-9a1d-277230d371a3-istiod-ca-cert\") pod \"c3686444-55af-44b0-9a1d-277230d371a3\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") "
Nov 04 02:40:41.970839 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.970285    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-kube-api-access-s8547\" (UniqueName: \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-kube-api-access-s8547\") pod \"c3686444-55af-44b0-9a1d-277230d371a3\" (UID: \"c3686444-55af-44b0-9a1d-277230d371a3\") "
Nov 04 02:40:41.970839 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.970340    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-socket\") pod \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\" (UID: \"5140eacd-ffa8-4e41-a77e-53dd70dd4c0e\") "
Nov 04 02:40:41.971164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.970940    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.971164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.970961    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.971164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.970975    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.971164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.971004    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.971164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.971022    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.971164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.971035    5722 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-data\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.971164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.971049    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.971164 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.971063    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.971599 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.971280    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-socket" pod "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" (UID: "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.971599 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.971448    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-credential-socket" pod "37c4af96-36ee-41f4-bc48-9f1b87e9e068" (UID: "37c4af96-36ee-41f4-bc48-9f1b87e9e068"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.972241 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.971893    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istiod-ca-cert" pod "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" (UID: "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:41.973299 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.972268    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-certs" pod "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" (UID: "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.973299 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.972555    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-credential-socket" pod "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" (UID: "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.973299 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.972766    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-socket" pod "c3686444-55af-44b0-9a1d-277230d371a3" (UID: "c3686444-55af-44b0-9a1d-277230d371a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.973299 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.972854    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-token" pod "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" (UID: "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.973299 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.973190    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3686444-55af-44b0-9a1d-277230d371a3-istiod-ca-cert" pod "c3686444-55af-44b0-9a1d-277230d371a3" (UID: "c3686444-55af-44b0-9a1d-277230d371a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:41.973706 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.973683    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-podinfo" pod "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" (UID: "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:40:41.974063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.974038    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-istio-token" pod "c3686444-55af-44b0-9a1d-277230d371a3" (UID: "c3686444-55af-44b0-9a1d-277230d371a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.974063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.974058    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3686444-55af-44b0-9a1d-277230d371a3-istio-podinfo" pod "c3686444-55af-44b0-9a1d-277230d371a3" (UID: "c3686444-55af-44b0-9a1d-277230d371a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:40:41.974341 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.974293    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-envoy" pod "37c4af96-36ee-41f4-bc48-9f1b87e9e068" (UID: "37c4af96-36ee-41f4-bc48-9f1b87e9e068"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.974341 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.974347    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-podinfo" pod "37c4af96-36ee-41f4-bc48-9f1b87e9e068" (UID: "37c4af96-36ee-41f4-bc48-9f1b87e9e068"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:40:41.974482 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.974395    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-envoy" pod "c3686444-55af-44b0-9a1d-277230d371a3" (UID: "c3686444-55af-44b0-9a1d-277230d371a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.974482 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.974413    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-kube-api-access-ptw8l" pod "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" (UID: "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e"). InnerVolumeSpecName "kube-api-access-ptw8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.975274 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.975250    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-kube-api-access-srktt" pod "37c4af96-36ee-41f4-bc48-9f1b87e9e068" (UID: "37c4af96-36ee-41f4-bc48-9f1b87e9e068"). InnerVolumeSpecName "kube-api-access-srktt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.975507 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.975491    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-token" pod "37c4af96-36ee-41f4-bc48-9f1b87e9e068" (UID: "37c4af96-36ee-41f4-bc48-9f1b87e9e068"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.976035 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.976002    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-envoy" pod "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" (UID: "5140eacd-ffa8-4e41-a77e-53dd70dd4c0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.976256 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:41.976240    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-kube-api-access-s8547" pod "c3686444-55af-44b0-9a1d-277230d371a3" (UID: "c3686444-55af-44b0-9a1d-277230d371a3"). InnerVolumeSpecName "kube-api-access-s8547". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:42.071990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.071917    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3686444-55af-44b0-9a1d-277230d371a3-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.071990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.071942    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.071990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.071952    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.071990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.071960    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.071990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.071968    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptw8l\" (UniqueName: \"kubernetes.io/projected/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-kube-api-access-ptw8l\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.071990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.071977    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.071990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.071988    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.071990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.071996    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.072487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.072004    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srktt\" (UniqueName: \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-kube-api-access-srktt\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.072487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.072012    5722 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-podinfo\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.072487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.072021    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.072487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.072029    5722 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.072487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.072037    5722 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-istio-envoy\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.072487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.072045    5722 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37c4af96-36ee-41f4-bc48-9f1b87e9e068-istio-token\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.072487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.072054    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3686444-55af-44b0-9a1d-277230d371a3-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.072487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.072062    5722 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-credential-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.072487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.072070    5722 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3686444-55af-44b0-9a1d-277230d371a3-istiod-ca-cert\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.072487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.072078    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8547\" (UniqueName: \"kubernetes.io/projected/c3686444-55af-44b0-9a1d-277230d371a3-kube-api-access-s8547\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.072487 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.072086    5722 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e-workload-socket\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.386751 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.386725    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:42.425619 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.425573    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"]
Nov 04 02:40:42.427121 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.427090    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-q5zd2"]
Nov 04 02:40:42.538961 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.538932    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"]
Nov 04 02:40:42.543556 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.543536    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-tlqnl"]
Nov 04 02:40:42.655042 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.654986    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"]
Nov 04 02:40:42.658854 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.658834    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-jgbwf"]
Nov 04 02:40:42.687359 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.687333    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" path="/var/lib/kubelet/pods/37c4af96-36ee-41f4-bc48-9f1b87e9e068/volumes"
Nov 04 02:40:42.687768 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.687753    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" path="/var/lib/kubelet/pods/5140eacd-ffa8-4e41-a77e-53dd70dd4c0e/volumes"
Nov 04 02:40:42.688143 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:42.688130    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c3686444-55af-44b0-9a1d-277230d371a3" path="/var/lib/kubelet/pods/c3686444-55af-44b0-9a1d-277230d371a3/volumes"
Nov 04 02:40:47.783169 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:47.783137    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:50.472353 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:50.472307    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:40:53.181819 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:53.181790    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:58.489229 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:58.489194    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:40:58.670337 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:40:58.670301    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:00.472714 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:00.472678    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:41:01.289314 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:01.289284    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:01.459887 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:01.459852    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:03.970734 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:03.970677    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:09.571024 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:09.570987    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:10.472682 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:10.472624    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:41:10.608142 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:41:10.608095    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:41:10.675028 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:10.674992    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:41:14.983296 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:14.983245    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:20.395492 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:20.395456    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:20.675129 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:20.675041    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:41:25.777553 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:25.777515    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:28.829299 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:28.829272    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:41:28.834267 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:28.834246    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:41:28.954001 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:28.953980    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:41:28.958226 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:28.958209    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:41:30.675355 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:30.675312    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:41:31.184095 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:31.184065    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:36.604526 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:36.604460    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:40.607638 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:41:40.607605    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:41:40.675029 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:40.674992    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:41:42.086472 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:42.086438    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:47.550319 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:47.550287    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:50.674949 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:50.674911    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:41:52.884157 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:52.884129    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:58.284409 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:58.284376    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:41:58.879890 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:41:58.879859    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:00.675616 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:00.675573    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:42:03.777531 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:03.777493    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:09.180050 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:09.179960    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:10.608010 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:42:10.607974    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:42:10.675747 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:10.675713    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:42:14.602760 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:14.602556    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:20.008990 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:20.008955    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:20.675201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:20.675172    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:42:25.496386 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:25.496306    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:30.675022 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:30.674983    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:42:30.879291 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:30.879227    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:32.675049 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:32.675011    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:42:36.287237 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:36.287195    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:40.608114 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:42:40.608076    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:42:41.145813 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:41.145775    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:41.346211 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:41.346169    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:41.811073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:41.811040    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:42.675115 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:42.675079    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:42:47.291315 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:47.291281    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:52.675945 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:52.675902    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:42:52.689381 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:52.689345    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:58.094094 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:58.094062    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:59.256562 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:59.256528    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:42:59.442928 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:42:59.442896    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:02.675539 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:02.675487    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:43:03.499527 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:03.499498    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:04.840392 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:04.840357    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:08.987345 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:08.987314    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:10.607913 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:43:10.607878    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:43:12.675588 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:12.675554    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:43:14.394743 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:14.394713    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:19.790489 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:19.790452    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:22.675798 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:22.675747    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:43:25.197153 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:25.197117    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:30.685694 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:30.685641    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:31.948637 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:31.948604    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:32.123410 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:32.123376    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:32.676201 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:32.676165    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:43:36.082809 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:36.082779    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:40.608436 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:43:40.608331    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:43:41.483214 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:41.483178    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:42.675183 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:42.675141    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:43:46.674693 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:46.674640    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:43:46.898755 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:46.898725    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:52.417297 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:52.417238    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:56.674700 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:56.674644    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:43:57.793927 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:57.793891    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:43:59.621132 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:43:59.621100    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:03.346288 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:03.346217    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:06.675120 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:06.675085    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:44:08.760926 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:08.760886    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:10.608602 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:44:10.608567    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:44:14.183546 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:14.183514    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:15.030872 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:15.030836    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:15.213841 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:15.213806    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:16.674490 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:16.674455    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:44:19.603682 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:19.603575    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:24.978075 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:24.978040    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:26.674570 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:26.674537    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:44:30.383054 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:30.383015    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:35.887079 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:35.887045    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:36.059316 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:36.059285    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"]
Nov 04 02:44:36.110077 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:36.110045    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d1b146bb-xlv2l"]
Nov 04 02:44:36.675132 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:36.675091    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:44:36.678857 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:36.678825    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f126c75d-c6a7-409d-a0c6-8fbec4561aa0" path="/var/lib/kubelet/pods/f126c75d-c6a7-409d-a0c6-8fbec4561aa0/volumes"
Nov 04 02:44:40.608782 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:44:40.608737    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:44:41.281515 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:41.281475    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:46.670158 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:46.670128    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:46.674444 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:46.674414    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:44:47.674756 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:47.674715    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:44:52.068581 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:52.068531    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:57.577846 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:57.577809    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:57.675117 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:57.675087    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:44:58.252366 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:58.252309    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:58.422415 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:58.422371    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:58.570142 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:58.570066    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"]
Nov 04 02:44:58.571420 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:58.571380    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:44:58.751176 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:58.751136    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:44:59.972505 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:44:59.972472    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:00.165386 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165354    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"]
Nov 04 02:45:00.165801 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165787    5722 cpu_manager.go:414] "containerMap: removing container" podUID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" containerName="istio-proxy"
Nov 04 02:45:00.165801 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165802    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" containerName="istio-proxy"
Nov 04 02:45:00.165894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165813    5722 cpu_manager.go:414] "containerMap: removing container" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerName="istio-proxy"
Nov 04 02:45:00.165894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165818    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerName="istio-proxy"
Nov 04 02:45:00.165894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165832    5722 cpu_manager.go:414] "containerMap: removing container" podUID="c3686444-55af-44b0-9a1d-277230d371a3" containerName="istio-proxy"
Nov 04 02:45:00.165894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165837    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3686444-55af-44b0-9a1d-277230d371a3" containerName="istio-proxy"
Nov 04 02:45:00.165894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165844    5722 cpu_manager.go:414] "containerMap: removing container" podUID="1ecc4012-ebb1-4baf-a0f7-138793c76990" containerName="istio-proxy"
Nov 04 02:45:00.165894 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165848    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ecc4012-ebb1-4baf-a0f7-138793c76990" containerName="istio-proxy"
Nov 04 02:45:00.166073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165902    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="5140eacd-ffa8-4e41-a77e-53dd70dd4c0e" containerName="istio-proxy"
Nov 04 02:45:00.166073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165910    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="37c4af96-36ee-41f4-bc48-9f1b87e9e068" containerName="istio-proxy"
Nov 04 02:45:00.166073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165917    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="c3686444-55af-44b0-9a1d-277230d371a3" containerName="istio-proxy"
Nov 04 02:45:00.166073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.165922    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ecc4012-ebb1-4baf-a0f7-138793c76990" containerName="istio-proxy"
Nov 04 02:45:00.168519 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.168501    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"
Nov 04 02:45:00.199779 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.199751    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr86v\" (UniqueName: \"kubernetes.io/projected/6f7c1c83-43e8-4b01-a210-63807a91a48b-kube-api-access-hr86v\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc\" (UID: \"6f7c1c83-43e8-4b01-a210-63807a91a48b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"
Nov 04 02:45:00.199919 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.199810    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7c1c83-43e8-4b01-a210-63807a91a48b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc\" (UID: \"6f7c1c83-43e8-4b01-a210-63807a91a48b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"
Nov 04 02:45:00.222014 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.221990    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:45:00.275244 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.275145    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"]
Nov 04 02:45:00.301443 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.301401    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7c1c83-43e8-4b01-a210-63807a91a48b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc\" (UID: \"6f7c1c83-43e8-4b01-a210-63807a91a48b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"
Nov 04 02:45:00.301623 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.301489    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr86v\" (UniqueName: \"kubernetes.io/projected/6f7c1c83-43e8-4b01-a210-63807a91a48b-kube-api-access-hr86v\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc\" (UID: \"6f7c1c83-43e8-4b01-a210-63807a91a48b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"
Nov 04 02:45:00.302067 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.302046    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7c1c83-43e8-4b01-a210-63807a91a48b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc\" (UID: \"6f7c1c83-43e8-4b01-a210-63807a91a48b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"
Nov 04 02:45:00.364116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.364086    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr86v\" (UniqueName: \"kubernetes.io/projected/6f7c1c83-43e8-4b01-a210-63807a91a48b-kube-api-access-hr86v\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc\" (UID: \"6f7c1c83-43e8-4b01-a210-63807a91a48b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"
Nov 04 02:45:00.480550 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.480450    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"
Nov 04 02:45:00.639064 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.639031    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:00.845394 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:45:00.845363    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7c1c83_43e8_4b01_a210_63807a91a48b.slice/crio-98e79a3e16259868115472634f3be7baec757e9d16e2c43d0e1b7750434bae0b WatchSource:0}: Error finding container 98e79a3e16259868115472634f3be7baec757e9d16e2c43d0e1b7750434bae0b: Status 404 returned error can't find the container with id 98e79a3e16259868115472634f3be7baec757e9d16e2c43d0e1b7750434bae0b
Nov 04 02:45:00.847977 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:00.847868    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"]
Nov 04 02:45:01.084481 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:01.084448    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc" event={"ID":"6f7c1c83-43e8-4b01-a210-63807a91a48b","Type":"ContainerStarted","Data":"98e79a3e16259868115472634f3be7baec757e9d16e2c43d0e1b7750434bae0b"}
Nov 04 02:45:02.091671 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:02.091567    5722 generic.go:356] "Generic (PLEG): container finished" podID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerID="47843cb94e97ba01c5bc56793f333f468f64c3a029dd56fb7321b3eb0f252ef6" exitCode=60
Nov 04 02:45:02.091671 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:02.091627    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc" event={"ID":"6f7c1c83-43e8-4b01-a210-63807a91a48b","Type":"ContainerDied","Data":"47843cb94e97ba01c5bc56793f333f468f64c3a029dd56fb7321b3eb0f252ef6"}
Nov 04 02:45:02.092098 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:02.091929    5722 scope.go:122] "RemoveContainer" containerID="47843cb94e97ba01c5bc56793f333f468f64c3a029dd56fb7321b3eb0f252ef6"
Nov 04 02:45:02.986110 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:02.986067    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:03.098942 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.098908    5722 generic.go:356] "Generic (PLEG): container finished" podID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerID="5d982b18b06ee7aa7194d21aec4c23140b70b342a27a1e21ca679a7b00f0b8cc" exitCode=60
Nov 04 02:45:03.099371 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.098996    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc" event={"ID":"6f7c1c83-43e8-4b01-a210-63807a91a48b","Type":"ContainerDied","Data":"5d982b18b06ee7aa7194d21aec4c23140b70b342a27a1e21ca679a7b00f0b8cc"}
Nov 04 02:45:03.099371 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.099063    5722 scope.go:122] "RemoveContainer" containerID="47843cb94e97ba01c5bc56793f333f468f64c3a029dd56fb7321b3eb0f252ef6"
Nov 04 02:45:03.099371 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.099273    5722 scope.go:122] "RemoveContainer" containerID="5d982b18b06ee7aa7194d21aec4c23140b70b342a27a1e21ca679a7b00f0b8cc"
Nov 04 02:45:03.099537 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:45:03.099520    5722 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc_odh-ai-gateway-infra(6f7c1c83-43e8-4b01-a210-63807a91a48b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b"
Nov 04 02:45:03.571100 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.571054    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing" containerID="cri-o://f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068" gracePeriod=25
Nov 04 02:45:03.809186 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.809162    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:45:03.836224 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.836153    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-kube-api-access-s9rw9\" (UniqueName: \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-kube-api-access-s9rw9\") pod \"781e5a65-33be-432b-9445-f5ce66d9274f\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") "
Nov 04 02:45:03.836367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.836234    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-plugins-config-volume\") pod \"781e5a65-33be-432b-9445-f5ce66d9274f\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") "
Nov 04 02:45:03.836367 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.836280    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-provider-credentials\" (UniqueName: \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-provider-credentials\") pod \"781e5a65-33be-432b-9445-f5ce66d9274f\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") "
Nov 04 02:45:03.836483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.836393    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-routing-overlay-volume\") pod \"781e5a65-33be-432b-9445-f5ce66d9274f\" (UID: \"781e5a65-33be-432b-9445-f5ce66d9274f\") "
Nov 04 02:45:03.836742 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.836706    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-plugins-config-volume" pod "781e5a65-33be-432b-9445-f5ce66d9274f" (UID: "781e5a65-33be-432b-9445-f5ce66d9274f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:03.836867 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.836759    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-routing-overlay-volume" pod "781e5a65-33be-432b-9445-f5ce66d9274f" (UID: "781e5a65-33be-432b-9445-f5ce66d9274f"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:03.838581 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.838554    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-provider-credentials" pod "781e5a65-33be-432b-9445-f5ce66d9274f" (UID: "781e5a65-33be-432b-9445-f5ce66d9274f"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:03.838693 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.838619    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-kube-api-access-s9rw9" pod "781e5a65-33be-432b-9445-f5ce66d9274f" (UID: "781e5a65-33be-432b-9445-f5ce66d9274f"). InnerVolumeSpecName "kube-api-access-s9rw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:03.937273 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.937244    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9rw9\" (UniqueName: \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-kube-api-access-s9rw9\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:03.937273 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.937271    5722 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-plugins-config-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:03.937273 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.937280    5722 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/781e5a65-33be-432b-9445-f5ce66d9274f-provider-credentials\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:03.937482 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:03.937289    5722 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/781e5a65-33be-432b-9445-f5ce66d9274f-routing-overlay-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:04.105573 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:04.105482    5722 generic.go:356] "Generic (PLEG): container finished" podID="781e5a65-33be-432b-9445-f5ce66d9274f" containerID="f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068" exitCode=0
Nov 04 02:45:04.105573 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:04.105533    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"
Nov 04 02:45:04.106137 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:04.105568    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" event={"ID":"781e5a65-33be-432b-9445-f5ce66d9274f","Type":"ContainerDied","Data":"f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068"}
Nov 04 02:45:04.106137 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:04.105625    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2" event={"ID":"781e5a65-33be-432b-9445-f5ce66d9274f","Type":"ContainerDied","Data":"841d2e0a977815177ae3a2ea774d0b1f4f804dd07966e86edec15e56de89522e"}
Nov 04 02:45:04.106137 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:04.105706    5722 scope.go:122] "RemoveContainer" containerID="f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068"
Nov 04 02:45:04.108246 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:04.108227    5722 scope.go:122] "RemoveContainer" containerID="5d982b18b06ee7aa7194d21aec4c23140b70b342a27a1e21ca679a7b00f0b8cc"
Nov 04 02:45:04.108505 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:45:04.108485    5722 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc_odh-ai-gateway-infra(6f7c1c83-43e8-4b01-a210-63807a91a48b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b"
Nov 04 02:45:04.115823 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:04.115798    5722 scope.go:122] "RemoveContainer" containerID="f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068"
Nov 04 02:45:04.116179 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:45:04.116159    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068\": container with ID starting with f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068 not found: ID does not exist" containerID="f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068"
Nov 04 02:45:04.116264 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:04.116188    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068"} err="failed to get container status \"f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068\": rpc error: code = NotFound desc = could not find container \"f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068\": container with ID starting with f9ef260e68356cc1392c02d4be0e60d824d658892c1b9c3394a1d5ad9bba3068 not found: ID does not exist"
Nov 04 02:45:04.277193 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:04.277148    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"]
Nov 04 02:45:04.283825 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:04.283798    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-b6fbcb49-hvml2"]
Nov 04 02:45:04.684605 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:04.684574    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" path="/var/lib/kubelet/pods/781e5a65-33be-432b-9445-f5ce66d9274f/volumes"
Nov 04 02:45:07.004589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:07.004557    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:07.820278 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:07.820242    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:07.999172 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:07.999143    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:08.735100 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:08.735066    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:10.608148 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:45:10.608110    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:45:12.886126 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:12.886087    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:14.289981 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:14.289950    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:14.673454 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:14.673425    5722 scope.go:122] "RemoveContainer" containerID="5d982b18b06ee7aa7194d21aec4c23140b70b342a27a1e21ca679a7b00f0b8cc"
Nov 04 02:45:15.166527 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:15.166492    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc" event={"ID":"6f7c1c83-43e8-4b01-a210-63807a91a48b","Type":"ContainerStarted","Data":"57f01681c48f4ddedc84657f20d817087b45508eede93a5122aeb07b6c30533e"}
Nov 04 02:45:15.284721 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:15.284582    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc" podStartSLOduration=15.284569113 podStartE2EDuration="15.284569113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:45:15.28439036 +0000 UTC m=+1726.757927542" watchObservedRunningTime="2026-11-04 02:45:15.284569113 +0000 UTC m=+1726.758106288"
Nov 04 02:45:16.172919 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:16.172886    5722 generic.go:356] "Generic (PLEG): container finished" podID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerID="57f01681c48f4ddedc84657f20d817087b45508eede93a5122aeb07b6c30533e" exitCode=60
Nov 04 02:45:16.173336 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:16.172958    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc" event={"ID":"6f7c1c83-43e8-4b01-a210-63807a91a48b","Type":"ContainerDied","Data":"57f01681c48f4ddedc84657f20d817087b45508eede93a5122aeb07b6c30533e"}
Nov 04 02:45:16.173336 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:16.173021    5722 scope.go:122] "RemoveContainer" containerID="5d982b18b06ee7aa7194d21aec4c23140b70b342a27a1e21ca679a7b00f0b8cc"
Nov 04 02:45:16.173336 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:16.173320    5722 scope.go:122] "RemoveContainer" containerID="57f01681c48f4ddedc84657f20d817087b45508eede93a5122aeb07b6c30533e"
Nov 04 02:45:16.173602 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:45:16.173579    5722 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc_odh-ai-gateway-infra(6f7c1c83-43e8-4b01-a210-63807a91a48b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b"
Nov 04 02:45:16.301611 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:16.301574    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"]
Nov 04 02:45:17.317400 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:17.317376    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"
Nov 04 02:45:17.365457 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:17.365427    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f7c1c83-43e8-4b01-a210-63807a91a48b-kube-api-access-hr86v\" (UniqueName: \"kubernetes.io/projected/6f7c1c83-43e8-4b01-a210-63807a91a48b-kube-api-access-hr86v\") pod \"6f7c1c83-43e8-4b01-a210-63807a91a48b\" (UID: \"6f7c1c83-43e8-4b01-a210-63807a91a48b\") "
Nov 04 02:45:17.365593 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:17.365513    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f7c1c83-43e8-4b01-a210-63807a91a48b-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7c1c83-43e8-4b01-a210-63807a91a48b-maas-api-service-ca\") pod \"6f7c1c83-43e8-4b01-a210-63807a91a48b\" (UID: \"6f7c1c83-43e8-4b01-a210-63807a91a48b\") "
Nov 04 02:45:17.365850 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:17.365830    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f7c1c83-43e8-4b01-a210-63807a91a48b-maas-api-service-ca" pod "6f7c1c83-43e8-4b01-a210-63807a91a48b" (UID: "6f7c1c83-43e8-4b01-a210-63807a91a48b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:17.367595 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:17.367569    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f7c1c83-43e8-4b01-a210-63807a91a48b-kube-api-access-hr86v" pod "6f7c1c83-43e8-4b01-a210-63807a91a48b" (UID: "6f7c1c83-43e8-4b01-a210-63807a91a48b"). InnerVolumeSpecName "kube-api-access-hr86v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:17.466480 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:17.466393    5722 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7c1c83-43e8-4b01-a210-63807a91a48b-maas-api-service-ca\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:17.466480 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:17.466426    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr86v\" (UniqueName: \"kubernetes.io/projected/6f7c1c83-43e8-4b01-a210-63807a91a48b-kube-api-access-hr86v\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:18.184798 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:18.184770    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"
Nov 04 02:45:18.184968 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:18.184808    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc" event={"ID":"6f7c1c83-43e8-4b01-a210-63807a91a48b","Type":"ContainerDied","Data":"98e79a3e16259868115472634f3be7baec757e9d16e2c43d0e1b7750434bae0b"}
Nov 04 02:45:18.184968 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:18.184873    5722 scope.go:122] "RemoveContainer" containerID="57f01681c48f4ddedc84657f20d817087b45508eede93a5122aeb07b6c30533e"
Nov 04 02:45:18.354497 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:18.354465    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"]
Nov 04 02:45:18.359149 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:18.359127    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29896005-qkdmc"]
Nov 04 02:45:18.678666 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:18.678621    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b" path="/var/lib/kubelet/pods/6f7c1c83-43e8-4b01-a210-63807a91a48b/volumes"
Nov 04 02:45:19.093344 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:19.093258    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:21.080523 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:21.080489    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:26.478262 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:26.478227    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:27.885589 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:27.885551    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:28.075073 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:28.075044    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:29.751199 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:29.751107    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:30.459909 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:30.459871    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:31.300165 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:31.300129    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:32.353924 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:32.353893    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:37.148399 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.148369    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"]
Nov 04 02:45:37.148795 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.148566    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb" podUID="fb2c99a7-e075-492e-972d-06dee97464b2" containerName="maas-api" containerID="cri-o://2a52eec0e90c7554b862156b77cabdba6756197140c46fb95df725d60972f284" gracePeriod=30
Nov 04 02:45:37.277820 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.277766    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:37.293230 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.293201    5722 generic.go:356] "Generic (PLEG): container finished" podID="fb2c99a7-e075-492e-972d-06dee97464b2" containerID="2a52eec0e90c7554b862156b77cabdba6756197140c46fb95df725d60972f284" exitCode=0
Nov 04 02:45:37.293335 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.293267    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb" event={"ID":"fb2c99a7-e075-492e-972d-06dee97464b2","Type":"ContainerDied","Data":"2a52eec0e90c7554b862156b77cabdba6756197140c46fb95df725d60972f284"}
Nov 04 02:45:37.414681 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.414644    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:45:37.559218 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.559193    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-maas-api-tls\") pod \"fb2c99a7-e075-492e-972d-06dee97464b2\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") "
Nov 04 02:45:37.559403 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.559282    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fb2c99a7-e075-492e-972d-06dee97464b2-kube-api-access-hfs46\" (UniqueName: \"kubernetes.io/projected/fb2c99a7-e075-492e-972d-06dee97464b2-kube-api-access-hfs46\") pod \"fb2c99a7-e075-492e-972d-06dee97464b2\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") "
Nov 04 02:45:37.559473 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.559413    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fb2c99a7-e075-492e-972d-06dee97464b2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2c99a7-e075-492e-972d-06dee97464b2-openshift-service-ca\") pod \"fb2c99a7-e075-492e-972d-06dee97464b2\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") "
Nov 04 02:45:37.559473 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.559460    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-metrics-certs\") pod \"fb2c99a7-e075-492e-972d-06dee97464b2\" (UID: \"fb2c99a7-e075-492e-972d-06dee97464b2\") "
Nov 04 02:45:37.559767 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.559740    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb2c99a7-e075-492e-972d-06dee97464b2-openshift-service-ca" pod "fb2c99a7-e075-492e-972d-06dee97464b2" (UID: "fb2c99a7-e075-492e-972d-06dee97464b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:37.561707 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.561678    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-maas-api-tls" pod "fb2c99a7-e075-492e-972d-06dee97464b2" (UID: "fb2c99a7-e075-492e-972d-06dee97464b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:45:37.561814 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.561721    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-metrics-certs" pod "fb2c99a7-e075-492e-972d-06dee97464b2" (UID: "fb2c99a7-e075-492e-972d-06dee97464b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:45:37.561814 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.561794    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb2c99a7-e075-492e-972d-06dee97464b2-kube-api-access-hfs46" pod "fb2c99a7-e075-492e-972d-06dee97464b2" (UID: "fb2c99a7-e075-492e-972d-06dee97464b2"). InnerVolumeSpecName "kube-api-access-hfs46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:37.562904 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.562878    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:37.660535 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.660485    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfs46\" (UniqueName: \"kubernetes.io/projected/fb2c99a7-e075-492e-972d-06dee97464b2-kube-api-access-hfs46\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:37.660535 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.660508    5722 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2c99a7-e075-492e-972d-06dee97464b2-openshift-service-ca\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:37.660535 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.660517    5722 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-metrics-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:37.660535 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.660526    5722 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb2c99a7-e075-492e-972d-06dee97464b2-maas-api-tls\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:37.724351 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.724303    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"]
Nov 04 02:45:37.785831 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.785794    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"]
Nov 04 02:45:37.938502 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:37.938435    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:38.116597 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:38.116559    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:38.306445 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:38.306354    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb" event={"ID":"fb2c99a7-e075-492e-972d-06dee97464b2","Type":"ContainerDied","Data":"13ce7ae6553957e52c370b7867681fdeb977bec1f0e233e83d8476f1246d4f05"}
Nov 04 02:45:38.306445 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:38.306424    5722 scope.go:122] "RemoveContainer" containerID="2a52eec0e90c7554b862156b77cabdba6756197140c46fb95df725d60972f284"
Nov 04 02:45:38.307032 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:38.306577    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"
Nov 04 02:45:38.477015 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:38.476980    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"]
Nov 04 02:45:38.480865 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:38.480843    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-3353a6-6c54b7fd8c-785lb"]
Nov 04 02:45:38.679361 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:38.679335    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fb2c99a7-e075-492e-972d-06dee97464b2" path="/var/lib/kubelet/pods/fb2c99a7-e075-492e-972d-06dee97464b2/volumes"
Nov 04 02:45:39.588720 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:39.588651    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:40.607285 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:45:40.607254    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:45:42.725571 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:42.725529    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78" podUID="2b5b8b62-db61-4485-aa7a-7c9f38406211" containerName="payload-processing" containerID="cri-o://6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e" gracePeriod=25
Nov 04 02:45:42.787125 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:42.787072    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c" podUID="b5271739-1351-45dc-bded-ea6bfac45443" containerName="payload-pre-processing" containerID="cri-o://90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3" gracePeriod=25
Nov 04 02:45:42.976491 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:42.976440    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:45:43.000187 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.000165    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b5b8b62-db61-4485-aa7a-7c9f38406211-kube-api-access-sb5tg\" (UniqueName: \"kubernetes.io/projected/2b5b8b62-db61-4485-aa7a-7c9f38406211-kube-api-access-sb5tg\") pod \"2b5b8b62-db61-4485-aa7a-7c9f38406211\" (UID: \"2b5b8b62-db61-4485-aa7a-7c9f38406211\") "
Nov 04 02:45:43.000309 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.000205    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b5b8b62-db61-4485-aa7a-7c9f38406211-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b5b8b62-db61-4485-aa7a-7c9f38406211-plugins-config-volume\") pod \"2b5b8b62-db61-4485-aa7a-7c9f38406211\" (UID: \"2b5b8b62-db61-4485-aa7a-7c9f38406211\") "
Nov 04 02:45:43.000565 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.000543    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b5b8b62-db61-4485-aa7a-7c9f38406211-plugins-config-volume" pod "2b5b8b62-db61-4485-aa7a-7c9f38406211" (UID: "2b5b8b62-db61-4485-aa7a-7c9f38406211"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:43.002329 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.002306    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b5b8b62-db61-4485-aa7a-7c9f38406211-kube-api-access-sb5tg" pod "2b5b8b62-db61-4485-aa7a-7c9f38406211" (UID: "2b5b8b62-db61-4485-aa7a-7c9f38406211"). InnerVolumeSpecName "kube-api-access-sb5tg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:43.101221 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.101192    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb5tg\" (UniqueName: \"kubernetes.io/projected/2b5b8b62-db61-4485-aa7a-7c9f38406211-kube-api-access-sb5tg\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:43.101221 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.101217    5722 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b5b8b62-db61-4485-aa7a-7c9f38406211-plugins-config-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:43.335956 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.335864    5722 generic.go:356] "Generic (PLEG): container finished" podID="2b5b8b62-db61-4485-aa7a-7c9f38406211" containerID="6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e" exitCode=0
Nov 04 02:45:43.335956 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.335923    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"
Nov 04 02:45:43.336198 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.335954    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78" event={"ID":"2b5b8b62-db61-4485-aa7a-7c9f38406211","Type":"ContainerDied","Data":"6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e"}
Nov 04 02:45:43.336198 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.336041    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78" event={"ID":"2b5b8b62-db61-4485-aa7a-7c9f38406211","Type":"ContainerDied","Data":"baf5c156fe8ad3d370556acac92ac1e25600ba1a2fc6eb9ada120a8d745a2365"}
Nov 04 02:45:43.336198 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.336073    5722 scope.go:122] "RemoveContainer" containerID="6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e"
Nov 04 02:45:43.344947 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.344932    5722 scope.go:122] "RemoveContainer" containerID="6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e"
Nov 04 02:45:43.345210 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:45:43.345195    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e\": container with ID starting with 6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e not found: ID does not exist" containerID="6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e"
Nov 04 02:45:43.345253 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.345217    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e"} err="failed to get container status \"6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e\": rpc error: code = NotFound desc = could not find container \"6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e\": container with ID starting with 6ecf3d48503463a46c16d9c0043154c7ae512dc10836372e40eed2ff416d6f6e not found: ID does not exist"
Nov 04 02:45:43.504052 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.504009    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"]
Nov 04 02:45:43.510116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.510085    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-3353a6-56549f6c84-72t78"]
Nov 04 02:45:43.565515 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:43.565486    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:44.678704 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:44.678672    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b5b8b62-db61-4485-aa7a-7c9f38406211" path="/var/lib/kubelet/pods/2b5b8b62-db61-4485-aa7a-7c9f38406211/volumes"
Nov 04 02:45:45.281192 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:45.281158    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:48.346399 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:48.346363    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c" podUID="b5271739-1351-45dc-bded-ea6bfac45443" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:45:49.564114 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:49.564084    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:49.742782 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:49.742751    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:50.837642 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:50.837609    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:51.360613 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:51.360581    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:51.949012 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:51.948980    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:52.442483 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:52.442451    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:56.649521 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:56.649486    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:57.366230 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:57.366199    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"]
Nov 04 02:45:57.417829 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:57.417796    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"]
Nov 04 02:45:57.873205 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:57.873171    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:45:58.345464 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:58.345381    5722 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c" podUID="b5271739-1351-45dc-bded-ea6bfac45443" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 02:45:59.489208 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:45:59.489172    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:00.318513 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:00.318480    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:02.097735 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:02.097696    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:03.038185 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.038158    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:46:03.078379 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.078322    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b5271739-1351-45dc-bded-ea6bfac45443-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5271739-1351-45dc-bded-ea6bfac45443-plugins-config-volume\") pod \"b5271739-1351-45dc-bded-ea6bfac45443\" (UID: \"b5271739-1351-45dc-bded-ea6bfac45443\") "
Nov 04 02:46:03.078480 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.078464    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5271739-1351-45dc-bded-ea6bfac45443-kube-api-access-9ghw6\" (UniqueName: \"kubernetes.io/projected/b5271739-1351-45dc-bded-ea6bfac45443-kube-api-access-9ghw6\") pod \"b5271739-1351-45dc-bded-ea6bfac45443\" (UID: \"b5271739-1351-45dc-bded-ea6bfac45443\") "
Nov 04 02:46:03.078750 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.078726    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5271739-1351-45dc-bded-ea6bfac45443-plugins-config-volume" pod "b5271739-1351-45dc-bded-ea6bfac45443" (UID: "b5271739-1351-45dc-bded-ea6bfac45443"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:46:03.080568 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.080538    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5271739-1351-45dc-bded-ea6bfac45443-kube-api-access-9ghw6" pod "b5271739-1351-45dc-bded-ea6bfac45443" (UID: "b5271739-1351-45dc-bded-ea6bfac45443"). InnerVolumeSpecName "kube-api-access-9ghw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:46:03.180110 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.180071    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ghw6\" (UniqueName: \"kubernetes.io/projected/b5271739-1351-45dc-bded-ea6bfac45443-kube-api-access-9ghw6\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:03.180110 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.180109    5722 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5271739-1351-45dc-bded-ea6bfac45443-plugins-config-volume\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:03.446502 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.446469    5722 generic.go:356] "Generic (PLEG): container finished" podID="b5271739-1351-45dc-bded-ea6bfac45443" containerID="90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3" exitCode=0
Nov 04 02:46:03.446727 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.446521    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"
Nov 04 02:46:03.446727 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.446525    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c" event={"ID":"b5271739-1351-45dc-bded-ea6bfac45443","Type":"ContainerDied","Data":"90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3"}
Nov 04 02:46:03.446727 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.446695    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c" event={"ID":"b5271739-1351-45dc-bded-ea6bfac45443","Type":"ContainerDied","Data":"d11fd9386ad6c5678e4065e9ce55311db310631f02fed6b96da810b0363bd2ce"}
Nov 04 02:46:03.446917 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.446737    5722 scope.go:122] "RemoveContainer" containerID="90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3"
Nov 04 02:46:03.455940 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.455922    5722 scope.go:122] "RemoveContainer" containerID="90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3"
Nov 04 02:46:03.456194 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:46:03.456174    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3\": container with ID starting with 90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3 not found: ID does not exist" containerID="90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3"
Nov 04 02:46:03.456265 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.456200    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3"} err="failed to get container status \"90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3\": rpc error: code = NotFound desc = could not find container \"90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3\": container with ID starting with 90f7df7b77e765576ce6bc76a3dc986a5aa9b7ba95e0158ece40ac06edb798f3 not found: ID does not exist"
Nov 04 02:46:03.613781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.613756    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"]
Nov 04 02:46:03.665100 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:03.665065    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-3353a6-95945dd67-pkq4c"]
Nov 04 02:46:04.678811 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:04.678785    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b5271739-1351-45dc-bded-ea6bfac45443" path="/var/lib/kubelet/pods/b5271739-1351-45dc-bded-ea6bfac45443/volumes"
Nov 04 02:46:05.502519 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:05.502477    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:06.426544 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:06.426506    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:06.632192 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:06.632158    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:07.819811 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:07.819773    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:10.607916 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:46:10.607882    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:46:11.745808 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:11.745773    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:12.386809 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.386771    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9" podUID="8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" containerName="main" containerID="cri-o://94e4f6bf594bedd23beee95232beb8372c67c3c1715b822f0d4d0bca329bd08d" gracePeriod=45
Nov 04 02:46:12.437170 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.437132    5722 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn" podUID="040a0d41-ab1b-4057-aea0-dda9cecf3f21" containerName="main" containerID="cri-o://166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02" gracePeriod=45
Nov 04 02:46:12.499219 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.499184    5722 generic.go:356] "Generic (PLEG): container finished" podID="8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" containerID="94e4f6bf594bedd23beee95232beb8372c67c3c1715b822f0d4d0bca329bd08d" exitCode=0
Nov 04 02:46:12.499346 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.499247    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9" event={"ID":"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd","Type":"ContainerDied","Data":"94e4f6bf594bedd23beee95232beb8372c67c3c1715b822f0d4d0bca329bd08d"}
Nov 04 02:46:12.681936 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.681911    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:46:12.708962 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.708049    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:46:12.765879 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.765848    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/040a0d41-ab1b-4057-aea0-dda9cecf3f21-kube-api-access-7bzgg\" (UniqueName: \"kubernetes.io/projected/040a0d41-ab1b-4057-aea0-dda9cecf3f21-kube-api-access-7bzgg\") pod \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") "
Nov 04 02:46:12.766354 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.765911    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-home\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-home\") pod \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") "
Nov 04 02:46:12.766354 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.765955    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tls-certs\") pod \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") "
Nov 04 02:46:12.766354 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.765994    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-dshm\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-dshm\") pod \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") "
Nov 04 02:46:12.766354 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766023    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tmp-dir\") pod \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") "
Nov 04 02:46:12.766354 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766136    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-model-cache\") pod \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") "
Nov 04 02:46:12.766354 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766217    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-home" pod "040a0d41-ab1b-4057-aea0-dda9cecf3f21" (UID: "040a0d41-ab1b-4057-aea0-dda9cecf3f21"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.766354 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766244    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-home\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-home\") pod \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") "
Nov 04 02:46:12.766354 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766246    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tmp-dir" pod "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" (UID: "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.766354 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766297    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tmp-dir\") pod \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") "
Nov 04 02:46:12.766354 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766353    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-dshm\") pod \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") "
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766367    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-model-cache" pod "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" (UID: "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766395    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-kube-api-access-p4rj2\" (UniqueName: \"kubernetes.io/projected/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-kube-api-access-p4rj2\") pod \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\" (UID: \"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd\") "
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766423    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-home" pod "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" (UID: "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766441    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-model-cache\") pod \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") "
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766469    5722 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tls-certs\" (UniqueName: \"kubernetes.io/secret/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tls-certs\") pod \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\" (UID: \"040a0d41-ab1b-4057-aea0-dda9cecf3f21\") "
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766500    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tmp-dir" pod "040a0d41-ab1b-4057-aea0-dda9cecf3f21" (UID: "040a0d41-ab1b-4057-aea0-dda9cecf3f21"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766700    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-model-cache" pod "040a0d41-ab1b-4057-aea0-dda9cecf3f21" (UID: "040a0d41-ab1b-4057-aea0-dda9cecf3f21"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766861    5722 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-model-cache\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766881    5722 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-home\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766897    5722 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tmp-dir\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766908    5722 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-model-cache\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766921    5722 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-home\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.767063 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.766938    5722 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tmp-dir\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.768562 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.768536    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/040a0d41-ab1b-4057-aea0-dda9cecf3f21-kube-api-access-7bzgg" pod "040a0d41-ab1b-4057-aea0-dda9cecf3f21" (UID: "040a0d41-ab1b-4057-aea0-dda9cecf3f21"). InnerVolumeSpecName "kube-api-access-7bzgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:46:12.768696 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.768670    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tls-certs" pod "040a0d41-ab1b-4057-aea0-dda9cecf3f21" (UID: "040a0d41-ab1b-4057-aea0-dda9cecf3f21"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:46:12.768820 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.768805    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-dshm" pod "040a0d41-ab1b-4057-aea0-dda9cecf3f21" (UID: "040a0d41-ab1b-4057-aea0-dda9cecf3f21"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.769060 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.769039    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-dshm" pod "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" (UID: "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.769060 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.769052    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tls-certs" pod "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" (UID: "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:46:12.769158 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.769041    5722 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-kube-api-access-p4rj2" pod "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" (UID: "8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd"). InnerVolumeSpecName "kube-api-access-p4rj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:46:12.867917 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.867882    5722 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/040a0d41-ab1b-4057-aea0-dda9cecf3f21-tls-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.867917 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.867915    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bzgg\" (UniqueName: \"kubernetes.io/projected/040a0d41-ab1b-4057-aea0-dda9cecf3f21-kube-api-access-7bzgg\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.868160 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.867931    5722 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-tls-certs\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.868160 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.867940    5722 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/040a0d41-ab1b-4057-aea0-dda9cecf3f21-dshm\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.868160 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.867948    5722 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-dshm\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.868160 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:12.867956    5722 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4rj2\" (UniqueName: \"kubernetes.io/projected/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd-kube-api-access-p4rj2\") on node \"ip-10-0-136-190.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:13.504875 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.504842    5722 generic.go:356] "Generic (PLEG): container finished" podID="040a0d41-ab1b-4057-aea0-dda9cecf3f21" containerID="166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02" exitCode=0
Nov 04 02:46:13.505070 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.504888    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"
Nov 04 02:46:13.505070 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.504928    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn" event={"ID":"040a0d41-ab1b-4057-aea0-dda9cecf3f21","Type":"ContainerDied","Data":"166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02"}
Nov 04 02:46:13.505070 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.504979    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn" event={"ID":"040a0d41-ab1b-4057-aea0-dda9cecf3f21","Type":"ContainerDied","Data":"7d82e874fe9083439b8ef74219729ba78f20ceb441629d843e0c2e4e6bb9b84f"}
Nov 04 02:46:13.505070 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.504996    5722 scope.go:122] "RemoveContainer" containerID="166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02"
Nov 04 02:46:13.506370 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.506355    5722 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"
Nov 04 02:46:13.506441 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.506380    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9" event={"ID":"8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd","Type":"ContainerDied","Data":"92fcba9161a1c1d10aa132d6417fe9e95049c69f70aa1e5ea2d59561ddf984e1"}
Nov 04 02:46:13.514035 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.514017    5722 scope.go:122] "RemoveContainer" containerID="166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02"
Nov 04 02:46:13.514359 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:46:13.514322    5722 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02\": container with ID starting with 166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02 not found: ID does not exist" containerID="166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02"
Nov 04 02:46:13.514453 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.514372    5722 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02"} err="failed to get container status \"166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02\": rpc error: code = NotFound desc = could not find container \"166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02\": container with ID starting with 166f41320a6ce90dcef1f0faccfc9be764ea364f8c66811a536b73c14b3b8d02 not found: ID does not exist"
Nov 04 02:46:13.514453 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.514397    5722 scope.go:122] "RemoveContainer" containerID="94e4f6bf594bedd23beee95232beb8372c67c3c1715b822f0d4d0bca329bd08d"
Nov 04 02:46:13.673077 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.672999    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"]
Nov 04 02:46:13.677474 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.677449    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/simulator-w2-1e4f1e-kserve-5c986cf7dc-nfnxn"]
Nov 04 02:46:13.838301 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.838265    5722 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"]
Nov 04 02:46:13.842166 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:13.842139    5722 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-2-w2-1e4f1e-kserve-5dc6659f4b-v22c9"]
Nov 04 02:46:14.678552 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:14.678518    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="040a0d41-ab1b-4057-aea0-dda9cecf3f21" path="/var/lib/kubelet/pods/040a0d41-ab1b-4057-aea0-dda9cecf3f21/volumes"
Nov 04 02:46:14.678938 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:14.678924    5722 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" path="/var/lib/kubelet/pods/8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd/volumes"
Nov 04 02:46:17.536752 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:17.536720    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:18.054709 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:18.054673    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:23.637744 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:23.637708    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:23.818899 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:23.818868    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:26.209822 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:26.209779    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:26.405249 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:26.405209    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:26.890285 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:26.890248    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:28.855092 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:28.855060    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:46:28.860377 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:28.860357    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:46:28.980861 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:28.980836    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-sxrh5_69dc840b-bd18-41ad-a213-f0d2c1252fca/console-operator/2.log"
Nov 04 02:46:28.986026 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:28.986000    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgm27_9a21ec19-27ea-4fd8-bbeb-154ef1063833/ovn-acl-logging/0.log"
Nov 04 02:46:29.413348 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:29.413322    5722 scope.go:122] "RemoveContainer" containerID="a4a9d57ae07aff36fb7c2048dc0f3f83af2eb92e7714795b9633066dbe8f52bb"
Nov 04 02:46:29.781095 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:29.781000    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:30.324170 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:30.324139    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:32.765116 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:32.765081    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:32.944094 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:32.944066    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:35.533741 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:35.533713    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-9x7xf_50ff7381-5e3b-44cb-ae1c-208ec2ab5b09/manager/0.log"
Nov 04 02:46:35.787489 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:35.787398    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-z6pgx_0a669c84-a538-413e-8da1-99d0aa4e0d66/manager/0.log"
Nov 04 02:46:37.069867 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:37.069838    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-zbm8q_53d77ce1-83c0-4e7c-9249-ac9c047e8954/proxy/0.log"
Nov 04 02:46:38.900546 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:38.900500    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:46:40.608420 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:46:40.608377    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:46:55.132017 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:55.131980    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-9x7xf_50ff7381-5e3b-44cb-ae1c-208ec2ab5b09/manager/0.log"
Nov 04 02:46:55.420715 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:55.420622    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-z6pgx_0a669c84-a538-413e-8da1-99d0aa4e0d66/manager/0.log"
Nov 04 02:46:56.763543 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:46:56.763515    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-zbm8q_53d77ce1-83c0-4e7c-9249-ac9c047e8954/proxy/0.log"
Nov 04 02:47:00.722122 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:00.722083    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:47:04.179884 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:04.179853    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-lwlzf_c07e2a7b-8139-48f7-aaf8-4b9579003b57/discovery/0.log"
Nov 04 02:47:04.628781 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:04.628753    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d555fc4c8-6r5vq_d38c5f91-ffbf-4780-8675-6fd1c01ab733/kube-auth-proxy/0.log"
Nov 04 02:47:05.152728 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:05.152697    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-7r6mg_bde9bff4-3d54-471d-ae04-e7fa835fb4e1/istio-proxy/0.log"
Nov 04 02:47:05.867672 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:05.867633    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-c8n4k_19ed5670-9c9e-45f9-a9bd-e1f273e50527/istio-proxy/0.log"
Nov 04 02:47:06.879712 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:06.879685    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-wpdjn_46833101-49be-437f-8ad5-3d332bdb85e0/istio-proxy/0.log"
Nov 04 02:47:08.134274 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:08.134243    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b8f6d865c-c8tlq_2e4e9c2c-7e7b-45d1-8e50-d850011dea19/router/0.log"
Nov 04 02:47:10.607204 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:47:10.607167    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:47:20.329236 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:20.329203    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:47:22.167772 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.167737    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:47:22.257577 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.257537    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpqsl/must-gather-tsl6l"]
Nov 04 02:47:22.257983 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.257964    5722 cpu_manager.go:414] "containerMap: removing container" podUID="b5271739-1351-45dc-bded-ea6bfac45443" containerName="payload-pre-processing"
Nov 04 02:47:22.258076 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.257985    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5271739-1351-45dc-bded-ea6bfac45443" containerName="payload-pre-processing"
Nov 04 02:47:22.258076 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258013    5722 cpu_manager.go:414] "containerMap: removing container" podUID="040a0d41-ab1b-4057-aea0-dda9cecf3f21" containerName="main"
Nov 04 02:47:22.258076 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258021    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="040a0d41-ab1b-4057-aea0-dda9cecf3f21" containerName="main"
Nov 04 02:47:22.258076 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258029    5722 cpu_manager.go:414] "containerMap: removing container" podUID="fb2c99a7-e075-492e-972d-06dee97464b2" containerName="maas-api"
Nov 04 02:47:22.258076 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258036    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fb2c99a7-e075-492e-972d-06dee97464b2" containerName="maas-api"
Nov 04 02:47:22.258076 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258055    5722 cpu_manager.go:414] "containerMap: removing container" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerName="cleanup"
Nov 04 02:47:22.258076 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258061    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerName="cleanup"
Nov 04 02:47:22.258076 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258072    5722 cpu_manager.go:414] "containerMap: removing container" podUID="8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" containerName="main"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258080    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" containerName="main"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258100    5722 cpu_manager.go:414] "containerMap: removing container" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258108    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258119    5722 cpu_manager.go:414] "containerMap: removing container" podUID="2b5b8b62-db61-4485-aa7a-7c9f38406211" containerName="payload-processing"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258126    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b5b8b62-db61-4485-aa7a-7c9f38406211" containerName="payload-processing"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258140    5722 cpu_manager.go:414] "containerMap: removing container" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerName="cleanup"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258149    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerName="cleanup"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258160    5722 cpu_manager.go:414] "containerMap: removing container" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerName="cleanup"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258166    5722 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerName="cleanup"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258258    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerName="cleanup"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258271    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5271739-1351-45dc-bded-ea6bfac45443" containerName="payload-pre-processing"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258281    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="040a0d41-ab1b-4057-aea0-dda9cecf3f21" containerName="main"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258291    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="fb2c99a7-e075-492e-972d-06dee97464b2" containerName="maas-api"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258300    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f1c2fdd-9af7-439d-a5e7-09c3e02de2cd" containerName="main"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258310    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="781e5a65-33be-432b-9445-f5ce66d9274f" containerName="payload-processing"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258319    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b5b8b62-db61-4485-aa7a-7c9f38406211" containerName="payload-processing"
Nov 04 02:47:22.258461 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258328    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerName="cleanup"
Nov 04 02:47:22.259312 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.258487    5722 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f7c1c83-43e8-4b01-a210-63807a91a48b" containerName="cleanup"
Nov 04 02:47:22.261627 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.261607    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpqsl/must-gather-tsl6l"
Nov 04 02:47:22.315846 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.315814    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpqsl\"/\"kube-root-ca.crt\""
Nov 04 02:47:22.359587 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.359557    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:47:22.366788 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.366762    5722 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpqsl\"/\"openshift-service-ca.crt\""
Nov 04 02:47:22.366788 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.366785    5722 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wpqsl\"/\"default-dockercfg-qfzcp\""
Nov 04 02:47:22.368059 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.368043    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpqsl/must-gather-tsl6l"]
Nov 04 02:47:22.383329 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.383308    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tv9q\" (UniqueName: \"kubernetes.io/projected/b7f4b968-2946-4f38-8a9b-436501137bd6-kube-api-access-9tv9q\") pod \"must-gather-tsl6l\" (UID: \"b7f4b968-2946-4f38-8a9b-436501137bd6\") " pod="openshift-must-gather-wpqsl/must-gather-tsl6l"
Nov 04 02:47:22.383416 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.383336    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7f4b968-2946-4f38-8a9b-436501137bd6-must-gather-output\") pod \"must-gather-tsl6l\" (UID: \"b7f4b968-2946-4f38-8a9b-436501137bd6\") " pod="openshift-must-gather-wpqsl/must-gather-tsl6l"
Nov 04 02:47:22.484677 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.484573    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tv9q\" (UniqueName: \"kubernetes.io/projected/b7f4b968-2946-4f38-8a9b-436501137bd6-kube-api-access-9tv9q\") pod \"must-gather-tsl6l\" (UID: \"b7f4b968-2946-4f38-8a9b-436501137bd6\") " pod="openshift-must-gather-wpqsl/must-gather-tsl6l"
Nov 04 02:47:22.484677 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.484608    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7f4b968-2946-4f38-8a9b-436501137bd6-must-gather-output\") pod \"must-gather-tsl6l\" (UID: \"b7f4b968-2946-4f38-8a9b-436501137bd6\") " pod="openshift-must-gather-wpqsl/must-gather-tsl6l"
Nov 04 02:47:22.485010 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.484990    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7f4b968-2946-4f38-8a9b-436501137bd6-must-gather-output\") pod \"must-gather-tsl6l\" (UID: \"b7f4b968-2946-4f38-8a9b-436501137bd6\") " pod="openshift-must-gather-wpqsl/must-gather-tsl6l"
Nov 04 02:47:22.546892 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.546862    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tv9q\" (UniqueName: \"kubernetes.io/projected/b7f4b968-2946-4f38-8a9b-436501137bd6-kube-api-access-9tv9q\") pod \"must-gather-tsl6l\" (UID: \"b7f4b968-2946-4f38-8a9b-436501137bd6\") " pod="openshift-must-gather-wpqsl/must-gather-tsl6l"
Nov 04 02:47:22.587902 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.587876    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpqsl/must-gather-tsl6l"
Nov 04 02:47:22.954397 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:47:22.954353    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7f4b968_2946_4f38_8a9b_436501137bd6.slice/crio-48dde0190bd5a5fa6630ec741fcdf5593c4c6d57eb3c86e1ef0517328fe46c45 WatchSource:0}: Error finding container 48dde0190bd5a5fa6630ec741fcdf5593c4c6d57eb3c86e1ef0517328fe46c45: Status 404 returned error can't find the container with id 48dde0190bd5a5fa6630ec741fcdf5593c4c6d57eb3c86e1ef0517328fe46c45
Nov 04 02:47:22.956746 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.956722    5722 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:47:22.995881 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:22.995849    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpqsl/must-gather-tsl6l"]
Nov 04 02:47:23.831944 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:23.831909    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpqsl/must-gather-tsl6l" event={"ID":"b7f4b968-2946-4f38-8a9b-436501137bd6","Type":"ContainerStarted","Data":"48dde0190bd5a5fa6630ec741fcdf5593c4c6d57eb3c86e1ef0517328fe46c45"}
Nov 04 02:47:24.838079 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:24.837984    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpqsl/must-gather-tsl6l" event={"ID":"b7f4b968-2946-4f38-8a9b-436501137bd6","Type":"ContainerStarted","Data":"ad179bf5ba00c41ae5ebcf57439f178b7d780ae3a91eed3da205371a7a0a71cf"}
Nov 04 02:47:24.838079 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:24.838023    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpqsl/must-gather-tsl6l" event={"ID":"b7f4b968-2946-4f38-8a9b-436501137bd6","Type":"ContainerStarted","Data":"3c855e7e86766989a440a018dd5948ba117c30a9f6f53f115a37d81d4abb5ff5"}
Nov 04 02:47:24.961960 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:24.961909    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-wpqsl/must-gather-tsl6l" podStartSLOduration=1.423195642 podStartE2EDuration="2.961890273s" totalImagesPullingTime="1.538694631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:47:24.96052428 +0000 UTC m=+1856.434061460" watchObservedRunningTime="2026-11-04 02:47:24.961890273 +0000 UTC m=+1856.435427454"
Nov 04 02:47:32.371679 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:32.370485    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jzwmx_dcca8570-7261-499b-938a-10097ca652b0/global-pull-secret-syncer/0.log"
Nov 04 02:47:32.741789 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:32.741680    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:47:33.532584 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:33.530639    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:47:33.608676 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:33.608267    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-4sqvd_1486093b-695f-4ba3-8737-385bfe779147/connection-checker/0.log"
Nov 04 02:47:34.030680 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:34.030322    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-6dk89_735db15d-9069-4b87-ab87-7ed88d365bdb/connection-checker/0.log"
Nov 04 02:47:34.468011 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:34.467972    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-bxplw_be37687a-5d12-4543-83eb-61961531f81f/connection-checker/0.log"
Nov 04 02:47:34.537176 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:34.537145    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-9x7xf_50ff7381-5e3b-44cb-ae1c-208ec2ab5b09/manager/0.log"
Nov 04 02:47:34.897903 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:34.897868    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-z6pgx_0a669c84-a538-413e-8da1-99d0aa4e0d66/manager/0.log"
Nov 04 02:47:34.973580 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:34.973246    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log"
Nov 04 02:47:36.180259 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:36.180226    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-zbm8q_53d77ce1-83c0-4e7c-9249-ac9c047e8954/proxy/0.log"
Nov 04 02:47:37.089162 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:37.089130    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-190.us-west-2.compute.internal_c60ccd19b86040261adde19f6117c493/haproxy/0.log"
Nov 04 02:47:39.485372 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:39.485329    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-9x7xf_50ff7381-5e3b-44cb-ae1c-208ec2ab5b09/manager/0.log"
Nov 04 02:47:39.812714 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:39.812607    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-z6pgx_0a669c84-a538-413e-8da1-99d0aa4e0d66/manager/0.log"
Nov 04 02:47:40.614637 ip-10-0-136-190 kubenswrapper[5722]: E1104 02:47:40.614089    5722 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v29px" containerName="extractor"
Nov 04 02:47:41.179526 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.179481    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-zbm8q_53d77ce1-83c0-4e7c-9249-ac9c047e8954/proxy/0.log"
Nov 04 02:47:41.798841 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.798806    5722 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"]
Nov 04 02:47:41.803840 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.803820    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.855244 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.855213    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-sys\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.855477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.855270    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-lib-modules\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.855477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.855365    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-proc\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.855477 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.855417    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf9tl\" (UniqueName: \"kubernetes.io/projected/ac26e482-fedb-4072-99a5-9c1cc7d3398a-kube-api-access-hf9tl\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.855719 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.855570    5722 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-podres\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.887208 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.887173    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"]
Nov 04 02:47:41.957217 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.957187    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-podres\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.957429 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.957242    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-sys\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.957429 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.957331    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-sys\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.957429 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.957335    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-podres\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.957429 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.957374    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-lib-modules\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.957429 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.957394    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-proc\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.957429 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.957429    5722 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf9tl\" (UniqueName: \"kubernetes.io/projected/ac26e482-fedb-4072-99a5-9c1cc7d3398a-kube-api-access-hf9tl\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.957867 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.957457    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-lib-modules\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:41.957867 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:41.957502    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac26e482-fedb-4072-99a5-9c1cc7d3398a-proc\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:42.020836 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:42.020803    5722 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf9tl\" (UniqueName: \"kubernetes.io/projected/ac26e482-fedb-4072-99a5-9c1cc7d3398a-kube-api-access-hf9tl\") pod \"perf-node-gather-daemonset-grsqq\" (UID: \"ac26e482-fedb-4072-99a5-9c1cc7d3398a\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:42.117343 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:42.117308    5722 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:42.492376 ip-10-0-136-190 kubenswrapper[5722]: W1104 02:47:42.492292    5722 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac26e482_fedb_4072_99a5_9c1cc7d3398a.slice/crio-7f57d8e01edfc4050e1e0925228394d54ac774461a890234be6e600db81de525 WatchSource:0}: Error finding container 7f57d8e01edfc4050e1e0925228394d54ac774461a890234be6e600db81de525: Status 404 returned error can't find the container with id 7f57d8e01edfc4050e1e0925228394d54ac774461a890234be6e600db81de525
Nov 04 02:47:42.493996 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:42.493973    5722 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"]
Nov 04 02:47:42.962922 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:42.962888    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq" event={"ID":"ac26e482-fedb-4072-99a5-9c1cc7d3398a","Type":"ContainerStarted","Data":"75af21c36c2fb50048bf213dff5c7e14510b9b60c986b9e9b7944bb6a07ff58b"}
Nov 04 02:47:42.963317 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:42.962938    5722 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq" event={"ID":"ac26e482-fedb-4072-99a5-9c1cc7d3398a","Type":"ContainerStarted","Data":"7f57d8e01edfc4050e1e0925228394d54ac774461a890234be6e600db81de525"}
Nov 04 02:47:42.963317 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:42.962966    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:43.085930 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:43.084240    5722 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq" podStartSLOduration=2.0842232 podStartE2EDuration="2.0842232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:47:43.082950614 +0000 UTC m=+1874.556487797" watchObservedRunningTime="2026-11-04 02:47:43.0842232 +0000 UTC m=+1874.557760381"
Nov 04 02:47:44.447837 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:44.447806    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-9x7xf_50ff7381-5e3b-44cb-ae1c-208ec2ab5b09/manager/0.log"
Nov 04 02:47:44.736965 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:44.736887    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-z6pgx_0a669c84-a538-413e-8da1-99d0aa4e0d66/manager/0.log"
Nov 04 02:47:45.917481 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:45.917455    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-zbm8q_53d77ce1-83c0-4e7c-9249-ac9c047e8954/proxy/0.log"
Nov 04 02:47:48.184211 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:48.184181    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-vckzn_aece3088-8729-43a1-8533-7bdd145d2fdd/cluster-monitoring-operator/0.log"
Nov 04 02:47:48.979292 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:48.979259    5722 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-grsqq"
Nov 04 02:47:50.380911 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:50.380877    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-lwlzf_c07e2a7b-8139-48f7-aaf8-4b9579003b57/discovery/0.log"
Nov 04 02:47:50.648276 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:50.648192    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2n7wg_094a872b-f79f-4899-8b8b-c84b58335ea5/node-exporter/0.log"
Nov 04 02:47:50.716953 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:50.716920    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d555fc4c8-6r5vq_d38c5f91-ffbf-4780-8675-6fd1c01ab733/kube-auth-proxy/0.log"
Nov 04 02:47:51.042877 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:51.042805    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2n7wg_094a872b-f79f-4899-8b8b-c84b58335ea5/kube-rbac-proxy/0.log"
Nov 04 02:47:51.172614 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:51.172589    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-7r6mg_bde9bff4-3d54-471d-ae04-e7fa835fb4e1/istio-proxy/0.log"
Nov 04 02:47:51.436908 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:51.436878    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2n7wg_094a872b-f79f-4899-8b8b-c84b58335ea5/init-textfile/0.log"
Nov 04 02:47:51.828706 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:51.828612    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-c8n4k_19ed5670-9c9e-45f9-a9bd-e1f273e50527/istio-proxy/0.log"
Nov 04 02:47:52.720167 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:52.720135    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-wpdjn_46833101-49be-437f-8ad5-3d332bdb85e0/istio-proxy/0.log"
Nov 04 02:47:53.851319 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:47:53.851290    5722 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b8f6d865c-c8tlq_2e4e9c2c-7e7b-45d1-8e50-d850011dea19/router/0.log"
Nov 04 02:48:01.037497 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:48:01.037463    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024
Nov 04 02:48:01.318600 ip-10-0-136-190 kubenswrapper[5722]: I1104 02:48:01.318523    5722 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6npmv_4753b15c-2b1c-4ecc-a5d3-1d6a17d35d10/konnectivity-agent/0.log" limit=1024